On-device document AI for accountants who cannot upload client data
Yes, accounting and tax professionals can use AI to read source documents, draft workpapers, and check figures without breaching confidentiality. The way to do it is on-device document AI, where the model runs on your own computer and client data stays on the machine. Apioni is one such tool. It is a desktop app that processes tax returns, payroll files, bank statements, and identity documents locally, so AI for accountants no longer has to mean uploading sensitive financial data to a third-party cloud. This article explains what on-device document AI is, how to verify that client data stays put, and how source-cited output fits your duty to substantiate your work.
Why accountants cannot just paste client data into cloud AI
The capability question is settled. A large language model can summarize a 60-page engagement file, pull figures from a bank statement, and draft a memo in seconds. The blocker is confidentiality.
Client tax returns, payroll registers, bank statements, and identity documents carry a professional and legal duty of confidentiality. Most cloud AI tools require uploading that content to a third-party server, where it leaves your control and may be retained, logged, or used in ways your engagement terms do not permit. For a firm, that creates exposure on three fronts at once.
- Professional duty. Confidentiality obligations to clients generally do not contemplate routing their financial records through an outside AI vendor.
- Engagement and contractual terms. Many engagement letters and data processing agreements restrict where client data may be sent and who may access it.
- Regulatory exposure. Depending on jurisdiction, financial and personal data carries data residency and protection requirements that a cloud upload can violate.
"Is ChatGPT safe for client tax documents?" is the wrong framing. The more useful question is whether the client's data ever has to leave your machine at all.
What on-device document AI actually means
On-device means the software runs entirely on the user's own computer, using local computing resources, rather than sending work to a remote server. On-device document AI therefore keeps both the AI model and your documents on the same machine.
In practice this requires two local components.
- A local LLM, the model that reads and writes text, running on your computer instead of in a vendor's cloud.
- Local embeddings, a model that converts your documents into searchable numerical representations, also running locally.
When both run on your machine, document content is confined to localhost, the loopback address that stays inside the device. A related term is an air-gapped network, which is a system kept physically isolated from the public internet. Apioni does not require an air-gapped setup, but the privacy goal is similar: keep your clients' financial and personal data from being transmitted to and stored on an external server.
On-device processing protects against that specific transmission risk. It does not replace ordinary endpoint hygiene such as disk encryption, access control, and physical security of the computer itself, which remain your responsibility.
How Apioni keeps document content on your machine, and how to verify it
Apioni is an on-device document AI desktop app built with Tauri, signed and notarized on macOS and available for Windows. It runs a local LLM (Ollama with a Qwen3-family model) and a local embedding model (bge-m3) directly on your computer.
All document processing goes only to the local engine on your machine at localhost. Your document content never leaves your computer. The one connection Apioni makes to the internet is a version check to apioni.com when the app launches, and that request carries no document content and only checks whether a newer version exists. There is no usage telemetry.
The point that matters for a firm is that you do not have to take this on trust. You can confirm it yourself.
- Use the in-app network self-check, which surfaces what the app connects to.
- Use standard operating system tools such as lsof to list the app's open network connections and confirm that the only outbound traffic is the version check, with no document content in flight.
Practical scenarios for accounting and tax work
- Summarizing source materials. Connect a folder for an engagement and get a structured summary of the file before you start fieldwork, without uploading anything.
- Checking figures and references. Ask where a number appears across the documents and read the cited passage it came from, rather than trusting a figure with no provenance.
- Drafting memos and documents. Produce a first draft of a memo, a client letter, or a section of workpapers, with citations back to the underlying source so a reviewer can check the basis.
How the retrieval works and why citations matter for review
Apioni indexes your connected documents locally, then answers questions, summarizes, and drafts while citing the source passages it relied on. It uses hybrid search, which combines keyword search (BM25) with semantic search and fuses the two result sets using Reciprocal Rank Fusion (RRF), so that both exact-term matches and meaning-based matches surface.
This matters for accounting specifically because the output is traceable. A figure or statement comes attached to the passage it was drawn from, which fits how review and workpaper documentation actually work. A reviewer can follow a conclusion back to its source rather than accepting a black-box answer. Source-cited output supports the duty to substantiate the positions in a return or a set of workpapers, instead of asking you to trust the model as an oracle.
Comparison: cloud document AI vs Apioni on-device
| Aspect | On-device (Apioni) | Cloud document AI |
|---|---|---|
| Where data is processed | Your own machine (localhost) | External vendor servers |
| Outbound connections | Version check to apioni.com only, no document content | Documents uploaded to the provider |
| Usage telemetry | None | Varies, often present |
| Source citations | Yes, cites source passages | Varies |
| Licensing | One-time purchase, company-wide, no device limit | Typically per-seat subscription |
| Offline use | Works without an internet connection | Requires connectivity |
| Verifiability | In-app self-check and lsof | Trust the provider's policy |
Pricing and rollout for a firm
Apioni is a one-time purchase of KRW 39,000 with no subscription. The license is company-wide with no device limit, so a firm can deploy it across the practice without per-seat math. There is a 14-day free trial that requires no card or payment details, which makes a low-risk pilot straightforward. Run it against a real engagement folder on one machine, use the network self-check to confirm the data behavior, and then roll it out.
Start the 14-day trial on one workstation, or buy a company-wide license once it has cleared your review.
Frequently asked questions
Is my client data sent anywhere when I use Apioni?
No. All document processing happens on your own machine at localhost, and your document content never leaves your computer. The only outbound connection is a version check to apioni.com at launch, which carries no document content and has no usage telemetry.
Can I run Apioni completely offline?
Yes. Apioni runs the LLM and embedding model locally, so it works without an internet connection. The only thing that needs connectivity is the version check at launch, and document processing does not depend on it.
How can I verify that document content never leaves my computer?
You can check it yourself rather than relying on a policy statement. Use the in-app network self-check to see what the app connects to, or use standard OS tools such as lsof to list the app's open connections and confirm that the only outbound traffic is the version check.
Does Apioni show where its answers and figures come from?
Yes. Apioni cites the source passages behind its answers, summaries, and drafts. It uses hybrid retrieval, which is BM25 keyword search plus semantic search fused with RRF, so you can trace a figure or statement back to the document it came from. That traceability supports review and workpaper documentation.
Is it a subscription, and can the whole firm use one license?
It is not a subscription. Apioni is a one-time purchase of KRW 39,000, and the license is company-wide with no device limit, so the whole firm can use it. A 14-day free trial with no card required lets you evaluate it first.