Receipt Capture and Categorization for Bookkeeper Review
An agent extracts vendor, date, amount, and tax from receipts in email, Drive, or photos, suggests a category from your own chart of accounts, and queues drafts in QuickBooks or Xero for a bookkeeper to approve.
The problem
Receipts arrive everywhere: forwarded emails, PDF invoices in Drive, phone photos of paper slips, and supplier portals. Someone has to collect them, read each one, work out which account it belongs to, match it to the bank transaction, and attach it in the accounting system. For a small business this often piles up until month end or tax season, when the bookkeeper is chasing missing receipts and guessing at categories. Errors compound: a misread amount, a duplicate entry, or a personal expense coded as business. This recipe uses an agent to do the first pass, extracting the key fields, suggesting a category based on your own chart of accounts and past decisions, and preparing draft matches. Anything uncertain or above a set amount goes to the bookkeeper, who approves every entry. The agent gives no tax advice and never deletes source documents.
Who it's for
- Small businesses processing roughly 50 or more receipts per month
- Owners who work with an in-house or outside bookkeeper using QuickBooks Online or Xero
- Businesses whose receipts are scattered across email, Google Drive, and phone photos
- Teams with a stable chart of accounts and some history of categorized transactions
Not a fit when
- Businesses without a bookkeeper or accountant to review entries; the agent should not be the final word on your books
- Situations needing tax treatment decisions, such as capitalizing assets or apportioning mixed-use expenses, which require professional judgment
- Very low volumes where your accounting software's built-in receipt capture already covers the need
Tools
| Gmail with a dedicated receipts label or address | Collects emailed receipts and invoices in one place |
| Google Drive folder | Stores receipt PDFs and phone photos; the original files are never deleted |
| Claude or another LLM with document and image input | Reads receipts and extracts vendor, date, amount, tax, and line details |
| Google Sheets review queue | Lists extracted fields, suggested category, confidence, and bookkeeper decisions |
| QuickBooks Online or Xero | Receives draft entries or attachments for matching after approval |
| Zapier or Make | Moves new receipts to the agent and approved rows into the accounting system |
Inputs you need first
- Your chart of accounts exported from QuickBooks or Xero, with account names and codes
- A history of categorized transactions or vendor rules, ideally the last 6 to 12 months
- A single collection point for receipts: a Gmail label or forwarding address and a Drive folder
- The amount threshold above which every receipt needs bookkeeper review
- Accounting system access for an automation user with the narrowest permissions that allow drafts or attachments
- Your bookkeeper's agreement on the review process and turnaround
Step-by-step build
Set up one intake point
Create a Gmail label such as Receipts with a filter for common receipt senders, plus a forwarding address team members can send receipts to. Create a Drive folder with subfolders for Inbox, Processed, and Needs Info. Ask the team to save phone photos into Inbox using a shared folder on their phones. Originals stay in Drive permanently; the workflow only moves or copies them, never deletes.
Export the chart of accounts and vendor rules
Export your chart of accounts and put it in a Sheet tab with columns: account_code, account_name, account_type, description, active. Export past categorized transactions and build a Vendor Rules tab: vendor_name, usual_account, notes, last_reviewed. Have the bookkeeper review this tab once before launch. The agent may only suggest accounts that appear in the active chart of accounts.
Build the review queue
Create a Review Queue tab with columns: receipt_id, source_link, vendor, receipt_date, subtotal, tax_amount, total, currency, payment_method_hint, suggested_account, reason, confidence, possible_duplicate, bookkeeper_account, bookkeeper_decision, approved_by, approved_date, accounting_ref. The source_link points to the original file so the reviewer can always see the actual receipt.
Configure extraction
Set Zapier or Make to trigger on new files in the Drive Inbox or new labeled emails. Send the image or PDF to the agent with the prompt below. Require structured output for each field, with 'unreadable' instead of a guess when a value is unclear. Ask the agent to check that subtotal plus tax equals total and flag it if not. Write the results to the Review Queue.
Suggest categories from your own rules
Pass the Vendor Rules and active chart of accounts with each receipt. The agent first checks for a vendor rule match, then uses the account descriptions, and gives a one-line reason, such as 'vendor rule: monthly software subscription'. It must choose from your accounts only. If nothing fits clearly, it sets suggested_account to 'needs bookkeeper' and confidence to low.
Apply confidence and amount thresholds
Define routing rules you adjust with your bookkeeper. Example: high confidence and total under your threshold, such as 250 in your currency, go to a quick-approve view; low or medium confidence, any total over the threshold, missing tax, mismatched totals, possible duplicates, foreign currency, or new vendors always go to full bookkeeper review. Even quick-approve rows need a human click; nothing posts automatically.
Detect duplicates
Before a row enters the queue, compare vendor, date, and total against existing rows and against recent transactions in your accounting system export. Mark possible_duplicate with the matching receipt_id. Duplicates often come from a receipt that was emailed and also photographed. The bookkeeper decides which to keep; the agent never removes either file.
Bookkeeper approves and creates drafts
The bookkeeper works through the queue, confirms or changes the account, and marks approve, reject, or needs info. Approved rows trigger the automation to attach the receipt to the matching bank transaction or create a draft or unposted entry in QuickBooks or Xero, depending on what your setup supports. The bookkeeper finalizes the match in the accounting system. Write the accounting reference back to the queue.
Test with last month's receipts
Before going live, run 30 to 50 receipts from a month your bookkeeper already closed. Compare extracted amounts, dates, and tax to the actual records, and suggested accounts to what was booked. Include a few blurry photos, a foreign currency receipt, and a known duplicate. Tighten the prompt, vendor rules, and thresholds until the bookkeeper is comfortable with the review load.
Maintain monthly
Each month, review the bookkeeper's changes in the queue. When a vendor is recategorized consistently, add or update its vendor rule. Deactivate accounts in the tab when they are retired in the accounting system. Check the Needs Info folder and chase missing receipts. Re-run the test set after any change to the prompt or chart of accounts.
Example agent instructions
Adapt this to your business. Placeholders in braces are filled by your automation tool.
You help prepare receipts for bookkeeper review at {business_name}. You extract data and suggest a category; you never post entries, give tax advice, or decide tax treatment. From the receipt provided, extract: vendor, receipt_date, subtotal, tax_amount, total, currency, payment method hints such as last four digits if printed, and a short description of what was purchased. If any value is unclear or missing, write 'unreadable' rather than guessing. Check whether subtotal plus tax equals total and say so. Then suggest one account from this active chart of accounts only: {chart_of_accounts}. First check these vendor rules: {vendor_rules}. Give a one-line reason and a confidence of high, medium, or low. Use low confidence and suggest 'needs bookkeeper' if the purchase could reasonably fit more than one account, appears personal, looks like an asset purchase, involves a foreign currency, or the vendor is new. Do not comment on deductibility or tax rules. Return the result as structured fields. Receipt source: {source_link}. Receipt content: {receipt_file}.
Human sign-off points
- Bookkeeper reviews and approves the chart of accounts tab, vendor rules, and routing thresholds before launch
- Bookkeeper approves every receipt in the queue before anything is attached or drafted in QuickBooks or Xero
- Bookkeeper personally reviews all low-confidence, over-threshold, duplicate, and new-vendor items
- Owner or accountant decides any tax treatment question flagged by the bookkeeper
- Bookkeeper finalizes and posts entries in the accounting system; the workflow only creates drafts or attachments
Guardrails
- The agent gives no tax advice and makes no statements about deductibility or tax treatment
- Low-confidence and over-threshold items always go to a person; there is no auto-approve path
- Suggested categories must come from the active chart of accounts; anything else becomes 'needs bookkeeper'
- Source receipts are never deleted; files are only moved or copied, and every row links to the original
- Unclear values are marked 'unreadable' instead of estimated
- The accounting system integration creates drafts or attachments only, using a limited-permission user
- Possible duplicates are flagged for the bookkeeper and neither copy is removed automatically
- Receipt files and extracted data stay in your own Drive and accounting system, with access limited to people who need it
Expected time saved
Estimate: if your bookkeeper processes about 150 receipts a month at roughly 3 to 4 minutes each for reading, keying, categorizing, and attaching, that is around 8 to 10 hours monthly. Reviewing pre-extracted rows with a suggested category might take closer to 1 minute for routine items, while flagged items still need full attention. Results depend on receipt quality, vendor consistency, and how many items fall above your thresholds.
How to tell it's working
- Share of suggested accounts the bookkeeper changes, tracked monthly
- Extraction errors found in review, such as wrong amount or date
- Days from receipt arrival to approved entry in the accounting system
- Number of missing or Needs Info receipts at month end
FAQ
Doesn't QuickBooks or Xero already read receipts?
Both offer receipt capture features, and if those cover your needs, start there. This recipe adds value when receipts are scattered across inboxes and Drive, when you want suggestions grounded in your own vendor rules and account descriptions, or when you want a single review queue with thresholds and a full audit trail your bookkeeper controls.
Can the agent tell me whether an expense is deductible?
No. This recipe deliberately keeps the agent out of tax decisions. It suggests an account from your chart and flags items that might need special treatment, such as possible asset purchases or mixed personal use. Your bookkeeper or accountant decides tax treatment, because it depends on your jurisdiction and circumstances.
What happens to receipts the agent cannot read?
Fields it cannot read are marked unreadable and the row goes to full bookkeeper review with a link to the original file. If the image is too poor to use, the bookkeeper moves it to the Needs Info folder and asks the person who submitted it for a clearer copy or the emailed version. The original is kept either way.
Want this set up for you?
Build it yourself with the steps above, or tell us what you need. We scope the work with you and send a written quote before anything starts.
Sources
Written by Agents Lookup. Official pages for the tools this recipe uses:
- Claude (official page): claude.ai (checked 2026-11-09)
- QuickBooks Online MCP server (official page): github.com/intuit/quickbooks-online-mcp-server (checked 2026-11-09)
- Xero MCP server (official page): github.com/XeroAPI/xero-mcp-server (checked 2026-11-09)
- Zapier MCP (official page): zapier.com/mcp (checked 2026-11-09)
- Make MCP server (official page): developers.make.com/mcp-server (checked 2026-11-09)