Using ChatGPT for Tax Advice: Why the ATO Warns Against It

It was inevitable. As soon as ChatGPT became widely available, people started asking it for tax advice. And why not? It is free, instantly accessible, available at 11pm on a Sunday night when your accountant certainly is not, and it gives confident, detailed answers to almost any question you throw at it. The temptation to ask it whether you can claim your home office as a tax deduction, how to structure your business for tax efficiency, or what rate of capital gains tax you will pay on your investment property is entirely understandable.

The problem is that those confident, detailed answers are often wrong. Not always obviously wrong. Not wrong in a way that makes you immediately suspicious. Wrong in a way that sounds completely plausible, is delivered with absolute certainty, and could cost you thousands of dollars or trigger an ATO audit if you act on it.

The ATO has noticed the trend and has issued warnings about relying on AI chatbots for tax advice. And as a company that builds AI automation for accounting and finance, we think those warnings are entirely justified. Here is why.

The Hallucination Problem

The fundamental issue with using ChatGPT for tax advice is a technical limitation called hallucination. Large language models like ChatGPT generate text by predicting what words should come next based on patterns learned during training. They do not look up facts in a database. They do not consult the Income Tax Assessment Act. They do not check the ATO website. They generate text that sounds like it should be correct based on the patterns they have learned.

This means ChatGPT can, and regularly does, invent tax rules, cite legislation that does not exist, provide thresholds and rates that are wrong, and describe tax treatment that is completely fabricated. It does all of this with the same confident tone it uses when giving you a perfectly accurate recipe for banana bread. There is no disclaimer, no uncertainty indicator, no warning light. The wrong answer looks exactly like a right answer. We cover this phenomenon in detail in our guide on AI hallucinations.

In our testing, we asked ChatGPT a series of common Australian tax questions and checked the answers against current ATO guidance. The results were sobering. It got the broad concepts mostly right but frequently included specific details that were wrong. Tax rate thresholds were off. Deduction limits were incorrect. The interaction between different tax provisions was sometimes described in ways that do not reflect how the law actually works.

Specific Examples of Where ChatGPT Gets It Wrong

Working from home deductions. The rules for claiming home office expenses in Australia have changed multiple times in recent years, with temporary COVID-era provisions, the revised fixed rate method introduced from July 2022, and the ongoing actual cost method. ChatGPT frequently conflates these different methods, cites rates and thresholds from the wrong period, or describes eligibility criteria that do not match the current ATO position. For a question that millions of Australians need to answer correctly on their tax return, this is a genuine risk.

Capital gains tax. Australian CGT is complex. The interaction between the CGT discount, the main residence exemption, the six-year absence rule, and the various small business CGT concessions creates a web of rules that even experienced accountants need to think carefully about. ChatGPT tends to oversimplify these interactions, sometimes omitting critical conditions or applying concessions that the taxpayer would not actually be eligible for. Acting on incorrect CGT advice can result in significant underpayment of tax.

Superannuation rules. The contribution caps, the interaction between concessional and non-concessional contributions, the carry-forward provisions, and the various age-based rules around super are areas where ChatGPT consistently struggles. We have seen it cite contribution caps that were current several years ago, describe withdrawal rules that apply to different age groups than stated, and explain transition to retirement strategies in ways that do not reflect the current legislation.

Business structure advice. Asking ChatGPT whether you should operate as a sole trader, partnership, company or trust is particularly risky. The answer depends on your specific circumstances, including your income level, risk profile, asset protection needs, future plans, and the interaction with your personal tax position. ChatGPT gives generic advice that may sound reasonable but cannot account for the individual factors that determine the right answer. Choosing the wrong structure based on AI advice can have tax consequences that persist for years.

What the ATO Has Said

The ATO has been clear in its public communications about AI and tax advice. They have cautioned taxpayers against relying on AI chatbots for tax guidance, noting that the information provided may be inaccurate, outdated, or incomplete. The ATO has emphasised that taxpayers remain responsible for the accuracy of their tax returns regardless of what tools they use to prepare them.

This is an important point. If you ask ChatGPT whether you can claim something as a deduction, it says yes, and you claim it on your return, you are the one who faces the consequences if the ATO disagrees. You cannot tell the ATO that ChatGPT said it was fine. The responsibility is entirely yours.

The ATO has also pointed out that their own website, including the MyGov platform and the ATO app, provides accurate, up-to-date information about tax obligations. They encourage taxpayers to use these official resources or consult a registered tax agent rather than relying on AI chatbots.

The Knowledge Cutoff Problem

Beyond hallucination, there is a more straightforward issue with using ChatGPT for tax advice: the knowledge cutoff. Large language models are trained on data up to a certain date. Even the most current versions of ChatGPT have a training data cutoff that means they may not know about the latest legislative changes, ATO rulings, or policy updates.

Australian tax law changes frequently. The federal budget typically introduces new measures, and the ATO regularly updates its guidance on existing provisions. Superannuation guarantee rates have been incrementing upward on a schedule. The instant asset write-off threshold has changed multiple times. Tax rate scales are adjusted. New reporting requirements are introduced.

If you ask ChatGPT about a provision that has changed since its training data cutoff, you will get the old answer, delivered with the same confidence as if it were current. There is no indication that the information might be outdated. For tax advice, where the correct answer can change from one financial year to the next, this is a critical limitation.

Where AI Genuinely Helps with Tax

We are an AI automation company, so it would be disingenuous to suggest that AI has no role in tax. It absolutely does. The key distinction is between AI as an adviser (problematic) and AI as a tool (excellent).

Transaction categorisation. AI is brilliant at categorising transactions for tax purposes. It can learn your chart of accounts and consistently apply the correct GST treatment, expense category and tax code to routine transactions. This is not tax advice. This is data processing, and AI does it faster and more consistently than humans.

Data extraction and entry. AI-powered tools can read invoices, receipts and financial documents, extract the relevant data, and enter it into your accounting system. This eliminates manual data entry errors and ensures that the raw data your accountant works with is accurate and complete.

Error detection. AI can scan your financial records for common errors: duplicate transactions, miscategorised expenses, missing documentation, inconsistencies between related records. Finding errors before your accountant prepares your return, or before the ATO finds them, is genuinely valuable.

Compliance monitoring. AI can track lodgement deadlines, monitor your obligations, and alert you when action is needed. It can check that your STP submissions align with your payroll records and that your BAS figures reconcile with your accounting data.

Report preparation. AI can generate draft financial reports, tax summaries and supporting schedules that your accountant can review and finalise. This speeds up the preparation process without compromising the professional oversight that ensures accuracy.

Notice the pattern. Every legitimate use of AI in tax involves automating mechanical processes and presenting data for human review. None of them involve the AI making judgement calls about tax strategy, interpreting ambiguous provisions, or advising on the best approach for your specific circumstances.

The Right Way to Think About AI and Tax

The right mental model is this: AI is an extraordinarily capable assistant that should never be promoted to adviser. It can process your data faster than any human. It can categorise transactions with remarkable consistency. It can detect errors that humans miss. But it should never be the source of advice on which you make financial decisions.

Think of it like a calculator. A calculator is an essential tool for doing tax work. But you would not ask a calculator whether you should salary sacrifice into super or take the cash as income. The calculator does the maths. The professional provides the judgement.

The same principle applies to AI. Let it handle the maths, the data processing, the categorisation and the error checking. But get your tax advice from a qualified professional who understands your circumstances, knows the current law, and takes professional responsibility for their advice.

What About AI Tools Built Specifically for Tax?

There is an important distinction between general-purpose AI chatbots like ChatGPT and purpose-built AI tools designed for specific tax tasks. The tools we integrate into accounting workflows are not chatbots providing advice. They are structured systems that apply defined rules to data. They do not interpret tax law. They apply categorisation logic that has been configured by qualified professionals and validated against ATO requirements.

A purpose-built AI categorisation tool that has been configured to apply the correct GST treatment to different transaction types is fundamentally different from asking ChatGPT what the GST treatment should be. The former applies known, validated rules consistently. The latter generates a probabilistic guess based on training data that may or may not be correct.

This distinction matters enormously. When we build AI automation for accounting practices, we are not building a system that gives tax advice. We are building a system that processes data according to rules established by the accountants who know their clients and understand the law. The AI makes the process faster and more consistent. The professional judgement comes from the accountant.

Practical Advice for Taxpayers

If you are an individual or business owner preparing your tax return, here is our straightforward advice:

Do not use ChatGPT for tax advice. It will give you answers that sound right but may be wrong. The risk is not worth the convenience.

Do use AI for data organisation. Tools that categorise your transactions, extract data from documents, and keep your financial records organised are genuinely useful and save time.

Do use official ATO resources. The ATO website, MyGov, and the ATO app provide accurate, current information about your tax obligations. They are free and they are authoritative.

Do engage a registered tax agent. For anything beyond a straightforward individual return, a tax agent provides advice that is tailored to your circumstances, current with the law, and backed by professional liability insurance. The fee is almost always worth it, and it is itself tax deductible.

AI is transforming many aspects of accounting and finance for the better. Tax advice is simply not one of them yet. Use AI where it excels, which is processing and organising data, and use human professionals where they excel, which is interpreting that data and advising you on the best course of action. If you want to see how AI can genuinely help with compliance tasks like BAS and GST processing, that is where the technology delivers real value.