This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The Canada Revenue Agency's 'Charlie' chatbot, developed at a cost of over $18 million, was found by the Auditor General to provide inaccurate tax information in a majority of test cases. Despite millions of interactions, the system consistently failed to provide reliable guidance, raising concerns about the efficacy of government-deployed AI tools for critical public services.
Charlie the Chatbot, an AI-powered system deployed by the Canada Revenue Agency (CRA), has reportedly been providing inaccurate or incomplete tax-related information to members of the public. An audit by the Auditor General of Canada reportedly found the chatbot produced correct responses in fewer than half of tested cases. The system has been publicly available across multiple CRA webpages since March 2020 and reportedly used by millions of users.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The chatbot generated and spread incorrect tax information to users seeking assistance with their tax filings.
The chatbot failed to perform reliably, providing incorrect answers to tax questions in a significant percentage of test cases and real-world interactions.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Charlie chatbot delivering incorrect answers to users after it was deployed to the public.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
The Canada Revenue Agency's 'Charlie' chatbot provided inaccurate tax information to citizens, resulting in 18 million dollars in wasted public funds and potential taxpayer confusion. While illustrating significant challenges in government AI deployment and public trust, the incident carries negligible national security implications.
The chatbot acts as an assistant designed to help Canadians navigate the tax system by answering questions and providing information, but it does not take independent actions or make decisions on behalf of the user.
Limited Risk: The system is a chatbot, which under the EU AI Act falls under Limited Risk, requiring transparency obligations so users know they are interacting with an AI.
The primary function of Charlie is to answer tax-related questions from Canadian taxpayers through a conversational interface.
The reports are based on an official audit by the Auditor General of Canada, providing precise figures on cost ($18 million), usage (7 million conversations), and accuracy rates (33% to 70%). There is little ambiguity about the chatbot's performance and the public scrutiny it faced.
None
Technology
Inaccurate Chatbot Responses
The chatbot answered only 2 out of 6 basic tax questions correctly.
Inferior AI Model Technology
Specialized government tool performed worse than free public AI tools.
Data Inputs
Lack of Interaction Data Review
CRA could not verify real-world accuracy without manual transcript reviews.
Human Factors
Premature Public Deployment
Deployed chatbot to the public while acknowledging it was still learning.
Process and Methods
Low Internal Accuracy Standards
Internal testing accepted a low 70 percent accuracy threshold.
Management
High Expenditure with Low Return
Spent 18 million dollars on a tool that delivered incorrect information.
Inadequate Pre-Rollout Testing
Broadly rolled out the chatbot in 2021 before resolving accuracy issues.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
