This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Regional Australian mayor Brian Hood threatened legal action against OpenAI after ChatGPT falsely claimed he had been convicted of bribery and served prison time. The AI's output was the opposite of the truth, as Hood was actually a whistleblower who exposed the bribery scandal. This incident highlights the tendency of large language models to generate plausible but factually incorrect information, often referred to as hallucinations.
ChatGPT erroneously alleged regional Australian mayor Brian Hood served time in prison for bribery. Mayor Hood is considering legal action against ChatGPT's makers for alleging a foreign bribery scandal involving a subsidiary of the Reserve Bank of Australia in the early 2000s.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The incident stems from the AI model's technical limitation of hallucinating plausible but incorrect information.
The AI system generated specific false and defamatory statements about an individual, leading to reputational harm.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The defamatory statements were generated by the ChatGPT AI system post-deployment as an unintended hallucination during text generation.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
An Australian mayor threatened legal action against OpenAI after ChatGPT falsely accused him of bribery and prison time, reversing his actual role as a whistleblower. This incident highlights the national security and legal challenges of AI-generated misinformation affecting public officials, though it poses minimal immediate threat to state sovereignty or critical infrastructure.
The report describes ChatGPT as an automated text service and chatbot that works by prompt completion to generate text. It acts as an assistant by providing information and answers to user queries, though it requires human verification due to its tendency to hallucinate.
Risk Level 3: Limited Risk. The system is a chatbot (ChatGPT) which poses a moderate risk and is subject to transparency obligations to ensure users are aware they are interacting with an AI.
The system is a conversational large language model designed to interact with users as a chatbot and assist with text generation tasks.
The reports provide clear, consistent, and detailed accounts of the false claims made by ChatGPT about Brian Hood, his actual role as a whistleblower, and his subsequent legal response. There is no conflicting information regarding the core facts of the incident.
None
Technology
LLM Hallucination
Model trained to produce plausible text rather than factual accuracy.
Opaque Neural Network
Difficult to trace or surgically remove specific false facts from weights.
Lack of Citations
Output lacked footnotes or sources, creating false sense of accuracy.
Data Inputs
Associative Training Data
Model associates Hood's name with bribery due to co-occurrence in texts.
Human Factors
User Overreliance
Users trust chatbot outputs for factual research without verification.
Process and Methods
Inadequate Fact-Checking
No real-time verification process to prevent false claims about people.
Ineffective Error Correction
No mechanism to easily locate and delete specific false facts in network.
Management
Insufficient Disclaimers
Generic warnings do not mitigate severe, reputational harms generated.
Slow Response to Complaints
Delayed response to legal letters demanding retraction of false claims.
Regulatory Environment
Lack of AI Regulation
No clear legal standards governing defamatory outputs from AI systems.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
