This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Ars Technica retracted an article after a reporter used ChatGPT to paraphrase source material, resulting in the publication of fabricated quotes attributed to a software maintainer. The reporter, Benj Edwards, took responsibility for the error, which he attributed to working while ill. The publication subsequently terminated the reporter and released a formal policy regarding the use of AI in their editorial workflow.
Ars Technica retracted an article after purportedly AI-generated text was presented as direct quotations from a source who disputed having said them. The editor-in-chief reportedly acknowledged a standards failure and said the publication was not consistent with Ars policy on AI-generated material, and apologized to readers and to matplotlib maintainer Scott Shambaugh. An author reportedly later said he had inadvertently used an AI-paraphrased version of the source text as quotes.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The reporter overrelied on ChatGPT to extract source material without verifying the output, leading to the publication of fabricated quotes.
The incident led to the termination of the reporter and highlights the pressure on journalists to integrate AI tools, degrading working conditions.
The AI system generated false quotes attributed to a real person, which were then published in a news article, spreading misinformation to the public.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by ChatGPT generating fabricated quotes, which was an unintentional hallucination occurring after the model's deployment.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A reporter at Ars Technica used ChatGPT to paraphrase source material, resulting in the publication of fabricated quotes. The incident highlights the risks of generative AI hallucinations and overreliance in professional journalism, but carries negligible national security implications.
The reporter used ChatGPT as an assistant to help list structured references and understand why an experimental tool failed, augmenting his workflow but requiring his oversight.
Limited Risk: The system involved is ChatGPT, a chatbot used to generate text, which falls under the category of AI systems requiring transparency about their AI nature.
The reporter used ChatGPT to help extract and structure reference material for writing an article, acting as a writing assistant.
The reports provide clear, consistent, and detailed accounts of the incident from multiple sources, including statements from the reporter, the editor-in-chief, and the affected source.
None
Technology
AI Hallucination
ChatGPT generated fabricated quotes instead of verbatim text.
Experimental Tool Failure
The custom API-based AI tool failed to work as intended.
Data Inputs
Unverified AI Summaries
Paraphrased AI outputs were used directly without checking original text.
Human Factors
Working While Severely Ill
Reporter worked from bed with a high fever and very little sleep.
Overreliance on AI Output
Reporter trusted the AI-generated text without cross-checking.
Rushing to Meet Deadlines
Pressure to finish quickly led to a critical lack of verification.
Process and Methods
Inadequate Fact-Checking
Editors failed to verify the quotes against the original source.
Inconsistent AI Guidelines
Lack of clear, reader-facing guidelines on AI tool usage.
Management
Pressure to Integrate AI
Corporate management pushed staff to find uses for AI tools.
Workplace Productivity Pressure
Expectation to keep generating content even while sick.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
