Addresses risks from AI systems that generate or amplify false, misleading, or deceptive information. This includes both inadvertent hallucinations that lead to inaccurate beliefs, and systemic pollution of the information ecosystem through personalized filter bubbles that undermine shared reality.
Incident volume relative to governance coverage; each dot is one of 7 domains
of the 272 AI experts surveyed named false or misleading information one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from false or misleading information reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 6.8% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
An author used AI tools ChatGPT and Claude to write a book about AI's effects on truth, but the AI generated numerous fake or misattributed quotes that were included in the published work without proper verification.
Developers: OpenAI, Anthropic
Deployers: Writers, Steven Rosenbaum, Authors
A lawyer used Anthropic's Claude AI to draft a court filing which generated false legal quotations that were submitted to a federal court, resulting in the lawyer having to apologize to the judge and implement additional safeguards.
Developers: Anthropic
Deployers: Binnall Law Group, Jason Greaves
AI image enhancement tools were used to alter real photographs of Iranian political prisoners, creating confusion between authentic documentation and AI-generated content, undermining human rights advocacy efforts.
Developers: Unknown AI Image Editing Technology Developers
Deployers: Eyal Yakoby, Iranian Embassy In South Africa, Donald Trump, White House, United States Department Of State
Establishes an AI Litigation Task Force to challenge state regulations hindering United States Artificial Intelligence (AI) dominance. Directs an evaluation to identify state laws that mandate ideological bias or alter truthful model outputs. Restricts state access to federal funding, such as the Broadband Equity Access and Deployment program, unless states comply with a proposed national policy framework designed to preempt conflicting state-level AI mandates.
Defines "companion chatbot" and requires operators to notify users when they interact with AI. Requires protocols to prevent the production of harmful content. Mandates annual reports on crisis notifications. Offers civil remedies for violations. Ensures suitability disclosures for minors.
Regulates companion chatbots by requiring operators to disclose their artificial nature, implement protocols against suicide-related content, and apply heightened protections for minors. Mandates annual reporting to the Office of Suicide Prevention and subjects violators to civil liability.
140 classified mentions from 35 companies.
Browse all 140 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.