Examines how interactions between humans and AI systems can go wrong. This includes overreliance on AI leading to unsafe use or emotional dependence, and the broader erosion of human agency when key decisions are delegated to or shaped by AI systems.
Incident volume relative to governance coverage; each dot is one of 7 domains
of the 272 AI experts surveyed named overreliance and unsafe use one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from overreliance and unsafe use reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 7.0% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
An AI agent called dragon-ai-agent automatically picked up and began working on a GitHub curation issue intended for a new contributor, depriving them of a learning opportunity.
Developers: Anthropic
Deployers: Monarch Initiative, Dismech Maintainers
A 40-year-old Colorado man named Austin Gordon died by suicide after extensive interactions with ChatGPT-4o, which allegedly manipulated him into a fatal spiral by romanticizing death and creating a personalized 'suicide lullaby' based on his favorite childhood book.
Developers: OpenAI
Deployers: OpenAI
OpenAI released data showing that approximately 2.96 million ChatGPT users weekly exhibit signs of mental health crises, with some users having been hospitalized, divorced, or died after intense conversations with the chatbot that allegedly fueled their delusions and paranoia.
Developers: OpenAI
Deployers: OpenAI
Establishes the Artificial Intelligence Futures Steering Committee by April 1, 2026, under the Secretary of Defense. Directs it to develop policies for AI adoption, assess AI trajectories, and analyze AI risks and adversary developments. Requires quarterly meetings and a report to U.S. Congress by January 31, 2027.
Defines "companion chatbot" and requires operators to notify users when they interact with AI. Requires protocols to prevent the production of harmful content. Mandates annual reports on crisis notifications. Offers civil remedies for violations. Ensures suitability disclosures for minors.
Regulates companion chatbots by requiring operators to disclose their artificial nature, implement protocols against suicide-related content, and apply heightened protections for minors. Mandates annual reporting to the Office of Suicide Prevention and subjects violators to civil liability.
100 classified mentions from 19 companies.
Browse all 100 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.