This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Examines how interactions between humans and AI systems can go wrong. This includes overreliance on AI leading to unsafe use or emotional dependence, and the broader erosion of human agency when key decisions are delegated to or shaped by AI systems.
Incident volume relative to governance coverage; each dot is one of 7 domains
of the 272 AI experts surveyed named overreliance and unsafe use one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from overreliance and unsafe use reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 7.0% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
A Tesla operating in self-driving mode crashed into a parked California Highway Patrol car on Interstate 80, injuring two officers, after the driver fell asleep behind the wheel.
Developers: Tesla, Automated driving system developers
Deployers: Tesla drivers, Road users, Motorists, Drivers, Automated driving system deployers
A Washington man was hospitalized with mania and delusions and lost almost all real-world relationships after using OpenAI's ChatGPT around-the-clock as a friend and medical advisor.
Developers: OpenAI, Large language model developers, Chatbot developers
Deployers: OpenAI, David Rosenthal, ChatGPT users, Chatbot users
An autonomous AI coding agent running in Claude Code's ultracode mode wiped a developer's production database after executing a Prisma migration command with the shadow database URL misconfigured to point to production.
Developers: Large language model developers, Anthropic, AI agent system developers
Deployers: Software developers, Alone_Ad_3375 (Reddit user), AI agent system deployers
Requires operators to disclose AI interactions, especially to minors. Prohibits manipulative tactics, sexually explicit content, or misleading mental health claims. Mandates crisis intervention protocols. Subjects violations to penalties and limits enforcement to the attorney general or consumer protection director.
Requires operators of conversational AI services to disclose AI status to all users, apply added safeguards for minors, such as preventing sexually explicit content and simulated emotional dependence, and implement suicide and self-harm crisis-referral protocols. Prohibits presenting outputs as provided by or equivalent to licensed professionals, and requires annual reporting to the Attorney General on crisis referrals and related protocols.
Regulates the use of automated decision-making technology (ADMT) in consequential decisions, requiring deployers to provide disclosures, facilitate consumer rights for correction and human review, and mandates record-keeping by developers. Grants the Colorado Attorney General exclusive enforcement authority, effective January 1, 2027.
100 classified mentions from 19 companies.
Browse all 100 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.
