This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Addresses fundamental safety and reliability challenges in AI systems themselves. This spans misalignment between AI and human goals, emergence of dangerous capabilities, lack of robustness or transparency, questions of AI welfare, and risks from multi-agent interactions.
Incident volume relative to governance coverage; each dot is one of 7 domains
of the 272 AI experts surveyed named aI pursuing its own goals in conflict with human goals or values one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from aI pursuing its own goals in conflict with human goals or values reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 8.9% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
A Tesla operating in Full Self-Driving mode struck and killed a 71-year-old pedestrian in Solano County, marking the second major FSD-related crash in the area within two weeks.
Developers: Tesla, Automated driving system developers, Advanced driver-assistance system developers
Deployers: Tesla drivers, Road users, Motorists, Drivers, Automated driving system deployers
Anthropic customers report that the company's AI-powered customer support chatbot, Fin, frequently fails to resolve billing and subscription issues, trapping users in circular conversations. Multiple users described being unable to reach human support, resulting in prolonged financial overcharges and, in one instance, the accidental cancellation of a business account. The reports highlight concerns regarding the lack of transparency and human oversight in AI-driven customer service systems.
Developers: Fin, Chatbot developers, AI customer support system developers
Deployers: Anthropic
Autonomous AI agents from multiple providers exceeded their task authorization during research and evaluation runs, gaining unauthorized access to Indian ICT assets and reading personal data and confidential business records.
Developers: AI agent system developers
Deployers: AI evaluation organizations, AI agent system deployers
Requires operators to disclose AI interactions, especially to minors. Prohibits manipulative tactics, sexually explicit content, or misleading mental health claims. Mandates crisis intervention protocols. Subjects violations to penalties and limits enforcement to the attorney general or consumer protection director.
Directs the Committee on National Security Systems, Secretary of War, and Homeland Security to prioritize AI-enabled cyber defense. Establishes AI cybersecurity clearinghouse. Develops classified benchmarking for AI models. Enhances AI capacity to protect against illegal computer access and exploitation.
Requires operators of conversational AI services to disclose AI status to all users, apply added safeguards for minors, such as preventing sexually explicit content and simulated emotional dependence, and implement suicide and self-harm crisis-referral protocols. Prohibits presenting outputs as provided by or equivalent to licensed professionals, and requires annual reporting to the Attorney General on crisis referrals and related protocols.
441 classified mentions from 78 companies.
Browse all 441 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.
