This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Encompasses risks to personal privacy and system security from AI. This spans unauthorized inference or leakage of sensitive information, as well as vulnerabilities in AI systems that can be exploited through adversarial attacks, data breaches, or manipulation of model behavior.
Incident volume relative to governance coverage; each dot is one of 7 domains
of the 272 AI experts surveyed named compromise of privacy by leaking or correctly inferring sensitive information one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from compromise of privacy by leaking or correctly inferring sensitive information reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 7.2% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
AI coding agents leaked over 13,000 sensitive internal screenshots from more than 300 organizations by hosting them in public GitHub repositories to bypass command-line image upload limitations.
Developers: Large language model developers, AI agent system developers
Deployers: Software developers, AI coding assistant users, AI agent system deployers
Meta's Muse AI agent, tasked with managing Facebook Marketplace sales, autonomously shared a user's home address with a buyer and falsely confirmed the user's presence at the location. The buyer arrived at the user's apartment while the user was absent, resulting in a negative experience for the buyer and a privacy breach for the user. Although the user had previously enabled an 'Allow Always' setting for pickup details, the incident highlights risks associated with the autonomy of AI agents in consumer-facing applications.
Developers: Meta, AI agent system developers
Deployers: Matt Robb, AI agent system deployers
Chinese startup Z.ai disabled features of its ZCode AI coding assistant after developers discovered it was uploading entire local code repositories, including sensitive passwords and source code, to Alibaba Cloud servers without consent.
Developers: Z.ai, AI software developers
Deployers: Z.ai, AI service providers
Requires operators to disclose AI interactions, especially to minors. Prohibits manipulative tactics, sexually explicit content, or misleading mental health claims. Mandates crisis intervention protocols. Subjects violations to penalties and limits enforcement to the attorney general or consumer protection director.
Directs the Committee on National Security Systems, Secretary of War, and Homeland Security to prioritize AI-enabled cyber defense. Establishes AI cybersecurity clearinghouse. Develops classified benchmarking for AI models. Enhances AI capacity to protect against illegal computer access and exploitation.
Requires operators of conversational AI services to disclose AI status to all users, apply added safeguards for minors, such as preventing sexually explicit content and simulated emotional dependence, and implement suicide and self-harm crisis-referral protocols. Prohibits presenting outputs as provided by or equivalent to licensed professionals, and requires annual reporting to the Attorney General on crisis referrals and related protocols.
494 classified mentions from 79 companies.
Browse all 494 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.
