This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Focuses on deliberate misuse of AI by bad actors, including large-scale disinformation campaigns, AI-enabled cyberattacks and weapons development, and targeted fraud, scams, and manipulation. These risks arise from intentional exploitation of AI capabilities for harmful purposes.
Incident volume relative to governance coverage; each dot is one of 7 domains
of the 272 AI experts surveyed named disinformation, surveillance, and influence at scale one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from disinformation, surveillance, and influence at scale reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 7.1% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
Spain's People's Party (PP) circulated an AI-generated video on official social media channels that used deepfake technology to impersonate political rivals, including the prime minister's wife and other Socialist party figures. The video attributed false, defamatory statements to these individuals, prompting a legal complaint from a former party member who reported suffering from anxiety and social isolation as a result. While the party defended the content as political satire, the incident has sparked significant debate regarding the ethics and legality of using AI-generated disinformation in political campaigns.
Developers: Voice cloning technology developers, Synthetic video generation technology developers, Synthetic media technology developers, Synthetic audio generation technology developers, Deepfake technology developers
Deployers: Synthetic media creators, political organizations, People's Party (Spain), Partido Popular, Deepfake creators
Criminals in the Netherlands used AI-generated voice clips to impersonate bank officials in a sophisticated phone scam, defrauding approximately 170 victims of 380,000 euros.
Developers: Synthetic media technology developers, Synthetic audio generation technology developers
Deployers: Voice phishers, Synthetic media creators, Scammers, Deepfake creators, Cybercriminals in the Netherlands, Cybercriminals, Bank helpdesk fraud ring in the Netherlands
An AI-generated political campaign ad in Pennsylvania used a deepfake likeness of Governor Shapiro to deliver a misleading message about a sexual harassment complaint, raising concerns about election manipulation.
Developers: Synthetic video generation technology developers, Synthetic media generation technology developers, Synthetic audio generation technology developers, Deepfake technology developers
Deployers: Synthetic media creators, Stacy Garrity's gubernatorial campaign, Stacy Garrity, Public figures, Politicians in the United States, Politicians, political campaigns, Deepfake creators
Requires operators to disclose AI interactions, especially to minors. Prohibits manipulative tactics, sexually explicit content, or misleading mental health claims. Mandates crisis intervention protocols. Subjects violations to penalties and limits enforcement to the attorney general or consumer protection director.
Directs the Committee on National Security Systems, Secretary of War, and Homeland Security to prioritize AI-enabled cyber defense. Establishes AI cybersecurity clearinghouse. Develops classified benchmarking for AI models. Enhances AI capacity to protect against illegal computer access and exploitation.
Requires operators of conversational AI services to disclose AI status to all users, apply added safeguards for minors, such as preventing sexually explicit content and simulated emotional dependence, and implement suicide and self-harm crisis-referral protocols. Prohibits presenting outputs as provided by or equivalent to licensed professionals, and requires annual reporting to the Attorney General on crisis referrals and related protocols.
353 classified mentions from 83 companies.
Browse all 353 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.
