This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Russian-linked disinformation networks, specifically Storm-1516 and Doppelgänger, have utilized generative AI tools like ChatGPT and DALL-E 3 to create and scale fake news websites and social media content. These campaigns targeted German and U.S. elections by fabricating scandals, manipulating audio/video content, and using bot networks to amplify divisive narratives. The operations aimed to erode trust in democratic institutions and influence voter behavior, with authorities noting the unprecedented scale and sophistication of these AI-enabled influence efforts.
Leading up to Germany’s February 23, 2025, federal election, the alleged Russian Doppelgänger, Storm-1516, and Matryoshka (Operation Overload) disinformation campaigns have reportedly been deploying AI-generated deepfake videos and fake news sites to spread false claims about German politicians and public figures. AI-powered bots have allegedly been amplifying the content across social media. Researchers suggest the campaign sought to erode trust in Germany’s democratic process. Germany's domestic intelligence agency (BfV) described the scale as unprecedented.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The AI systems were used to generate specific false narratives, such as fabricated corruption and personal scandals involving politicians.
Coordinated bot networks flooded social media platforms with AI-generated articles and deepfakes, polluting the information ecosystem during critical election periods.
The incident involves state-sponsored malicious actors using generative AI to conduct coordinated, large-scale disinformation campaigns aimed at manipulating political processes and public opinion in the U.S. and Germany.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The disinformation campaigns were intentionally orchestrated by human threat actors using deployed generative AI models to influence democratic elections.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
Russian-linked influence networks utilized generative AI tools to conduct large-scale, automated disinformation campaigns targeting the US and German elections. By generating fake news websites, cloning voices, and leveraging bot networks, the operations sought to undermine democratic processes and public trust, demonstrating an evolved capability in foreign information warfare.
The reports describe threat actors using commercial AI models as tools to generate text, rewrite articles, and clone voices. The AI systems performed specific, well-defined functions on direct input without autonomous planning or decision-making.
Limited Risk: The AI systems were used to generate deepfakes and synthetic content (AI-generated articles and cloned voices), which fall under transparency obligations for AI-generated content under the EU AI Act.
The primary function of the AI systems in these campaigns was to generate social media posts, articles, and images at scale to populate fake news websites and influence public opinion.
The reports from multiple credible sources (NewsGuard, Correctiv, government agencies, and threat intelligence firms) provide consistent and detailed accounts of the disinformation campaigns, the specific AI tools used (ChatGPT, DALL-E 3, voice cloning), and the targeted elections in the U.S. and Germany.
Some might view the campaigns as primarily traditional cyber-influence operations where AI played only a minor, scaling role, rather than a novel AI-driven threat.
Technology
AI Voice Cloning
AI cloned FBI director voice to spread fake voter fraud narratives.
Deepfakes of Regular People
AI tools recreated a nurse's voice to spread political disinformation.
Algorithmic Amplification
X's algorithm prioritized high-engagement extremist content.
Data Inputs
Plagiarized Article Rewriting
Generative AI used to rewrite and spin legitimate news stories.
Stock Media Manipulation
AI tools altered authentic stock images for misleading political posters.
Inauthentic Audio Tracks
AI-generated crowd chants replaced original audio in TikTok videos.
Human Factors
Disinformation Laundering
Prominent politicians shared AI-generated claims, normalizing them.
Voter Susceptibility
Audiences struggle to distinguish AI deepfakes from authentic footage.
Paid Actor Collaboration
Human actors collaborated with AI networks to legitimize fake stories.
Process and Methods
Automated Bot Deployment
Adversaries used automation to post AI content at precise intervals.
Sleeper Website Activation
Coordinated networks hosted AI articles on dormant pseudo-news sites.
Bypassing Platform Detection
Doppelganger used cloaking and redirects to evade moderator reviews.
Management
Prioritizing Growth Over Safety
Platforms failed to restrict bots to maintain high engagement metrics.
Failure to Curb Bot Accounts
Platform leadership did not restrict known Doppelganger bot accounts.
Inadequate AI API Safeguards
AI providers failed to block accounts generating scale disinformation.
Regulatory Environment
Inadequate Platform Oversight
Lack of enforcement under DSA to stop coordinated Russian bot networks.
Weak KYC for Hosting Providers
Adversaries easily bought Western hosting servers using front companies.
Lack of Deepfake Regulations
Absence of clear legal penalties for weaponizing political deepfakes.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
