This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Foreign state-sponsored actors from China, Russia, and Iran integrated generative AI into covert influence operations targeting U.S. and Taiwanese elections. These operations utilized AI to scale the production of fake news articles, political cartoons, and voice clones, though the report notes that these tools generally helped scale content rather than improving its quality or persuasiveness. Despite these efforts, the report concludes that foreign malign influence campaigns failed to achieve measurable results in the 2024 U.S. elections due to the resilience of the U.S. information ecosystem and proactive debunking by government and private sector researchers.
AI tools linked to China were used to disseminate disinformation targeting voters in the U.S. and Taiwan, according to a Microsoft report. These operations included AI-generated imagery and audio to influence political perceptions and election outcomes, originating from the APT Storm-1376 (also known as Spamouflage and Dragonbridge).
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The campaigns generated specific false narratives, such as fabricated voter fraud claims and fake audio endorsements.
The massive scaling of low-quality AI-generated articles, comments, and cartoons across social media platforms threatens to pollute the information ecosystem.
The incident involves state-sponsored actors using generative AI to conduct coordinated, large-scale disinformation and influence campaigns targeting democratic elections in the U.S. and Taiwan.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The influence operations were intentionally designed and executed by human threat actors (state-sponsored groups from Russia, China, and Iran) using post-deployment commercial AI systems to scale their campaigns.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
State-sponsored actors from Russia, China, and Iran integrated generative AI tools to scale covert influence operations targeting the 2024 US and Taiwanese elections. While the operations failed to achieve measurable impact due to proactive defense and the resilience of the information ecosystem, they represent a significant, ongoing information warfare and sovereignty threat.
The AI systems acted as assistants to human operators, helping them generate text, images, and audio based on direct prompts, but requiring human orchestration to deploy.
Limited Risk: The report describes the use of chatbots (ChatGPT) and the generation of deepfakes (voice clones, fake audio clips), which fall under the transparency obligations of Risk Level 3.
The primary use of the AI systems was to generate social media posts, comments, articles, and cartoons to populate fake news websites and social media feeds. Voice generation was also used to create deepfake audio clips.
The reports from FDD and Microsoft provide detailed, well-researched accounts of multiple state-sponsored operations, identifying specific AI tools (ChatGPT, DALL-E 3, ByteDance tools) and their exact roles in generating content. The findings are corroborated by multiple government agencies (CISA, FBI, ODNI) and independent research groups (Clemson University, Recorded Future, ISD).
None. The role of AI as a scaling tool for human-driven disinformation is clearly established.
Technology
AI Voice Cloning
Operation Overload used AI to clone FBI Director's voice to claim voter fraud.
Generative AI Content Rewriting
CopyCop used ChatGPT and DALL-E 3 to rewrite articles and create fake sites.
AI-Generated News Anchors
Spamouflage used ByteDance AI tools to create fake news anchors in videos.
Data Inputs
Plagiarized Content Input
Generative AI models ingested real news to rewrite and spin disinformation.
Lack of Shared Technical Indicators
Absence of shared AI indicators hinders rapid detection across platforms.
Human Factors
Susceptibility to Fake Audio
Audiences are easily duped by highly convincing AI-generated audio clips.
Voter Polarization Exploitation
Adversaries used AI content to exploit and deepen existing domestic divisions.
Process and Methods
Inefficient Fake Account Prevention
Social platforms fail to prevent rapid creation of automated bot accounts.
Lack of Rapid AI Verification
Inability to quickly verify and identify AI-generated content at scale.
Management
Inadequate Platform Moderation
Tech platforms failed to proactively block automated text generation comments.
Regulatory Environment
Weak Hosting KYC Processes
Adversaries easily access Western hosting services due to loose identity checks.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
