In February 2023, a deepfake video of Senator Elizabeth Warren circulated on social media, falsely depicting her claiming that Republicans should be barred from voting in the 2024 election. The video, which originated on TikTok and gained significant traction on Twitter, used AI to manipulate footage from an actual MSNBC interview. While many users identified the video as fake and Twitter applied an 'altered audio' label, some individuals were misled by the content, which aimed to fuel political polarization.
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The AI system was used to generate a highly realistic but entirely fabricated video of a politician making false statements, leading to epistemic confusion among some viewers.
The incident involves the creation and dissemination of a deepfake video of a US Senator to spread political disinformation and influence public opinion regarding the 2024 election.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human actor intentionally using a deployed AI deepfake generation tool to create and distribute misleading political content.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
An AI-generated deepfake video of US Senator Elizabeth Warren falsely claiming Republicans should be barred from voting circulated on social media. While the video aimed to fuel political polarization and manipulate electoral narratives, its reach was limited, and platform labeling mitigated its overall national security impact, representing a minor information warfare incident.
The report describes the video as being 'made using artificial intelligence' to alter audio and video. The AI functioned as a tool to execute a specific content generation task based on direct human inputs.
Limited Risk: The incident involves a deepfake video, which is explicitly classified under Risk Level 3 (Limited Risk) due to transparency obligations requiring users to be informed that the content is AI-generated.
The AI system was used to generate a deepfake video of Senator Warren, manipulating both her visual appearance and her voice to make false claims.
The report clearly details the nature of the deepfake, the platform metrics (views on Twitter and TikTok), the target (Senator Warren), and the political context. There is no ambiguity about the fact that the video was AI-generated and intended to mislead.
None. The event is clearly a political deepfake disinformation incident.
Technology
Generative AI Deepfake Tools
AI tools allowed realistic synthetic audio and video generation.
Algorithmic Amplification
Platform algorithms promoted the sensational deepfake, increasing views.
Data Inputs
Misuse of Authentic Media
Original MSNBC broadcast footage was used as input for the deepfake.
Human Factors
Malicious Creator Intent
An actor actively sought to spread political disinformation using AI.
User Confirmation Bias
Some social media users believed the fake because it fit their views.
Process and Methods
Reactive Labeling Processes
Platforms only labeled the video after it gained significant views.
Ineffective Upload Screening
Automated screening failed to catch the synthetic content at upload.
Management
Underinvestment in Trust and Safety
Platform management failed to prioritize proactive deepfake detection.
Regulatory Environment
Absence of Deepfake Laws
Lack of regulatory frameworks targeting AI-generated political fakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.