This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The Arizona Agenda, a local political newsletter, created and published a deepfake video of Senate candidate Kari Lake to demonstrate the accessibility and dangers of AI-generated disinformation. While the outlet intended the video as an educational tool, it did not obtain Lake's consent, leading her campaign to issue a cease-and-desist letter. The incident sparked debate among experts regarding the balance between public education and the risk of normalizing synthetic media in political campaigns.
The Arizona Agenda produced a deepfake video of Republican Senate candidate Kari Lake giving a testimonial about the publication with the seeming intention of educating the general public about the dangers of deepfakes in the coming election cycle. However, the Arizona Agenda appears not to have sought Lake's consent, prompting a cease-and-desist letter from her campaign.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfake video generated false information that misled some subscribers into believing the endorsement was real.
The incident involved the unauthorized creation of a deepfake video of a political candidate to simulate a fake endorsement, which falls under impersonation and targeted manipulation of likeness.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by humans (the journalists) intentionally using a post-deployment AI tool to generate a deepfake video of a political candidate for educational purposes.
A local political newsletter in Arizona created an unauthorized deepfake of Senate candidate Kari Lake as an educational demonstration. While intended to highlight AI risks, the incident caused minor voter confusion and a legal dispute, illustrating the growing challenge of synthetic media in democratic processes without posing a direct threat to national security.
The AI system was used as a tool by a software engineer and journalists to generate a synthetic video of Kari Lake based on direct inputs. The report notes they 'enlisted the help of a tech-savvy friend' to create the video, indicating the AI functioned as a generation tool.
Risk Level 3: Limited Risk. The incident involves AI-generated content (a deepfake), which falls under Limited Risk due to transparency obligations requiring users to be informed that they are interacting with or viewing AI-generated content.
The AI system was used specifically to generate a synthetic video and voice clone of Kari Lake to simulate her endorsing a newsletter.
The reports provide clear, consistent, and detailed accounts of the creation, distribution, and reception of the deepfake video. The facts regarding the creators, the subject (Kari Lake), the platform (Arizona Agenda), and the resulting legal threat are well-documented across multiple sources.
None. The event is clearly an educational demonstration of deepfake technology that resulted in a cease-and-desist letter due to lack of consent.
Technology
Rapidly Improving AI Realism
AI-generated media is becoming nearly indistinguishable from real footage.
High Accessibility of AI Tools
Free and easy-to-use tools allow anyone with a computer to generate fakes.
Inherent Difficulty in Detection
Technical experts note that it is increasingly impossible to detect fakes.
Data Inputs
Unauthorized Likeness Data
Publicly available video and voice data used to generate deepfakes.
Lack of Authentication Standards
No cryptographic watermarks on official media to verify authenticity.
Human Factors
Voter Unpreparedness
Electorate is unprepared for the influx of highly realistic fake media.
Skepticism of Real Media
Public tends to write off objective, real videos as deepfakes.
Susceptibility to Deception
Even sophisticated observers and paying readers were fooled by the fake.
Process and Methods
Unconsented Demonstration Methods
Outlets create unauthorized deepfakes to demonstrate technology risks.
Lack of Standardized Verification
Absence of third-party authentication methods for political communications.
Management
Unintended Editorial Risk-Taking
Newsletter management deployed deepfakes despite risk of losing subscribers.
Lack of Consent Protocols
Management failed to obtain permission before using candidate's likeness.
Regulatory Environment
Unregulated AI Technology
Lack of comprehensive laws governing deepfakes in political campaigns.
Inadequate Legal Remedies
Campaigns must rely on cease-and-desist letters after the fake goes viral.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
