This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Political campaigns in India are increasingly utilizing AI-generated deepfakes of both living and deceased politicians to influence voter behavior ahead of the 2024 general elections. These 'ghost appearances' and synthetic media campaigns have raised significant ethical and legal concerns regarding the integrity of democratic processes, the potential for widespread misinformation, and the lack of consent for using the likenesses of deceased figures. Experts warn that these tools pose a threat to democratic norms by blurring the line between reality and fiction.
In the lead-up to India's 2024 general elections, AI technology was used to create deepfake videos of deceased politicians, such as M. Karunanidhi and J. Jayalalithaa, aiming to influence voter behavior and campaign strategies. These AI-generated appearances are contributing to the erosion of trust in democratic processes and media discourse.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The AI systems generate synthetic speeches that actively ascribe opinions and statements to deceased politicians, creating misleading representations of their views.
Political campaigns are intentionally using AI-generated deepfakes of deceased and living politicians to conduct coordinated, large-scale influence campaigns aimed at manipulating public opinion and political processes.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident is caused by the intentional decisions of human political campaigns and consultants to deploy AI deepfakes to influence voters post-deployment.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
Political campaigns in India are deploying advanced AI-generated deepfakes and voice clones of living and deceased politicians to influence voters in the 2024 elections. This widespread use of synthetic media poses a substantial threat to information security, democratic processes, and societal trust, representing an evolved capability in domestic political influence operations.
The AI systems (Muonium, ElevenLabs, The Indian Deepfaker) are used as tools by political campaigns and tech firms to perform specific functions like voice cloning and video generation based on direct inputs such as scripts and historical audio data.
Limited Risk: The reports describe the creation and dissemination of AI-generated content such as deepfakes, which are subject to transparency and labeling obligations under the EU AI Act.
The AI systems were primarily used to generate deepfake videos and clone the voices of deceased and living politicians for campaign speeches.
The reports provide clear, detailed, and consistent accounts of how political parties in India are using AI-generated deepfakes of living and deceased politicians. Multiple sources, including AI creators, political consultants, and tech policy experts, are quoted, providing high credibility.
Some might view this as standard political campaigning/satire rather than a malicious disinformation threat, though the consensus in the text leans towards democratic risk.
Technology
Imperfect Lip Sync and Visuals
Unavailability of high-quality video datasets led to imperfect visual outputs.
Rapidly Advancing Voice Cloning
Advanced AI tools allow highly realistic replication of deceased leaders' voices.
Data Inputs
Sourcing Public Internet Data
Low-quality public video data was used to train the likeness of the leader.
Cadre-Supplied Scripting
Scripts for resurrected leaders were supplied and vetted by party personnel.
Human Factors
Low Digital Literacy
A large part of the public struggles to distinguish AI media from reality.
Voter Cognitive Bias
Voters only tend to fact-check videos that do not align with their beliefs.
Sentiment Exploitation
Parties leverage emotional attachment to dead leaders to sway voter opinions.
Process and Methods
Inadequate Ethical Vetting
No standardized ethical vetting process exists for political consultants.
Mass Dissemination via WhatsApp
Unchecked distribution channels allow rapid spread of synthetic media.
Management
Prioritizing Low Cost over Ethics
Parties choose cheap digital resurrection over expensive physical rallies.
Commercialization of AI Tools
Vendors selling cheap voice-cloning services without strict ethical oversight.
Regulatory Environment
No Rights for Deceased People
Indian law lacks legal framework protecting deceased individuals' voice rights.
Absence of AI Campaign Regulations
Lack of clear regulatory guidelines on the use of AI in election campaigning.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
