This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A senior Indian National Congress leader in Kerala, N. Subrahmanian, was booked by police for sharing an AI-generated image on Facebook. The image falsely depicted Kerala Chief Minister Pinarayi Vijayan with a suspect in a gold theft case. Authorities stated the post was intended to provoke enmity and mislead the public, leading to charges under the Bharatiya Nyaya Sanhita and the Kerala Police Act.
A senior Indian National Congress leader in Kerala, N. Subrahmanian, was reportedly booked by police after sharing a digitally altered image on Facebook depicting Kerala Chief Minister Pinarayi Vijayan alongside a suspect in a gold theft case. Police reportedly stated that at least one circulated image was created using AI tools and that the post allegedly sought to provoke enmity and mislead the public.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The AI-generated image created a false depiction of the Chief Minister with a theft suspect, spreading misleading information.
The incident involves a political leader sharing an AI-generated fake image of a Chief Minister to manipulate public opinion and political processes.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human actor intentionally sharing an AI-generated deepfake image to mislead the public and provoke conflict.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A senior Indian political leader was booked for sharing an AI-generated deepfake of a state Chief Minister alongside a gold theft suspect. The incident represents a minor, localized political disinformation attempt handled by standard law enforcement, highlighting the ongoing but established threat of synthetic media in domestic politics.
The report mentions that 'one of the images circulated was created using artificial intelligence tools.' The AI functioned as a tool to generate a specific image based on direct user inputs without autonomous planning or agency.
Limited Risk: The system used was an AI tool to generate a deepfake image, which falls under the category of AI-generated content requiring transparency obligations under the EU AI Act.
The AI system was used to generate a digitally altered photograph depicting a real person (the Chief Minister) with a theft suspect, which is a deepfake image.
The report clearly outlines the incident, the parties involved, the nature of the AI-generated content (a fake photograph), and the legal actions taken. There is little ambiguity regarding the events, though the specific AI tool used is not named.
None.
Technology
AI Image Generation Tools
AI tools allowed creation of realistic, digitally altered fake photographs.
Accessibility of Synthesis Tools
Easy access to AI synthesis tools enables rapid creation of misleading media.
Human Factors
Intentional Political Provocation
User deliberately shared fake image to damage reputation and provoke conflict.
Sharing Without Verification
Sharing AI-generated content on social media without verifying authenticity.
Process and Methods
Lack of Platform AI Detection
Social media platform failed to detect and label the AI-generated image.
Weak AI Generation Guardrails
AI tools lacked guardrails to prevent generating misleading political images.
Management
Poor Political Communication Oversight
Lack of internal review by political party before sharing sensitive media.
Regulatory Environment
Reactive Legal Frameworks
Laws penalize sharing after the fact but do not prevent generation of fakes.
Lack of Deepfake Regulations
Absence of clear regulations specifically targeting AI-generated deepfakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
