This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A deepfake video featuring India's Finance Minister, Nirmala Sitharaman, was circulated on social media to promote a fraudulent investment scheme. The video used AI-generated audio and text overlaid on genuine footage to falsely claim that the minister endorsed a high-return investment platform. Fact-checkers confirmed the video was fabricated, and no evidence of financial loss by victims was established.
A purported AI-manipulated video reportedly depicted Indian Finance Minister Nirmala Sitharaman endorsing an investment platform that claimed a ₹22,000 deposit could generate returns of up to ₹25 lakh per month. Genuine webinar footage was reportedly altered with synthetic audio and added text, and the advertisement circulated under the name "Trust India." Available evidence did not identify the perpetrators or establish whether viewers invested money or suffered financial losses.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The AI-generated video spread false and misleading information by fabricating an endorsement from a government official.
The incident involves the creation of a deepfake video impersonating a public figure to promote a fraudulent investment scam for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human scammers who intentionally created and distributed a deepfake video to defraud the public using deployed AI tools.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
Scammers created and circulated a deepfake video of India's Finance Minister, Nirmala Sitharaman, falsely endorsing a fraudulent investment platform. The video was quickly debunked by fact-checkers with no confirmed financial losses, representing a minor economic and information security threat with low national security impact.
The AI system was used as a tool by human creators to generate synthetic voice and manipulate video frames to create a deepfake. It performed a specific, well-defined function based on direct inputs provided by the scammers.
Risk Level 3: Limited Risk. The incident involves AI-generated content (a deepfake), which falls under Limited Risk due to transparency obligations requiring users to be informed that the content is AI-generated.
The AI system was used to generate a deepfake video of the Finance Minister with synthetic audio to mimic her voice.
The report clearly describes the nature of the deepfake, the platform, the fact-check, and the lack of confirmed financial losses. The role of AI is explicitly identified as generating synthetic voice and video.
None
Technology
AI Deepfake Generation Tools
AI algorithms allowed realistic manipulation of facial movements.
AI Voice Cloning
AI-generated audio cloned the Finance Minister's voice for the script.
Data Inputs
Publicly Available Video Footage
Scammers accessed official YouTube webinar footage of the Minister.
Scripted Fraudulent Text
Scammers fed deceptive text into the AI model to generate fake speech.
Human Factors
Exploitation of Public Trust
Scammers leveraged the high trust associated with a public official.
Vulnerability to Financial Scams
Viewers are lured by promises of high and guaranteed daily returns.
Process and Methods
Lack of Platform Ad Verification
Social media platforms failed to verify the authenticity of the video.
Ineffective Deepfake Detection
Automated tools failed to catch mismatched lip-syncing and transitions.
Regulatory Environment
Weak Social Media Regulations
Absence of strict enforcement against AI-generated misinformation.
Lack of Swift Legal Penalties
Insufficient immediate regulatory consequences for deepfake creators.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
