This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Following the crash of Air India Flight 171 on June 12, 2025, bad-faith actors exploited the delay in official information to circulate AI-generated misinformation. This included a fabricated preliminary accident report, doctored images of the crash site, and deepfake videos created from victims' personal photos. These materials misled the public and aviation professionals, caused significant distress to victims' families, and were used to facilitate fraudulent fundraising campaigns.
Following the June 12, 2025 crash of Air India Flight 171, bad-faith actors reportedly used generative AI to produce fake videos and images misrepresenting victims and dramatizing the event. These AI-generated fakes spread widely on social media during the investigation delay, reportedly confusing even aviation professionals and misleading the public. Experts warned that the misuse exploited the grief of victims' families and amplified misinformation about the tragedy.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
AI-generated fake preliminary crash reports containing realistic aviation jargon misled aviation professionals and news media.
The incident involved bad actors intentionally using AI to generate fake crash reports, deepfake videos of victims, and fraudulent fundraising campaigns to exploit the tragedy for financial gain and manipulation.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was driven by human bad actors intentionally using post-deployment AI generation tools to create misleading reports, deepfakes, and fraudulent campaigns.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
Following the crash of Air India Flight 171, bad-faith actors used AI to generate highly convincing fake crash reports and distressing deepfakes of victims. While the incident caused significant psychological harm to grieving families and temporarily misled media, its national security impact remains minor as it did not threaten critical infrastructure, state sovereignty, or strategic stability.
The reports describe bad actors 'leveraging AI' to generate fake reports, deepfake videos, and synthetic images. The AI systems functioned as tools to generate specific content based on user inputs (such as photos or text prompts) without exhibiting independent goal-directed behavior.
Limited Risk: The incident involves 'AI-generated content such as deepfakes' and synthetic media, which fall under Risk Level 3 due to transparency obligations to inform users that the content is AI-generated.
The AI systems were primarily used to generate deepfake videos of the crash victims and fake technical reports mimicking official aviation accident investigations.
The reports provide consistent and detailed accounts of the types of AI-generated misinformation (fake reports, deepfake videos, fraudulent fundraising) and their specific impacts on victims' families and aviation professionals. The role of AI as a content generation tool is clear, and the resulting harms are well-documented across multiple sources.
None
Technology
AI Text Generation Platforms
Used to generate highly convincing fake crash reports with aviation jargon.
Deepfake Video Generation
Created synthetic videos of victim cremation and passenger dramatization.
AI Image Manipulation
Produced doctored images of aircraft ablaze or falsely positioned.
Data Inputs
Unverified Historical Accident Data
AI used 2024 LATAM Airlines incident data to create a fake report.
Unauthorized Victim Photos
Social media selfies of victims were used as inputs for AI deepfakes.
Human Factors
Lack of Verification by Journalists
News websites published stories based on fake AI reports without verifying.
Exploitation of Emotional Grief
Bad actors used AI content to run fraudulent fundraising campaigns.
Public Susceptibility
Aviation circles and public easily misled by realistic AI reports.
Process and Methods
Slow Official Communication
AAIB delayed official updates, creating an information vacuum filled by AI.
Inadequate Platform Moderation
Social media platforms failed to quickly flag and remove AI misinformation.
Management
Delayed AAIB Investigation Updates
Investigation bureau failed to hold daily briefings to counter fake news.
Regulatory Environment
Lack of Platform Accountability
Absence of strict enforcement or laws requiring platforms to label AI content.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
