This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
BBC presenter Naga Munchetty and other high-profile figures have been targeted by AI-generated scams. These scams use deepfake imagery and fake news articles, often mimicking reputable media outlets like the BBC, to deceive users into participating in fraudulent investment schemes or to distribute non-consensual sexually explicit content. Despite platform policies against such content, these scams continue to proliferate on social media, leading to significant financial losses for victims.
BBC presenter Naga Munchetty was reportedly targeted in an AI-generated scam using deepfake images and fake news articles to promote a fraudulent investment scheme. Scam ads on social media allegedly featured manipulated images of Munchetty and linked to a fake BBC article directing users to a cyber trading website. The BBC legal team is reported to have taken action to remove the fraudulent site.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The scammers created and distributed non-consensual sexually explicit deepfakes of high-profile women, exposing social media users to highly toxic content.
The primary objective of the AI-generated deepfakes and fake news articles was to impersonate trusted individuals to defraud victims for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human scammers intentionally deploying AI-generated deepfakes and fake articles to defraud and harass individuals.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
AI-generated deepfakes of high-profile figures and fake news articles mimicking the BBC were used in sophisticated financial scams. While causing significant individual financial loss and psychological distress, the incident represents a serious cybercrime and regulatory challenge rather than a direct threat to national security.
The reports describe deepfakes being 'created or altered using artificial intelligence' to swap faces. The AI operates as a tool performing a specific, well-defined function of image/video manipulation based on direct human inputs.
Limited Risk: The report describes AI-generated content such as deepfakes, which are subject to transparency obligations under the EU AI Act to ensure users are aware they are interacting with synthetic media.
The AI systems were used to generate fake nude photos (image generation) and sexually explicit deepfake videos (video generation) of celebrities.
The reports provide clear, first-hand accounts from a victim (Naga Munchetty) and details of investigations by the BBC and Which? regarding the scams. The role of AI in generating the deepfakes is explicitly discussed, and the financial and psychological harms are well-documented.
None
Technology
AI Deepfake Tech Access
Easy access to AI tools allows scammers to generate realistic fake media.
Inadequate Detection Tech
Platforms lack robust AI tools to automatically flag synthetic media.
Algorithmic Ad Delivery
Algorithms optimized for engagement promoted scam ads to vulnerable users.
Data Inputs
Stolen Likeness Data
Public images and videos of celebrities harvested to generate deepfakes.
Spoofed Brand Assets
Scammers used BBC logos and branding to make fake articles look authentic.
Human Factors
User Trust in Celebrities
Victims trusted the fake endorsements due to the celebrity's reputation.
Malicious Scammer Intent
Criminals actively exploit AI to deceive users and steal money.
Process and Methods
Flawed Ad Vetting Processes
Platforms allowed paid scam ads to run without sufficient verification.
Slow Content Takedowns
Platforms took too long to remove reported deepfakes and scam links.
Management
Neglecting Safety for Profit
Platforms prioritized ad revenue over rigorous safety checks on advertisers.
Reduced Moderation Resources
Management changes led to fewer resources dedicated to content moderation.
Regulatory Environment
Weak Synthetic Media Laws
Inadequate regulatory pressure on platforms to prevent deepfake spread.
International Jurisdictions
Scammers operated from foreign locations, complicating law enforcement.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
