This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Northeast Ohio man was defrauded of $20,000 after being targeted by a social media scam. The perpetrators used a deepfake video of a celebrity to convince the victim to open credit accounts under the guise of starting an online store. The victim later realized the scheme was fraudulent after interacting with the scammers, but had already incurred significant debt.
A Northeast Ohio man ("Ray," pseudonym) was allegedly lured by a social-media deepfake video impersonating Elton John into a "push button" scam promising easy income from an online store. Ray reportedly said he was directed by purported "representatives" to open accounts and credit cards, after which charges accumulated to about $20,000. He later reported one card credited $9,400.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves scammers using a deepfake video of a celebrity to impersonate them and run a fraudulent online store scam, resulting in financial loss for the victim.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The financial scam was intentionally executed by human actors who deployed a deepfake video of a celebrity to deceive the victim.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A US citizen was defrauded of $20,000 by scammers using a celebrity deepfake video on social media. While illustrating the growing use of synthetic media in consumer fraud, the incident has negligible national security implications.
The AI system was used as a tool to generate a deepfake video of a celebrity. The report notes that scammers 'will use deep fake videos of celebrities', indicating the AI functioned as a content generation tool for the human operators.
Limited Risk: The report describes the use of 'deep fake videos of celebrities' on social media, which falls under Risk Level 3 due to transparency obligations for AI-generated content.
The AI system was used to create a synthetic video of a celebrity to deceive users on social media.
The report clearly outlines the scam, the role of the deepfake video, the financial impact on the victim, and the emotional distress caused. There is little ambiguity regarding the sequence of events or the classification of the incident as a financial scam leveraging deepfake technology.
None. The incident is a straightforward financial scam utilizing synthetic media.
Technology
Deepfake Video Generation
Scammers used AI to create a realistic video of celebrity PERSON_002.
Algorithmic Ad Delivery
The platform's ad algorithm targeted vulnerable users with the scam.
Data Inputs
Unlabeled Synthetic Content
The video lacked metadata or labels identifying it as AI-generated.
Human Factors
Trust in Celebrity Endorsement
The victim trusted the video because it featured a famous musician.
Financial Vulnerability
Economic pressure made the victim receptive to quick-income claims.
Lack of Deepfake Awareness
The victim could not recognize the visual indicators of a deepfake.
Process and Methods
Inadequate Ad Moderation
The platform's ad review process failed to detect the fraudulent deepfake.
Weak Account Verification
Scammers easily created fake representative accounts to contact the victim.
Management
Revenue Prioritization
Platform prioritized ad revenues over rigorous security vetting.
Inadequate Risk Assessment
Management failed to address the threat of AI-generated financial fraud.
Regulatory Environment
Lack of Deepfake Regulation
Insufficient legal frameworks to deter and penalize deepfake creators.
Weak Platform Accountability
No regulations forcing platforms to verify the authenticity of ad content.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
