This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A woman in Guelph, Ontario, lost $14,000 after falling victim to a cryptocurrency scam that utilized AI-generated deepfakes of a popular YouTuber to impersonate the celebrity and solicit funds. The victim was deceived by social media advertisements and a phone call, leading her to transfer money into a fraudulent cryptocurrency wallet. Local police have issued a warning regarding the use of AI in celebrity-endorsed financial scams.
A Guelph, Ontario, woman reportedly lost $14,000 after clicking a social-media ad for a cryptocurrency investment purportedly promoted by MrBeast. Police said her losses accumulated through an initial $250 payment and later transfers made after she spoke with supposed representatives and someone she believed was the YouTube creator, including $5,000 sent to a crypto wallet.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves malicious actors using AI-generated deepfakes and voice clones of a celebrity to execute a targeted financial scam and defraud a victim of $14,000.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human scammers who intentionally used deployed AI deepfake tools to defraud a victim.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A Canadian citizen lost $14,000 to a financial scam utilizing AI-generated deepfakes and voice cloning of a popular YouTuber. While demonstrating the growing accessibility of sophisticated social engineering tools, the incident is a localized cybercrime with negligible implications for national security.
The AI systems were used as tools by malicious actors to generate synthetic media, specifically deepfake videos and cloned voices, to facilitate a financial scam. The report states that these celebrity endorsements can be 'easily faked with artificial intelligence'.
Risk Level 3: The incident involves 'AI-generated content such as deepfakes' used to impersonate a celebrity, which falls under the transparency obligations of Limited Risk systems.
The AI was primarily used to generate a deepfake video of Jimmy Donaldson to impersonate him in social media ads, and voice generation was used to clone his voice for a phone call.
The report clearly details the scam, the specific amount lost ($14,000), the method of deception (AI-generated deepfake video and phone call), and the identity of the impersonated celebrity. There is minimal ambiguity regarding the events described.
None. The incident is a straightforward financial fraud facilitated by synthetic media.
Technology
Deepfake Video Generation
AI-generated video mimicked celebrity likeness to deceive the victim.
AI Voice Cloning
AI-synthesized voice used during phone calls to build trust.
Algorithmic Ad Targeting
Social media algorithms delivered malicious deepfake ads to users.
Data Inputs
Celebrity Likeness Training Data
Publicly available media used to train AI models of the celebrity.
Unverified Ad Media Assets
Malicious ad assets uploaded to platforms without input validation.
Human Factors
Trust in Celebrity Likeness
Victim trusted the fake endorsement due to celebrity's reputation.
Low AI Deepfake Awareness
Victim lacked awareness that video and voice could be faked with AI.
Urgency and Financial Pressure
Victim acted quickly due to high-pressure tactics from the scammer.
Process and Methods
Inadequate Ad Screening
Social media platforms failed to screen ads for AI-generated deepfakes.
Weak Identity Verification
Lack of robust identity checks for advertisers promoting investments.
Delayed Scam Takedowns
Slow response in removing reported deepfake ads from the platform.
Management
Prioritizing Ad Revenue
Platforms prioritized ad sales over rigorous safety and verification.
Inadequate Risk Mitigation
Platform management failed to address known risks of AI deepfake ads.
Regulatory Environment
Lack of Deepfake Regulation
No strict legal framework governing AI impersonation and deepfakes.
Weak Platform Liability
Platforms are not legally liable for hosting fraudulent AI-generated ads.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
