This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Fraudsters are increasingly using AI-generated deepfakes and synthetic media to impersonate prominent financial experts on social media platforms like Facebook and Instagram. These scams lure victims into fraudulent investment groups on WhatsApp, resulting in substantial financial losses. While victims and experts have reported these scams to platforms and law enforcement, the proliferation of these AI-driven frauds continues to challenge existing legal and regulatory frameworks.
Fraudsters allegedly used AI-generated content and social media ads to impersonate economist David Rosenberg and promote a fraudulent investment scheme. Victims were reportedly directed to WhatsApp groups with fake stock tips, resulting in substantial financial losses, with some exceeding $500,000. The ads reportedly appeared on Meta platforms, including Facebook and Instagram. Rosenberg and his family reported the scam to authorities.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves malicious actors using AI-generated deepfakes of financial experts to conduct targeted investment scams and fraud, resulting in significant financial losses for victims.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human fraudsters intentionally deploying and utilizing AI deepfake generation tools to scam investors.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
Fraudsters used AI-generated deepfakes and voice cloning to impersonate prominent financial experts, defrauding Canadian and international investors of over $1 million. While representing an evolved cybercrime capability with significant individual financial harm, the incident remains a criminal fraud issue with minor national security implications.
The AI systems were used as tools by fraudsters to generate hyper-realistic synthetic videos and cloned voices of financial experts based on direct inputs of their public likenesses.
Risk Level 3: Limited Risk. The reports describe the use of AI-generated content such as deepfakes to impersonate financial experts, which falls under transparency obligations for synthetic media.
The AI was primarily used to generate hyper-realistic videos of financial experts to deceive social media users, alongside cloned voices.
The reports provide clear, consistent, and detailed accounts of multiple deepfake impersonation scams targeting financial experts, including specific financial losses and platform reach. The role of AI in generating these videos and voices is explicitly stated.
None. The events clearly represent a coordinated financial scam utilizing synthetic media.
Technology
AI Deepfake Video Generation
Hyper-realistic AI videos realistically mimicked financial experts' movements.
AI Voice Synthesis
AI synthesized realistic voices to make fraudulent investment advice convincing.
Internet Scraping Tools
Scammers scraped legitimate business data to train and build fake profiles.
Data Inputs
Lack of Ad Identity Verification
Meta did not verify the identity of advertisers using public figures' names.
Scraped Public Media Data
Abundant public video and audio of experts was used to train deepfake models.
Unlabeled AI Generated Content
AI-generated ads lacked metadata or labels indicating they were synthetic.
Human Factors
Investor Trust in Authority Figures
Victims trusted the realistic AI likeness of well-known financial experts.
Desire for High Yield Returns
Low interest rates drove investors to trust unrealistic high-yield promises.
Inability to Detect Deepfakes
Users could not distinguish highly realistic AI avatars from real videos.
Process and Methods
Slow Ad Takedown Procedures
Meta's manual and slow review processes allowed scam ads to run for months.
Ineffective Ad Moderation Algorithms
Automated moderation failed to flag obvious deepfake scams targeting users.
Whack-a-Mole Reporting System
Reporting scams was reactive and failed to prevent re-uploading of fake ads.
Management
Delayed Deployment of Safeguards
Meta only deployed facial recognition verification after major public pressure.
Prioritizing Ad Revenue Over Safety
Platforms allowed unverified ads to run without rigorous pre-screening.
Inadequate Risk Assessment of AI
Management failed to anticipate the scale of AI-driven imposter fraud.
Regulatory Environment
Safe Harbour Legal Protections
Platforms face limited liability for user-generated scam ads under safe harbor.
Lack of National Fraud Agency
Canada lacks a unified, proactive fraud-fighting agency like Australia.
Cross-Jurisdictional Police Barriers
International scammers operate outside the reach of local law enforcement.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
