This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Criminal organizations are leveraging generative AI to conduct sophisticated, large-scale investment scams. By using deepfake videos of public figures, synthetic passport images, and cloned financial websites, these groups have defrauded tens of thousands of victims globally of hundreds of millions of dollars. Regulators and law enforcement agencies, including the FBI, SEC, and Spanish police, have confirmed that AI tools significantly lower the barrier to entry and increase the speed and success rate of these fraudulent operations.
Spanish police arrested six individuals allegedly behind a €19M ($20.9M) global investment scam powered by AI. The operation used deepfake ads featuring national celebrities to deceive victims, many of whom were selected through targeting algorithms. Scammers posed as financial advisors and fake officials, cycling through romance baiting, investment fraud, and recovery scams. AI-generated content amplified trust and engagement.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
AI-generated deepfakes and cloned trading platforms were used to spread false information and mislead victims into believing the investments were legitimate.
The incident involves scammers using generative AI tools to create highly realistic deepfakes, fake passports, and cloned websites to execute targeted financial fraud and investment scams.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human scammers intentionally using deployed generative AI tools to create fake passports, deepfakes, and cloned websites to defraud victims.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
Criminal organizations utilized generative AI tools, including deepfakes and synthetic document generation, to conduct large-scale international financial fraud. While the operations caused substantial economic harm to tens of thousands of individuals globally, the overall national security impact remains minor as the incident did not target critical infrastructure, sovereignty, or systemic stability.
The reports describe generative AI being used as a tool by scammers to quickly copy website interfaces, generate fake passport images, and create deepfake videos of public figures based on direct user prompts.
Limited Risk: The report describes the use of 'AI-generated content such as deepfakes' to create fake ads of public figures and fake passport images.
The scammers primarily used AI to generate deepfake videos of public figures to promote fake investments, as well as deepfake images of passports to bypass verification.
The reports provide detailed, corroborated accounts from financial compliance officers, regulators (CFTC, SEC, FBI), and law enforcement (Spanish police) regarding the scale, methods, and financial impact of the scams. The role of AI in generating deepfakes, fake passports, and cloned websites is clearly documented with specific figures on victims and losses.
None. The events are clearly identified as coordinated financial fraud facilitated by generative AI tools.
Technology
AI-Generated Deepfake Video Ads
Scammers used AI to generate highly convincing deepfake ads of celebrities.
Rapid AI Website Cloning Tools
AI tools allowed scammers to quickly clone complex trading boards and sites.
ChatGPT Fake Passport Generation
ChatGPT image generation made creating realistic fake passports extremely easy.
Data Inputs
Victim Profiling Algorithms
Algorithms analyzed user profiles to select and target vulnerable victims.
Real Platform Data Replication
Scammers replicated real trading board data to make fake platforms look real.
Human Factors
Trust in Deepfake Celebrity Ads
Victims trusted fake ads due to realistic deepfakes of public figures.
Susceptibility to Romance Baiting
Victims fell for emotional manipulation and fake romantic interest by scammers.
Overreliance on Fake Digital Figures
Victims trusted fake platform interfaces showing fabricated high returns.
Process and Methods
Fast Creation and Exploitation
AI-driven automation drastically reduced the scammers' time-to-exploit.
Multi-Phase Scam Tactics
Scammers used complex multi-phase tactics, including fake recovery claims.
Shell Company Money Laundering
Criminals set up multiple shell companies and aliases to launder proceeds.
Management
Inadequate Bank Verification
JP Morgan Chase allowed scammers to open real accounts with fake identities.
Brokerage Lack of US Presence
Exante could not easily report or stop scams targeting US clients.
Regulatory Environment
Lack of Active AI Fraud Oversight
Regulators have not fully explored AI capabilities to address AI-driven fraud.
Low Barriers to Entry for Actors
Lack of strict controls allows cybercriminals easy access to advanced AI tools.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
