This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The 'Quantum AI' fraud network is a global, multi-year investment scam that leverages generative AI to create high-quality deepfake videos and audio of celebrities, politicians, and news anchors. These deepfakes are used in paid social media advertisements and fake news articles to lure victims into depositing money into fraudulent trading platforms. The scheme has caused significant financial harm to thousands of victims worldwide, with losses reaching into the millions, while exploiting the trust associated with the impersonated public figures.
A global investment fraud network known as Quantum AI has reportedly used AI-generated deepfake videos, fake news sites, phishing pages, and spoofed calls to deceive victims. The scheme allegedly impersonates celebrities, news outlets, and political leaders to promote fraudulent trading platforms, leading targets to transfer money they cannot recover. Investigations suggest coordinated operations across multiple countries and platforms.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The scam relies on AI-generated fake news broadcasts and articles that spread false information to deceive investors.
The unauthorized replication and exploitation of public figures' and journalists' likenesses devalues their professional reputation and human effort.
The incident involves malicious actors using AI-generated deepfakes of public figures to orchestrate highly targeted financial fraud and investment scams.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident is driven by human malicious actors intentionally deploying deepfake AI models post-deployment to defraud the public.
Added categories peak at 3: Substantial (Psychological Harm, Inferred)
The Quantum AI fraud network represents an evolved threat where malicious actors leverage generative AI and voice cloning to execute highly convincing global investment scams. While the incident primarily constitutes retail financial fraud with minor direct national security impact, the scale of public figure impersonation and information pollution highlights growing challenges for societal trust and digital ecosystem integrity.
The AI system is used as a tool to perform specific, well-defined functions, namely generating deepfake videos and cloning voices based on direct human inputs, without autonomous decision-making or context retention.
Limited Risk: The report describes the use of AI-generated content such as deepfakes, which falls under Risk Level 3 due to transparency obligations requiring users to be informed they are interacting with AI-generated media.
The primary function of the AI system in this incident is generating highly convincing deepfake videos and cloned voices of public figures to deceive the public.
The reports provide extensive, consistent, and highly detailed accounts of the Quantum AI scam network across multiple countries, including specific financial losses, platforms used, and technical details of the hosting infrastructure.
None
Technology
Cheap Voice and Face Cloning
Allowed scammers to easily replicate public figures' likenesses.
Lip-Syncing Software
Modified lip movements of figures to match AI-generated audio.
Generative AI Tools
Enabled rapid creation of high-quality, convincing fake videos.
Data Inputs
Authentic Interview Footage
Real media footage was hijacked and used as input for manipulation.
Trusted Celebrity Likeness
Names and faces of trusted figures were fed into voice-cloning tools.
Original Speech Audio
Voice recordings of public figures used to train cloning models.
Human Factors
Public Trust in Celebrities
Victims trusted fake endorsements by respected public figures.
Low Digital Literacy
Victims struggled to spot unnatural movements and lip-sync errors.
Overreliance on Social Media
Users assumed platforms verified the legitimacy of paid advertisements.
Process and Methods
Lax Ad Moderation Policies
Social media platforms failed to catch policy-violating deepfake ads.
Delayed Content Takedowns
Slow response times allowed scam ads to reach hundreds of thousands.
IP Address Obfuscation
Use of CDNs and reverse proxies hid scammers' hosting infrastructure.
Management
Prioritization of Ad Revenue
Platforms accepted payments for unverified ads to boost revenue.
Inadequate Proactive Risk Assessment
Management failed to deploy automated tools to detect deepfake ads.
Lack of Platform Oversight
Failure to proactively audit verified accounts hijacked by scammers.
Regulatory Environment
Lagging Online Safety Laws
New duties under the Online Safety Act were not yet fully in force.
No Mandatory Ad Verification
Regulators did not require platforms to verify financial advertiser registry.
Lack of Platform Accountability
Absence of strict legal penalties for hosting fraudulent AI content.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
