This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The New Zealand Financial Markets Authority (FMA) has issued a warning regarding a global pump-and-dump scam that utilizes deepfake videos of prominent business leaders to deceive investors. These deepfakes are used in social media advertisements to direct victims to fraudulent WhatsApp investment groups, where they are manipulated into purchasing low-value shares. Following the financial loss, victims are often targeted by a secondary 'recovery' scam designed to extract further funds and personal information.
The New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, reportedly warned of a global AI-enabled "pump-and-dump" scam that used purported deepfake videos of prominent New Zealand business leaders in Facebook and Instagram ads to lure investors into fake WhatsApp investment groups. Victims were allegedly urged to buy low-value foreign shares to inflate prices, then defrauded through a follow-on "recovery" scam.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves scammers using deepfake technology to impersonate business leaders in order to commit financial fraud and target individual investors for personal gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The scam is orchestrated by human actors who intentionally deploy deepfake technology post-deployment to deceive investors for financial gain.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A global financial scam network utilized deepfake videos of prominent New Zealand business leaders to execute a pump-and-dump scheme targeting individual investors. While the incident causes financial harm and highlights the growing threat of synthetic media in fraud, it remains a criminal matter with minor direct implications for national security.
The AI system (deepfake generator) is used as a tool by human scammers to generate synthetic media of business leaders based on direct inputs, without exhibiting autonomous planning or decision-making.
Limited Risk: The report describes the use of 'AI-generated content such as deepfakes' to impersonate business leaders, which falls under the transparency obligations of Risk Level 3.
The AI was primarily used to generate deepfake videos/advertisements of prominent business leaders to impersonate them on social media.
The reports from the Financial Markets Authority provide a clear, detailed, and authoritative account of the scam's mechanics, the platforms used, and the role of deepfake technology. While exact financial losses and the precise number of victims are not quantified, the nature of the AI's involvement (deepfakes and bots) and the resulting harms are unambiguously described.
None. The incident is clearly a coordinated financial scam leveraging synthetic media.
Technology
Deepfake Video Generation
AI-generated deepfakes successfully impersonated trusted business leaders.
Automated Bot Accounts
AI-controlled bots populated group chats to simulate active engagement.
Data Inputs
Impersonation Target Media
Publicly available media of leaders used to train deepfake algorithms.
Unverified Ad Creatives
Platforms accepted fraudulent media inputs for paid promotional campaigns.
Human Factors
Cognitive Bias and FOMO
Investors trusted familiar faces and feared missing out on quick gains.
Lack of Deepfake Awareness
Victims could not distinguish synthetic media from real videos of leaders.
Process and Methods
Flawed Ad Moderation
Automated ad reviews failed to detect deepfake impersonations.
Unregulated Messaging Groups
Platforms lacked proactive scanning for fraudulent group chat activities.
Management
Revenue Prioritization
Ad networks prioritized revenue over rigorous vetting of financial ads.
Slow Platform Response
Delayed action by platforms in removing reported imposter accounts.
Regulatory Environment
Cross-Border Gaps
Global nature of scams makes international regulatory enforcement difficult.
Weak Synthetic Media Laws
Lack of clear regulations holding platforms accountable for deepfake ads.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
