This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A deepfake video of Australian billionaire Andrew Forrest was identified on Facebook, falsely depicting him endorsing a fraudulent cryptocurrency platform named 'Quantum AI'. The video, which manipulated footage from a 2023 Rhodes Trust talk, is part of a broader trend of deepfake-based financial scams targeting social media users. The incident highlights ongoing concerns regarding the efficacy of platform moderation in preventing AI-generated fraud.
Cybertrace reportedly identified a purported deepfake of Australian billionaire Andrew Forrest circulating on Facebook on January 27, 2024, falsely depicting him endorsing a fraudulent crypto platform called Quantum AI. The video reportedly altered footage from a 2023 Rhodes Trust talk. Forrest reportedly condemned Meta for failing to curb AI-generated frauds.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfake video generated and spread false information regarding Andrew Forrest's endorsement of a cryptocurrency platform.
The incident involves the use of AI-generated deepfakes of a public figure to promote a fraudulent cryptocurrency platform, directly targeting individuals for financial scamming.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The deepfake scam was intentionally created and deployed by human malicious actors using post-deployment AI generation tools to defraud social media users.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A deepfake-enabled financial scam targeting Australian billionaire Andrew Forrest on Facebook. While representing an ongoing challenge for platform moderation and contributing to epistemic erosion, the incident is a localized criminal fraud with minor national security implications.
The report describes the AI system being used to generate a deepfake video by modifying existing footage of Andrew Forrest. This represents a specific, well-defined function operating on direct input to produce a synthetic video, characteristic of a Tool.
Limited Risk: The report describes the use of 'Artificial intelligence (AI) generated deepfake videos' which fall under the category of AI-generated content requiring transparency obligations under the Act.
The AI system was used to create a deepfake video of Andrew Forrest by modifying his actions, mannerisms, and voice from a real fireside chat.
The report clearly describes the nature of the deepfake, the platform it was hosted on, the target individual, and the fraudulent intent. There is little ambiguity regarding the classification of this event as a deepfake-enabled financial scam.
None
While the specific AI generator and exact victim counts are not detailed, this information is not strictly necessary to confidently classify the incident under the domain and causal taxonomies.
Technology
Advanced Deepfake Generation
AI tools easily alter actions and mannerisms to create realistic fakes.
Lagging Deepfake Detection
Verification systems fail to keep pace with evolving AI generation tools.
Data Inputs
Use of Real Public Footage
Scammers source legitimate videos of public figures to train AI models.
Human Factors
Trust in Public Figures
Unassuming users trust recognizable figures like prominent businessmen.
Process and Methods
Ineffective Ad Screening
Social media platforms fail to filter out deceptive and doctored video ads.
Slow Content Removal
Platforms take days to remove scams, allowing them to reach many targets.
Management
Inadequate Safety Enforcement
Meta fails to enforce its 2020 deepfake ban effectively on its platforms.
Regulatory Environment
Lack of Platform Liability
Social media companies face minimal legal liability for negligent ad platforms.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
