A fraudulent investment scheme used AI deepfake technology to impersonate Thai PBS World news anchors and prominent business figures on Facebook. The deepfake was created by modifying a 2013 news report, replacing the original audio with synthesized Thai speech and superimposing the Thai PBS logo. The incident was investigated and debunked by Thai PBS Verify, which confirmed the clip was a deepfake using AI detection tools and identified the original source footage.
A purported deepfake video circulating on Facebook allegedly used AI-generated visuals and voice synthesis to impersonate Thai PBS World anchors and prominent business figures, promoting a fraudulent "Crystallum AI" investment promising fivefold returns. The original clip was reportedly traced to a 2013 NHK report, but it misused logos and likenesses.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfake video generated and spread false information regarding a non-existent investment project using a fabricated news broadcast.
The incident involved malicious actors using AI deepfake technology to impersonate trusted public figures in order to run a fraudulent investment scam on Facebook.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by malicious human actors intentionally using deployed AI deepfake generation tools to create a fraudulent investment advertisement.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A fraudulent Facebook ad campaign used AI deepfakes to impersonate Thai PBS news anchors and business leaders to promote a fake investment scheme. The incident represents a common cyber-enabled financial fraud threat with minor national security implications, manageable under standard law enforcement and media verification procedures.
The report describes the use of AI deepfake technology to synthesize Thai voice reporting and modify video clips. The AI operated as a tool to perform specific, well-defined functions based on direct inputs provided by the malicious actors.
Limited Risk: The system is an AI-generated content tool used to create deepfakes, which under the EU AI Act poses a moderate risk and requires specific transparency obligations to ensure users are informed.
The AI system was used to generate a deepfake video of a news anchor and synthesize a Thai voice to replace the original English audio.
The report provides clear details about the nature of the deepfake, the platforms used, the specific individuals impersonated, and the verification process. The role of AI is explicitly verified using detection tools.
None. It is clearly a malicious deepfake scam.
Technology
AI Deepfake Voice Synthesis
AI synthesized a Thai voice to impersonate the English-speaking anchor.
AI Face and Lip Syncing
Deepfake tech modified facial movements to match the fake Thai audio.
Data Inputs
Scraped Online Video Data
An old 2013 NHK news clip from YouTube was used as training/source data.
Unprotected Personal Biometrics
Publicly accessible faces and voices were used without authorization.
Human Factors
Malicious Exploitation of AI
Bad actors intentionally used AI to create a deceptive investment scam.
Viewer Susceptibility to Scams
Viewers may trust the fake video due to realistic AI-generated elements.
Process and Methods
Inadequate Ad Screening on Facebook
Facebook approved and distributed the deepfake video as a paid ad.
Lack of Proactive AI Detection
No automated real-time checks stopped the fake content prior to upload.
Management
Inadequate Ad Verification
Platform management failed to verify the legitimacy of the advertiser.
Lack of Brand Monitoring
Thai PBS lacked continuous monitoring to detect logo misuse immediately.
Regulatory Environment
Reactive Legal Framework
Laws like the Computer Crime Act only penalize after damage has occurred.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.