This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Facebook account impersonated Indonesian preacher Ustaz Ujang Bustomi using an AI-generated video to promote a fraudulent money-giveaway scheme. The video was flagged as AI-generated by Hive Moderation with 96.9% probability. The preacher has publicly denounced such claims as scams.
A Facebook account called "PT perusahaan uangtunai" reportedly shared an AI-generated video impersonating Indonesian preacher Ustaz Ujang Bustomi and allegedly claiming he was giving away money. TurnBackHoax reported that the post drew about 12,500 likes, 7,100 comments, and 422 shares by 11/21/2025, and that Hive Moderation rated the video as likely AI-generated.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfake video generated false statements and misleading claims about a monetary giveaway.
The incident involved using an AI-generated deepfake of a trusted preacher to run a fraudulent giveaway scam on Facebook for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by malicious human actors who intentionally generated and deployed a deepfake video to run a financial scam.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
An AI-generated deepfake video of Indonesian preacher Ustaz Ujang Bustomi was used on Facebook to conduct a financial scam. While the incident represents a common form of cyber-enabled fraud using synthetic media, it has negligible national security implications and presents no threat to critical infrastructure, sovereignty, or national economic stability.
The AI system was used as a tool by malicious actors to generate a synthetic video of the preacher. It performed a specific, well-defined function of video generation based on direct inputs.
Limited Risk: The report describes an AI-generated deepfake video. Under the EU AI Act, AI systems that generate or manipulate image, audio or video content (deepfakes) pose a moderate risk and are subject to transparency obligations to inform users.
The AI system was used to generate a synthetic video and voice of Ustaz Ujang Bustomi to impersonate him.
The report clearly details the nature of the scam, the platform used, the engagement metrics, and the fact-checking process confirming the video was AI-generated. There is little ambiguity about the events.
None
Technology
AI Deepfake Generation Tools
Advanced AI tools allowed synthesis of realistic video of Ustaz Bustomi.
Lack of Platform Deepfake Detection
Facebook failed to automatically detect and block the AI-generated scam video.
Data Inputs
Unauthorized Use of Source Video
Scammers used existing public videos of Ustaz Bustomi to train or drive AI.
Human Factors
User Vulnerability to Scams
Users believed the fake promise of easy money due to financial trust in Ustaz.
Impersonation of Public Figures
Exploiting the high public trust in religious figures to maximize scam reach.
Process and Methods
Inadequate Content Moderation
Social media moderation processes did not flag the fraudulent AI video.
Delayed Fact-Checking Response
Fact-checking occurred only after the video gained significant engagement.
Management
Inadequate Platform Risk Assessment
Platform management did not mitigate risks of AI-driven financial scams.
Regulatory Environment
Weak AI Generated Content Laws
Lack of strict regulation on creating and sharing deceptive deepfakes.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
