This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Malaysian family reported a sextortion incident where scammers used AI-generated explicit video content to target their teenage son. The perpetrators demanded RM5,800 under the threat of releasing the fabricated footage. The family reported the incident to the police, who noted that such AI-enabled extortion schemes targeting minors are becoming increasingly common.
A Malaysian family reported that scammers used purported AI-generated explicit video content to target their teenage son in a sextortion attempt. The perpetrators allegedly contacted the boy via Telegram, sending manipulated footage that depicted him in compromising situations and demanding RM5,800 (~$1,400) to prevent its release. The family alerted authorities and warned others about the growing use of generative AI in targeting minors.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The victim was directly exposed to toxic, sexually explicit synthetic content created to harass and extort him.
The incident involves scammers using AI-generated explicit content to target and extort a specific minor for financial gain, which constitutes targeted fraud and manipulation.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The extortion incident was caused by the intentional actions of human scammers utilizing deployed AI deepfake generation tools to target a minor.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
An AI-enabled sextortion incident in Malaysia where scammers used deepfake video generation to target and extort a minor. While representing an evolved capability in cyber-enabled crime and a minor threat to societal privacy protections, the incident has negligible direct national security implications.
The AI system was used as a tool to perform a specific, well-defined function of generating a deepfake video from a photo, operating on direct input without autonomous planning or context retention.
Risk Level 3: The incident involves 'AI-generated content such as deepfakes', which falls under Limited Risk due to transparency obligations, though its malicious use by humans caused harm.
The AI system was used to generate a fabricated, explicit video of the victim using his photo.
The report clearly outlines the sequence of events, the nature of the threat, the medium used (Telegram), the demand amount (RM5,800), and the involvement of AI deepfake tools. There is little ambiguity regarding the facts of this specific case.
None
Technology
AI Deepfake Generation Tools
Scammers easily access AI tools to generate realistic explicit videos.
Anonymous Messaging Platforms
Telegram allows accounts without visible phone numbers, shielding scammers.
Data Inputs
Accessible Personal Photos
Publicly accessible photos were harvested to generate the deepfake.
Human Factors
Targeting of Vulnerable Minors
Scammers exploit minors' fear to extort money.
Oversharing on Social Media
Users upload personal photos online, providing raw material for deepfakes.
Process and Methods
Inadequate Content Moderation
Messaging platforms lack real-time filtering for non-consensual deepfakes.
Management
Inadequate Platform Safety Policies
Platform management fails to prioritize safety measures against AI extortion.
Regulatory Environment
Lack of Deepfake Regulation
Insufficient legal frameworks to restrict the creation of malicious AI tools.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
