This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Thai actor Khunnapat Pichetworawut reported that scammers used AI to manipulate his face and private images into non-consensual sexual content. The perpetrators sold access to this material through private groups for 800–1,000 baht, causing significant reputational and emotional harm to the actor. The victim and his director filed a formal police complaint to address the fraud and defamation.
Thai actor Khunnapat Pichetworawut reportedly said scammers used AI to edit his face and private chat images into an obscene video purportedly presented as a leaked clip of him and sold access through private groups for about 800–1,000 baht. Reports say the material circulated on X.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The incident involved the creation and online promotion of explicit pornographic content.
The scammers obtained and leaked the victim's private chat images to fabricate the video.
Scammers used AI to create a non-consensual sexual deepfake of a specific victim to defraud buyers and target the victim with humiliating imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by human scammers intentionally using a deployed AI tool to create and distribute a deepfake video for financial gain.
Added categories peak at 2: Minor (Psychological Harm, Direct)
Thai actor Khunnapat Pichetworawut was targeted by scammers who used AI to generate non-consensual deepfake pornographic content for financial exploitation. The incident is a localized criminal matter with negligible national security implications, representing an established threat of synthetic media abuse targeting individuals.
The AI system was used as a tool by scammers to manipulate the actor's face onto a pre-existing video. The report does not describe any autonomous decision-making or agentic behavior by the AI itself, but rather its use as a software tool to generate synthetic media.
Limited Risk: The system used is an AI-generated content generator (deepfake). Under the EU AI Act, 'AI-generated content such as deepfakes' falls under Risk Level 3 (Limited Risk), which carries specific transparency obligations to inform users that the content is AI-generated.
The scammers used AI to place the actor's face onto a fake pornographic video clip, which is the definition of deepfake video generation.
The reports provide clear, consistent, and detailed accounts of the incident, including the victim's identity, the nature of the scam, the platform used for distribution, and the specific impacts on the victim's reputation and mental state. The role of AI as a deepfake generation tool is explicit.
None
Technology
AI Face Swapping Technology
Scammers used advanced AI to swap the actor's face onto adult content.
Easy Access to Deepfake Tools
Deepfake creation tools are highly accessible to malicious actors.
Data Inputs
Publicly Available Actor Photos
Scammers harvested public images of the actor to train the AI model.
Stolen Personal Chat Logs
Personal chat screenshots were used to add credibility to the scam.
Human Factors
Public Credulity
Viewers and close acquaintances believed the deepfake was genuine.
Malicious Intent of Scammers
Scammers actively exploited AI to defraud users and damage reputation.
Process and Methods
Inadequate Social Media Filtering
Platforms like X failed to automatically block the deepfake content.
Ineffective Reporting Mechanisms
Slow platform response allowed scammers to defy warnings and share free.
Management
Lack of Platform Accountability
Platform management failed to enforce strict rules against deepfakes.
No Proactive Risk Mitigation
No preventative checks were established by platforms to protect victims.
Regulatory Environment
Weak Deepfake Regulations
Lack of strong legal frameworks to deter AI-generated defamation.
Slow Law Enforcement Response
Police action is reactive, allowing the scam to spread initially.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
