This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A South Korean police officer was arrested and indicted for using an AI application to create approximately 400 sexually explicit deepfake videos of his acquaintances and distributing them on Telegram.
A police officer at Dongdaemun Police Station in Seoul, South Korea, was accused of using an AI app to create roughly 400 sexually explicit deepfake videos from acquaintances' photographs and sharing about 50 through Telegram. He was also charged with possessing about 1,600 child sexual abuse videos. Reporting does not establish whether that material was AI-generated. He was indicted following an undercover police investigation.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The perpetrator distributed the sexually explicit deepfakes on Telegram, exposing other users to harmful and non-consensual sexual content.
The incident involves the targeted creation of humiliating and sexually explicit deepfake imagery of specific victims (acquaintances) for personal gratification and harassment, which falls under sub-domain 4.3.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was directly caused by the intentional actions of a human user (the police officer) who chose to use an AI tool to generate non-consensual sexual deepfakes of his acquaintances.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A South Korean police officer was arrested for creating and distributing non-consensual sexual deepfakes of acquaintances. While highlighting vulnerabilities in police background checks and representing severe personal privacy violations, the incident remains a localized criminal matter with minor national security implications.
The AI system was used as a tool by the officer to perform a specific, well-defined function (generating deepfake videos from input photos) without autonomous decision-making or planning.
Limited Risk: The AI system was used to generate deepfakes, which falls under the transparency obligations of Risk Level 3 under the EU AI Act.
The AI application was explicitly used to generate false videos and images depicting acquaintances naked.
The reports from multiple reputable news agencies provide consistent and detailed factual accounts of the officer's actions, the timeline, the scale of the deepfakes created, and the legal proceedings.
None. The facts clearly point to a case of non-consensual deepfake creation and distribution.
While the exact number of victims and the specific AI app name are not provided, this information is not strictly necessary to confidently classify the incident.
Technology
AI Deepfake Software
AI tools allowed easy and realistic synthesis of fake nude videos.
Telegram Platform
Encrypted messaging enabled secure and anonymous sharing of illicit content.
Data Inputs
Acquaintance Photos
Offender harvested target face images to feed into deepfake AI models.
Human Factors
Offender Sexual Deviance
Suspect's psychological urge to sexually exploit female and child images.
Moral Hazard of Officer
Committed digital sex crimes while serving as an active police officer.
Process and Methods
Flawed Screening Process
Criminal history checks failed to reveal prior sexual offense records.
Management
Inadequate Monitoring
Lack of internal oversight to detect illegal activities by active officers.
Regulatory Environment
Legal Gaps in Disclosure
Suspended indictments are legally omitted from job background checks.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
