This report details the non-consensual use of deepfake technology to create and distribute pornographic content featuring the likenesses of women, including celebrities and private individuals. The practice is described as a form of digital manipulation that strips victims of control over their own faces and contributes to sexual humiliation. Research cited in the report indicates that the vast majority of deepfakes found online are pornographic in nature and target women without their consent.
The actor Kristen Bell discovered that her likeness was exploited by creators of deepfake pornography, who shared their non-consensual sexual depictions of her on the Internet.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The generated deepfake pornographic videos represent highly toxic, abusive, and sexually explicit content hosted on public platforms.
The incident involves the targeted creation of humiliating and sexual deepfake imagery of specific victims (Kristen Bell and the Perth law graduate) without their consent, which fits under targeted manipulation and humiliation.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human actors intentionally utilizing deployed deepfake generation tools to create non-consensual pornographic content targeting specific women.
Added categories peak at 3: Substantial (Psychological Harm, Inferred)
The incident highlights the widespread use of deepfake technology for non-consensual pornography targeting women. While causing severe psychological harm and privacy violations to individuals, its direct national security impact is minor, primarily affecting digital privacy and human rights frameworks rather than critical infrastructure or state sovereignty.
The AI system functions as a Tool, as it is used by human creators to perform the specific, deterministic task of face-swapping and facial animation based on direct image inputs.
Risk Level 3: Limited Risk. The incident involves 'AI-generated content such as deepfakes' which are subject to transparency obligations under the EU AI Act to ensure users are aware the content is synthetic.
The AI systems were used specifically to manipulate faces onto other bodies to generate deepfake videos and images.
The reports provide clear, first-hand accounts from one of the primary victims (Kristen Bell) and cite specific statistics from a Deeptrace study regarding the prevalence of pornographic deepfakes targeting women. The details regarding how the technology was used and its psychological impact are explicit and unambiguous.
None. The reports clearly describe non-consensual deepfake pornography.
Technology
Facial Expression Animation
Deepfake tech animates a victim's face using another's expressions.
Advanced Deepfake Algorithms
AI tools enable highly realistic face-swapping onto explicit videos.
Data Inputs
Accessible Social Media Photos
Publicly shared photos are harvested to train deepfake models.
Human Factors
Lack of Consent
Creators generate explicit content without target's permission.
Intent to Humiliate
Deepfakes are used as a tool for the sexual humiliation of women.
Process and Methods
Delayed Platform Bans
Platforms banned deepfakes only after widespread publication and harm.
Ineffective Content Filtering
Hosting sites struggled to detect and block non-consensual deepfakes.
Regulatory Environment
Lack of Legal Protections
Absence of strict laws governing unauthorized digital face manipulation.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.