In October 2023, it was discovered that male students at Westfield High School in New Jersey had used AI-powered tools, specifically the Clothoff app, to create and circulate non-consensual pornographic images of their female classmates. The incident caused widespread distress among the student body, leading to police investigations and national advocacy by victims and their families for stronger legal protections against AI-generated sexual abuse material. Despite the school's investigation, many victims and parents expressed frustration over the lack of accountability and the perceived inadequacy of existing laws to address this form of digital exploitation.
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The creation and sharing of explicit pornographic images of minors constitutes exposure to toxic and illegal content.
The reports highlight a significant gap in legal frameworks and regulatory oversight to address and penalize AI-generated non-consensual pornography.
The incident involved the creation of humiliating and sexual deepfake imagery targeting specific high school girls, which fits the definition of targeted harassment and exploitation under sub-domain 4.3.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was initiated by the intentional actions of human students who chose to use a deployed AI tool to generate non-consensual explicit images of their classmates.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
This incident involved male high school students using a consumer AI tool (ClothOff) to generate non-consensual explicit deepfakes of female classmates. While causing severe local psychological harm and highlighting regulatory gaps in AI-generated child sexual abuse material, the national security impact is minor and manageable within standard domestic legal frameworks.
The AI system operated as a Tool, performing the specific function of generating deepfake images based on direct user inputs (photos) without independent planning or autonomous decision-making.
Limited Risk: The reports describe the use of generative AI to create 'deepfakes', which falls under the category of AI-generated content requiring transparency obligations under the EU AI Act.
The primary function of the ClothOff app used in this incident is to generate deepfake nude images by manipulating uploaded photos of individuals.
The reports are highly consistent across multiple reputable news outlets (WSJ, CNN, CBS, etc.), providing clear details on the nature of the AI tool, the victims, the school's response, and the ongoing legal and police investigations. There is no major conflicting information regarding the core events.
None. The incident is clearly a case of non-consensual deepfake pornography creation targeting minors.
Technology
Easy Access to AI Tools
Free or cheap AI tools allow anyone to generate deepfakes using an iPhone.
Lack of Technical Guardrails
Open-source face-swapping and clothes-removing tools lack moderation filters.
Highly Realistic Generation
AI makes fakes nearly impossible to distinguish from real photographs.
Data Inputs
Publicly Available Photos
Targeted girls' photos were easily sourced from their public social media.
Single-Photo Requirements
Modern AI requires only a single photo to generate highly realistic deepfakes.
Human Factors
Lack of Student Ethical Boundaries
Male classmates used AI to violate peer privacy, viewing it as a joke.
Digital Bullying Behavior
Sophomore boys targeted female peers, leading to emotional trauma.
Process and Methods
Unrestricted Device Access
Students can access harmful AI tools anywhere and anytime on personal devices.
Inadequate School AI Guidelines
School lacked clear guidelines and preventative safeguards on AI technology.
Management
Delayed Incident Discovery
Incident occurred over summer but was only discovered by school in October.
Perceived Inadequate Discipline
Parents felt school's response and short suspension was too lenient.
Lack of Administrative Transparency
School cited confidentiality, leaving parents frustrated and uninformed.
Regulatory Environment
Lagging Federal and State Laws
No federal or New Jersey laws banned the creation of deepfake pornography.
Lack of Legal Clarity
Law enforcement struggled due to unclear legality of faked underage images.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.