New South Wales police are investigating reports that non-consensual, AI-generated sexually explicit images of female high school students were created and circulated online. The incident has prompted a criminal investigation and highlights a growing trend of deepfake-based abuse in Australian schools. Government officials and the eSafety Commissioner are responding with new legislation and digital literacy initiatives to combat the use of 'nudify' apps and similar AI tools.
New South Wales police in Australia launched an investigation after parents reported that purported AI-generated sexually explicit images of female students from a Sydney high school had been created and circulated online. The reported manipulated images, produced without consent using deepfake tools, prompted school involvement and a criminal probe under new state laws banning such content.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The incident involved the creation and online circulation of sexually explicit, non-consensual synthetic content of minors.
The incident involves the targeted creation and circulation of sexually explicit deepfakes to humiliate and degrade specific female high school students.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by human actors intentionally using deployed AI 'nudify' tools to generate and circulate explicit deepfakes of classmates.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
An investigation into AI-generated explicit deepfakes of high school students in Australia highlights an evolving societal challenge regarding synthetic media abuse. While causing severe distress to victims and prompting legislative action, the incident remains a localized criminal and educational issue with minor direct national security implications.
The AI systems are described as 'nudify' or 'undressing' apps where users harvest images of someone else to generate a deepfake. This operates as a simple tool executing a specific function based on direct user input.
Limited Risk: The report describes 'AI-generated content such as deepfakes' created by 'nudify' apps, which fall under transparency and disclosure obligations for synthetic media under the EU AI Act.
The primary function of the AI tools used in this incident was to generate deepfake images by digitally altering photos of students to make them appear explicit.
The reports provide clear, consistent, and detailed accounts of the police investigation, the emotional impact on students, and the regulatory response from the eSafety Commissioner. The facts of the deepfake creation and distribution are well-established.
None. The incident is clearly a case of image-based abuse using generative AI.
Technology
Availability of Nudify Apps
AI apps allow easy generation of non-consensual explicit images.
Hyper-realistic Generative AI
Advanced generative tools make deepfake media highly convincing.
Data Inputs
Harvesting of Social Media Images
Publicly available photos were harvested to feed deepfake models.
Human Factors
Lack of Student Digital Literacy
Students lack understanding of ethical AI use and online safety.
Malicious Intent by Students
Individuals deliberately used AI tools to harass and degrade peers.
Process and Methods
Delayed Content Removal
Platforms lacked rapid mechanisms to take down deepfake content.
Inadequate School Guidelines
Schools lacked clear procedures for managing AI image-based abuse.
Management
Insufficient Platform Moderation
AI developers failed to block generation of explicit content.
Weak Risk Assessments by Tech Firms
Companies deployed powerful AI without assessing risks to minors.
Regulatory Environment
Lagging Legal Frameworks
Laws only recently evolved to criminalize deepfake image creation.
Lack of App Store Restrictions
Nudifying services remained easily downloadable by minors.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.