This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A high school student in Campbelltown, New South Wales, is under police investigation for allegedly using AI platforms to generate and distribute explicit deepfake images of female classmates. The incident has prompted involvement from the eSafety Commissioner and the Department of Education, with school leadership providing wellbeing support to the affected students. The case highlights the misuse of AI tools for non-consensual sexual content creation among minors.
A Sydney high school student allegedly used AI platforms to create explicit deepfake images of female classmates, which were then distributed through fake social media accounts. The incident reportedly caused significant distress among the victims, leading to an investigation by Campbelltown city police area command and involvement from the eSafety Commissioner.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The generated explicit deepfakes constitute toxic and sexually explicit content distributed online.
The student used AI to generate explicit deepfakes of classmates for targeted humiliation and harassment, which falls under targeted manipulation and creation of humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human student intentionally using deployed AI platforms to generate and distribute explicit deepfake images of classmates.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
A localized incident involving a high school student in Australia using generative AI to create non-consensual explicit images of classmates. While presenting serious local law enforcement, privacy, and child protection concerns, the incident has negligible direct national security implications.
The report states the student used 'artificial intelligence platforms to create pornography', operating them as tools to generate specific synthetic images based on inputs.
Limited Risk: The incident involves 'AI-generated content such as deepfakes', which falls under Risk Level 3 (Limited Risk) requiring transparency obligations.
The student explicitly used AI platforms to generate deepfake images of classmates.
The report clearly outlines the nature of the incident, the actors involved, and the harm caused. While the specific AI platform is not named, the classification of the risk and behavior is straightforward based on the detailed description of deepfake creation and distribution.
None
Technology
AI Deepfake Platforms
AI platforms were used to generate explicit pornography of students.
Data Inputs
Target Student Images
Photos of female students were used as inputs for the AI tool.
Human Factors
Student Misconduct
The student chose to create and distribute harmful non-consensual images.
Process and Methods
Fake Social Media Distribution
Fake social media accounts were used to circulate the deepfake images.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
