Students at Colegio Alicante del Sol in Chile used AI to create and distribute non-consensual sexual deepfakes of their female classmates, leading to panic attacks, school protests, and physical altercations.
Students at Colegio Alicante del Sol, a school in Puente Alto, Chile, allegedly used AI tools to turn female classmates' Instagram photos into fake nude images and circulated them among other students. Families reported panic attacks among affected girls. The school suspended implicated students, and Chile's education oversight authority opened an investigation into its response.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The creation and distribution of sexually explicit deepfakes of minors exposed the school community to highly inappropriate and toxic content.
The incident involved the targeted creation and distribution of humiliating sexual imagery (deepfakes) of specific victims for personal amusement or harassment, which directly aligns with sub-domain 4.3.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by the intentional actions of students who used a deployed AI tool to generate and distribute non-consensual sexual deepfakes of their classmates.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
Students at a Chilean school used AI tools to generate non-consensual sexual deepfakes of classmates, causing severe psychological distress, local protests, and minor school altercations. While the incident represents a serious violation of privacy and human rights for the minors involved, its national security impact is minor and restricted to localized societal disruption manageable by local authorities.
The AI system was used as a tool by the students to perform a specific, well-defined function: manipulating existing Instagram photos to generate fake nude images.
Limited Risk: The incident involves the creation of AI-generated content (deepfakes), which falls under Risk Level 3 due to transparency and disclosure obligations.
The AI system was used specifically to generate fake nude images (deepfakes) of the students by manipulating their real photos.
The reports provide consistent, detailed accounts of the incident, including the timeline, the school involved, the reactions of the victims and families, and the subsequent school protests and police intervention. The role of AI in generating the deepfakes is clearly stated.
None
Technology
AI Image Manipulation Tools
Easy access to AI tools allowed creation of realistic fake nudes.
Digital Distribution Platforms
Digital platforms facilitated rapid sharing of the generated material.
Data Inputs
Public Social Media Photos
Students downloaded public Instagram photos to use as inputs for AI.
Human Factors
Lack of Student Ethical Awareness
Students used AI to harm peers without considering consequences.
Victim Blaming and Mockery
Returned students mocked victims, escalating emotional distress.
Process and Methods
Inadequate School Response
School failed to provide proper communication and support to victims.
Flawed Disciplinary Measures
A short suspension followed by return to school escalated conflicts.
Management
Inadequate Risk Assessment
School management failed to anticipate escalation upon students return.
Poor Communication with Families
Families were not informed timely about the incident details.
Regulatory Environment
Lack of AI Content Regulations
Absence of clear laws governing non-consensual AI-generated imagery.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.