The Richland School District in Pennsylvania launched an investigation after discovering that secondary students used AI to generate and distribute obscene images of other students. The incident, reported on November 14, 2024, prompted the involvement of local law enforcement and child protective services. The school district is pursuing the matter legally while maintaining student privacy.
The Richland School District (Cambria County, Pennsylvania) released a statement on November 19, 2024 announcing an investigation into "some secondary students" who are alleged to have used AI to "create and electronically distribute obscene images of Richland students." The school administrators became aware of the incident on November 14, 2024.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The creation and distribution of obscene images exposed students to harmful and inappropriate content.
Students used AI to generate and distribute obscene, humiliating sexual imagery of specific peers, which fits the targeted creation of humiliating or sexual imagery under 4.3.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by students intentionally using a deployed AI system to generate and distribute obscene images of their peers.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
Secondary students in Pennsylvania used generative AI to create and distribute non-consensual obscene images of peers. While causing localized harm and prompting law enforcement and child protective services involvement, the incident carries negligible direct implications for national security.
The report describes students using AI to generate specific images based on direct inputs, which fits the definition of a tool performing a well-defined function without autonomous planning.
Limited Risk: The incident involves the creation of AI-generated content (deepfakes/obscene synthetic images), which falls under Risk Level 3 due to transparency and manipulation concerns.
The students used AI to generate obscene, synthetic images of real students, which constitutes deepfake image generation.
The report clearly outlines the event, the actors (students), and the immediate administrative and legal response. However, it lacks technical details about the specific AI tool used, how it was accessed, and the exact number of victims, requiring some inference.
The incident could be classified primarily under 1.2 (Exposure to toxic content), but boundary rule B1 directs targeted humiliation to 4.3.
The specific AI software/platform used, the number of victims, and the exact nature of the images.
Technology
Lack of AI Generation Safeguards
AI systems lacked filters to prevent generating obscene images of minors.
Digital Distribution Platforms
Electronic channels facilitated the rapid spread of generated images.
Data Inputs
Unauthorized Use of Target Photos
AI tools accepted photos of students without consent to generate deepfakes.
Human Factors
Student Misuse of AI Tools
Students exercised poor judgment by using AI to harm classmates.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.