This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A youngster used AI to generate a fake image of Orlando West High School in Soweto on fire, sparking community panic and forcing emergency services to waste resources investigating the hoax.
A purportedly AI-generated image reportedly depicting Orlando West High School of Soweto, South Africa, on fire circulated and was allegedly shared with emergency services. Johannesburg EMS reportedly investigated and visited the school, confirming that no fire had occurred. Officials said the false report caused public alarm and diverted emergency resources.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The youngster used the AI-generated image to conduct a targeted hoax/prank, manipulating emergency services into believing a real emergency was occurring.
The incident involved the creation and dissemination of a fabricated AI-generated image of a school on fire, which misled emergency services and the public.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human youngster who intentionally generated and shared a fake image of a school on fire as a prank after the AI model had been deployed.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
An individual used generative AI to create a fake image of a school on fire in Soweto, South Africa, causing localized community panic and diverting emergency services. The incident constitutes a minor national security concern, highlighting the potential for AI-generated hoaxes to temporarily disrupt local public safety resources.
The AI system functioned as a Tool, generating a synthetic image of a school on fire based on direct user prompts without independent planning or autonomous decision-making.
Risk Level 3: Limited Risk. The system generated synthetic media (a deepfake image of a school on fire), which falls under transparency obligations for AI-generated content.
The AI was used to generate a highly realistic but fabricated image of a school on fire to deceive others.
The reports clearly describe the incident, the nature of the AI-generated image, the entity responsible (a youngster), and the consequences (EMS investigation, wasted resources, community panic). There is little ambiguity about what transpired.
None
Technology
AI Image Generation
AI tools enabled the creation of a highly realistic fake fire image.
Human Factors
Irresponsible Pranking
A youngster deliberately shared the fake image to deceive emergency services.
Process and Methods
Manual Verification Process
EMS had to physically dispatch and investigate to verify the fire.
Regulatory Environment
Insufficient Legal Consequences
Weak legal deterrents failed to prevent sharing AI-generated fake emergencies.
