This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A man in Brazil was arrested after using AI software to create a fake photograph of himself holding a pistol. He sent this image to his former partner via WhatsApp to intimidate her and her father. Police searches confirmed no real firearm existed, and the suspect confessed to using AI to simulate the weapon for the purpose of domestic intimidation.
A man allegedly used an AI-altered photograph of himself holding a pistol to threaten his former partner and her father in Santa Helena de Goiás, Brazil. Police reportedly arrested him in nearby Rio Verde after the woman sought help. He reportedly said he used AI to simulate a weapon; a local report said police had not confirmed his explanation. Searches reportedly found no firearm.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The victim was directly exposed to abusive, threatening, and unsafe synthetic content depicting a weapon.
The suspect used AI to generate a fake image of himself holding a gun to manipulate the victim's beliefs (making her believe he was armed) and intimidate her, representing targeted coercion.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by a human user who intentionally used a deployed AI image generation tool to create a threatening fake photo for domestic intimidation.
Added categories peak at 2: Minor (Psychological Harm, Direct)
A localized domestic violence incident in Brazil where an individual used AI image generation to fake a photo of himself with a gun to threaten his ex-partner. The incident has negligible national security implications and was resolved entirely by local law enforcement.
The AI system was used as a tool to perform a specific, well-defined function (generating/manipulating an image of a gun) based on direct user input, without exhibiting autonomous decision-making or planning.
Limited Risk: The system used was an AI image generator capable of creating synthetic content (deepfakes/manipulated images), which falls under transparency obligations for AI-generated content.
The suspect used AI software to generate a fake photograph of himself holding a pistol to simulate being armed.
The report clearly details the incident, the suspect's confession, the method of using AI to generate the fake gun, and the police response. There is little ambiguity regarding the events or the role of the AI.
None
Technology
Unrestricted Weapon Synthesis
AI tools generated a realistic firearm without safety guardrails.
Lack of Image Provenance
Generated threat image lacked metadata or watermarks to signal AI origin.
Data Inputs
Integration of Real Photos
AI accepted real personal photos to overlay synthesized weapons seamlessly.
Human Factors
Intentional Malicious Use
Perpetrator weaponized AI-generated content to terrorize ex-partner.
Process and Methods
Exploitation of View-Once Media
Using temporary WhatsApp messages to hide the AI threat from authorities.
Management
Deficient AI Policy Enforcement
AI developer failed to monitor and block abusive prompt patterns.
Regulatory Environment
Inadequate AI Threat Regulation
Lack of strict legal frameworks governing AI-facilitated domestic abuse.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
