This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Multiple incidents in Northern Ireland involving the creation and circulation of non-consensual sexualised AI-generated images have been reported. These include the targeting of students at Royal School Armagh and a blackmail incident involving a member of a local GAA club. The reports highlight the misuse of AI tools, specifically mentioning Grok, to generate explicit content, prompting police investigations and political calls for legislative reform.
Police in Northern Ireland reportedly investigated allegations that explicit purportedly AI-generated images of girls attending Royal School Armagh were created and shared among pupils. The images allegedly targeted multiple students and circulated within the school community.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The incident involved the creation and circulation of explicit, sexually graphic content depicting minors within a school community.
The incident primarily involves the targeted creation of humiliating sexual imagery and blackmail of specific victims for personal advantage or harassment, which aligns with sub-domain 4.3.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was directly caused by the intentional actions of human users who prompted the AI system to generate explicit images of specific individuals for harassment and blackmail after the model was deployed.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
The incident involves the localized use of xAI's Grok to generate non-consensual explicit deepfakes of minors, politicians, and public figures in Northern Ireland. While causing severe psychological harm and raising regulatory concerns, the national security impact is minor and manageable through standard law enforcement and legislative channels.
The AI system, Grok, was used by pupils and other individuals as a tool to generate and alter images of real people to make them sexually explicit based on direct prompts.
Limited Risk: The incident involves AI-generated content such as deepfakes, which falls under Risk Level 3 due to transparency obligations requiring users to be informed that the content is AI-generated.
The AI system was used to generate and alter realistic images of real people to make them sexually explicit, which is the definition of deepfake image generation.
The reports provide clear details about the nature of the incidents, the specific AI tool involved (Grok), the targeted individuals (schoolgirls, politicians, presenters), and the resulting harms (blackmail, psychological distress, police investigations). The boundary rules clearly resolve potential overlaps between privacy, toxic content, and malicious actors.
None. The events clearly represent the malicious use of AI image generation for harassment and blackmail.
Technology
Unrestricted Image Alteration
AI tools like Grok allowed users to sexually alter photos of real people.
Lack of Technical Safeguards
AI models lacked initial technical limits to block explicit image generation.
Data Inputs
Use of Real Photos
Real photos of victims were inputted into AI tools to generate deepfakes.
Human Factors
Malicious User Intent
Pupils used AI to create and share non-consensual explicit images.
Online Anonymity
Users hid behind anonymity to generate and share explicit content.
Process and Methods
Inadequate Platform Moderation
Social platforms failed to effectively moderate AI-generated explicit content.
Easy Accessibility of AI Apps
Apps allowing creation of intimate images were easily accessible to minors.
Management
Delayed Safety Implementation
Platforms introduced technical limits only after widespread abuse occurred.
Prioritizing Features Over Safety
AI models were deployed with features that could easily be misused for abuse.
Regulatory Environment
Lagging Regional Legislation
Northern Ireland lacked laws criminalizing non-consensual adult deepfakes.
Inconsistent Regulatory Enforcement
Regulators faced challenges ensuring platforms complied with safety duties.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
