This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
An unauthorized TikTok account impersonated Grainville School in Jersey by using its branding to post five AI-generated deepfake videos featuring staff members. The incident prompted an investigation by the States of Jersey Police and the content was reported to TikTok, leading to the account's removal. Local officials have urged the public not to engage with the material to prevent further harm.
A TikTok account allegedly using the badge and branding of Grainville School in Jersey (Channel Islands) reportedly uploaded five "deeply inappropriate," purportedly AI-generated deepfake videos, including material featuring staff. The Education and Lifelong Learning Minister said the incident was reported to TikTok and the States of Jersey Police and urged the public not to view or share the content. The account was reportedly later removed.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deeply inappropriate deepfake videos were uploaded to TikTok, exposing the public and school community to harmful and inappropriate synthetic content.
The incident involved the creation of deeply inappropriate deepfake videos targeting and impersonating specific school staff members, which represents targeted humiliation of specific victims.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human actor who intentionally used a deployed AI deepfake generation tool to target and impersonate school staff.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
An unauthorized social media account used AI deepfakes to impersonate Jersey school staff and school branding. While causing local distress and requiring police and platform intervention, the incident represents a localized harassment case with negligible national security implications.
The AI system used was a deepfake generation tool, which performs a specific, well-defined function (generating synthetic media based on direct inputs) without autonomous planning or context retention.
Limited Risk: The report describes the creation of 'deepfakes', which are explicitly categorized as posing a moderate risk requiring transparency obligations under the EU AI Act.
The AI was used to generate deepfake videos of school staff which were then posted on TikTok.
The report clearly details the incident where a TikTok account posted deepfakes of school staff using the school's branding. The facts are straightforward, and the application of the boundary rules makes the classification highly confident.
The incident could be interpreted as a privacy violation, but boundary rule B1 clarifies that using public likeness for targeted humiliation is classified under 4.3 rather than 2.1.
Technology
AI Deepfake Generation
AI tools allowed creation of realistic fake videos of school staff.
Platform Hosting Capabilities
TikTok hosted and distributed deepfakes targeting school staff.
Data Inputs
School Badge and Branding
School branding was used in videos to falsely imply official source.
Staff Likeness Data
Staff images or audio were used to generate deepfake videos.
Human Factors
Malicious Creator Action
An individual chose to target school staff with harmful deepfakes.
Public Engagement with Material
People watching and sharing the deepfakes increased their reach.
Process and Methods
Reactive Content Removal
Platform relied on reports to remove content rather than proactive blocks.
Management
Inadequate Proactive Monitoring
School and authorities monitored reactively after the videos appeared.
Regulatory Environment
Weak Impersonation Laws
Lack of preventive legal barriers against AI-based impersonation.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
