This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Welsh teenager was the victim of a four-year catfishing campaign where another teenager used her photographs and AI-generated imagery to create fake social media profiles. The perpetrator accumulated over 100,000 followers and engaged in romantic conversations with strangers, causing the victim significant distress and safety concerns. The case concluded with a High Court settlement, including £10,000 in damages and an undertaking by the perpetrator to cease the conduct.
A Welsh teenager reportedly endured a nearly four-year online impersonation campaign in which another teenager created fake social media accounts using her photographs and, later, AI-generated images depicting her. The campaign reportedly attracted more than 100,000 followers, led strangers to believe they knew the victim, and resulted in a High Court settlement and damages award.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The victim was subjected to a sustained campaign of harassment and synthetic content generated to impersonate her, causing significant psychological distress.
The perpetrator used AI-generated imagery to impersonate the victim and manipulate others into believing they were in romantic relationships, causing targeted distress to the victim.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by a human perpetrator who intentionally used AI-generated imagery to catfish and impersonate the victim after the AI model was deployed.
Added categories peak at 2: Minor (Psychological Harm, Direct)
A localized personal catfishing and harassment campaign where a UK teenager used AI-generated imagery to impersonate another teenager over four years. While causing significant personal distress and civil rights violations, the incident carries negligible national security implications and was resolved through standard civil litigation.
The AI system was used by the perpetrator to generate synthetic imagery of the victim. It acted as a tool performing a specific function (image generation) based on direct inputs without independent planning or autonomy.
Risk Level 3: Limited Risk. The report describes the use of AI-generated imagery to create deepfakes and impersonate a real person, which falls under the category of AI-generated content requiring transparency.
The perpetrator used AI to generate synthetic images of the victim to support a fake online persona, which constitutes deepfake image generation.
The reports provide clear and consistent details about the catfishing campaign, the legal proceedings, the impact on the victim, and the specific role of AI-generated imagery. There is little ambiguity regarding the events or the parties involved.
None
Technology
AI Image Generation
AI was used to generate realistic fake images of Sasha without her consent.
Platform Identity Anonymity
Social media platforms allowed easy creation of anonymous fake profiles.
Data Inputs
Unauthorized Photo Access
Sasha's public social media pictures were stolen to seed the fake profiles.
Lack of Image Verification
Platforms did not verify if uploaded images belonged to the account creator.
Human Factors
Malicious Impersonation Intent
The perpetrator intentionally targeted the victim to run a catfish campaign.
User Deception
Followers believed the fake persona was real due to convincing AI images.
Process and Methods
Inadequate Content Moderation
Platforms failed to remove fake profiles despite repeated reports by victim.
Inadequate Police Investigation
Police treated online anonymity as an insurmountable barrier to action.
Management
Failure to Protect Users
Platform management failed to prioritize safety and identity protection.
Inadequate Incident Response
Platforms only acted after public media exposure on the BBC.
Regulatory Environment
No Specific Catfishing Laws
The lack of specific catfishing laws hindered direct criminal prosecution.
Weak Platform Regulation
Lack of regulatory pressure allowed platforms to ignore fake account reports.
