This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A 77-year-old retired lecturer was defrauded of £17,000 by scammers who used AI-generated deepfake videos and fake documents to impersonate a romantic partner. The victim, who was lonely, was convinced by the realistic nature of the AI-generated content to send money via gift cards, bank transfers, and PayPal. The scam was eventually uncovered when the victim's bank flagged fraudulent activity, and the case is currently under investigation by Police Scotland.
A scammer, or scammers, reportedly used AI-generated deepfake videos and documents to impersonate a fictitious person named "Alla Morgan," allegedly convincing a 77-year-old woman, Nikki MacLeod, to send £17,000 through various payment methods. The deepfakes were allegedly used in establishing credibility so as to enable fraud under the pretense of an online romantic relationship.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident is a targeted romance scam where scammers used AI-generated deepfakes to exploit a specific victim for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by human scammers who intentionally deployed and used AI deepfake technology to deceive and defraud the victim.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
A localized financial fraud incident where scammers used AI-generated deepfakes to conduct a romance scam against a UK citizen, resulting in a loss of 17,000 pounds. The incident constitutes cybercrime with negligible national security implications, as it did not target critical infrastructure, government functions, or state stability.
The AI technology (face swap apps, filters, or deepfake generators) was used as a tool by human scammers to generate synthetic video messages. The AI performed the specific function of manipulating video frames based on direct inputs without autonomous decision-making or planning.
Risk Level 3: Limited Risk. The incident involves the creation and use of AI-generated content (deepfakes), which falls under Limited Risk and requires transparency obligations under the EU AI Act.
The scammers used AI tools specifically to generate realistic deepfake videos and manipulated voices of a fictional persona to deceive the victim.
The reports provide consistent, detailed accounts of the romance scam, the victim's background, the amount of money lost, and the specific role of AI-generated deepfake videos in reassuring the victim. Multiple news sources corroborate the core facts of the incident.
None. The incident is clearly a romance scam facilitated by deepfake technology.
Technology
Accessible Deepfake Tools
Scammers easily created realistic videos using face swap apps and filters.
Realistic AI Video Generation
AI-generated videos of the persona on an oil rig bypassed initial skepticism.
Data Inputs
Misused Identity Photos
Scammers used photos of real people to generate deepfakes without consent.
Lack of Image Verification
Reverse image scanning failed to identify the source of the generated images.
Human Factors
Emotional Vulnerability
Victim felt lonely after lockdown and a breakup, making her more trusting.
Overreliance on Video Proof
Victim assumed video messages were absolute proof of the person's identity.
Lack of Deepfake Awareness
Victim was unaware of deepfakes and how easily AI can fake video and audio.
Process and Methods
Inadequate Video Verification
Lack of live video calls allowed recorded deepfakes to substitute for proof.
Irreversible Payment Methods
Use of Steam cards and PayPal friends and family bypassed protections.
Management
Platform Safety Gaps
Social media platforms failed to detect or block scam accounts using AI.
Lack of Payment Portal Alerts
Payment platforms did not sufficiently warn users about romance scam patterns.
Regulatory Environment
Lack of Deepfake Regulations
Absence of strict laws targeting the creation and use of non-consensual AI.
Limited AI Generation Oversight
No regulatory standards for watermarking or tracking AI-generated media.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
