This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Scammers created a fake Facebook profile impersonating Teigan McMahon, who was raising funds for her father in a coma. The fake account used photos and purportedly AI-generated content to solicit donations, forcing the family to pause their legitimate GoFundMe campaign. The incident highlights the ongoing issue of fraudsters exploiting real-life tragedies through social media impersonation.
Scammers allegedly created a fake Facebook profile impersonating a Scottish woman, Teigan McMahon, raising funds for her father, who was reportedly in a coma in Turkey. The account reportedly reused her photos and posts and was described as using purportedly AI-generated or deepfake-style content to solicit donations. The impersonation forced the family to pause their legitimate fundraiser while the fake profile remained online.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves fraudsters using impersonation and deep-fake technology to target specific victims and scam them for personal financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human fraudsters who intentionally created a fake social media profile using deployed AI technologies to scam donors.
Added categories peak at 2: Minor (Psychological Harm, Direct)
Fraudsters created a fake Facebook profile impersonating a UK citizen to scam donors raising money for a family medical emergency. The incident is a localized financial fraud attempt with negligible national security implications, representing an established cybercrime threat rather than a national security crisis.
The report mentions 'deep-fake scammers' but does not provide any details about the specific AI system, its developer, or its operational behavior.
Limited Risk: The incident involves 'deep-fakes' (AI-generated content), which under the EU AI Act are subject to transparency obligations to inform users they are interacting with AI-generated media.
The report mentions 'deep-fake scammers' and a fake Facebook profile, suggesting the AI's primary goal was generating social media content or deepfake media to impersonate the victim, though specific technical details are absent.
The report clearly details the real-world impact of the scam on the family and their GoFundMe campaign. However, details about the AI technology used (referred to generally as 'deep-fake') are extremely sparse, making it difficult to identify the specific AI system or verify if AI was actually used or if it was a simple manual impersonation.
The incident could be interpreted as a non-AI social engineering scam if the 'deep-fake' label was misapplied to simple profile cloning.
Technical details of the AI system used, confirmation of whether synthetic media (deepfakes) was actually generated, and the specific platform used to create the content.
Technology
Facilitation of Deepfakes
AI tools enable scammers to easily create convincing fake media.
Weak Identity Verification
Social media platforms lack robust automated identity verification.
Inadequate Fake Account Detection
Algorithms fail to automatically flag and remove impersonator accounts.
Data Inputs
Unprotected Personal Photos
Publicly accessible photos are harvested to fuel impersonation scams.
Lack of Media Provenance
No metadata to verify the authenticity of uploaded images.
Human Factors
Overreliance on Profiles
Users trust social media profiles without verifying actual identity.
Scammer Exploitation of Empathy
Scammers exploit human emotions and empathy during family tragedies.
Difficulty Spotting Deepfakes
Public struggles to differentiate between real and AI-manipulated media.
Process and Methods
Slow Takedown Processes
Reporting mechanisms are slow to remove flagged impersonator profiles.
Inadequate Content Moderation
Platform moderation processes fail to proactively stop scam setups.
Management
Prioritizing Growth Over Security
Platforms prioritize user growth over robust safety and moderation.
Inadequate Risk Assessment
Failure to assess risk of AI-enabled impersonation on platforms.
Regulatory Environment
Lack of Deepfake Regulation
Absence of strict legal frameworks governing AI-generated impersonation.
Weak Platform Liability Laws
Platforms face minimal legal penalties for hosting fraudulent accounts.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
