This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In June 2025, Swedish police issued a warning regarding a scam campaign where fraudsters used AI-generated deepfake videos of prominent doctors to promote fake health products on social media. Victims were directed to fraudulent websites where they were tricked into providing credit card information, resulting in unauthorized charges and theft of financial data. The campaign, which began in late May 2025, has led to multiple police reports from both the impersonated physicians and defrauded consumers.
A June 2025 Swedish police warning reported that fraudsters used purportedly AI-generated deepfake videos of well-known doctors, including Anders Tegnell and Agnes Wold, in social media ads promoting fake health products. Victims were allegedly lured to fraudulent sites where card details were stolen and large unauthorized charges were made. The scams, which reportedly began in late May 2025, prompted multiple complaints from both impersonated physicians and defrauded consumers.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfake videos spread false medical advice, such as encouraging patients to stop taking blood pressure and heart failure medications.
Fraudsters used AI-generated deepfakes of well-known doctors to deceive individuals into purchasing fake health products and stealing their credit card information for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human fraudsters intentionally deploying AI deepfake generation tools to create deceptive videos for financial gain.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
Fraudsters in Sweden used AI-generated deepfakes of prominent medical figures, including a former state epidemiologist, to run social media scams promoting fake health products and stealing credit card details. While the incident highlights the growing threat of synthetic media in cybercrime, its direct national security impact is minor, representing localized financial fraud rather than a coordinated state-sponsored attack.
The AI system was used as a tool to generate synthetic video and voice content mimicking real doctors. The report notes that 'with the help of AI, it is possible to mimic both people's appearance visually and their voices in a convincing way'.
Limited Risk: The system involves AI-generated content such as deepfakes. According to the definitions, 'AI-generated content such as deepfakes' falls under Limited Risk (Level 3) requiring transparency obligations.
The AI was used to generate realistic videos and voices of Swedish doctors to deceive social media users.
The reports from the Swedish police and Dagens Nyheter provide clear, consistent details about the scam mechanism, the specific individuals impersonated, the nature of the fake medical advice, and the financial harm caused. There is little ambiguity regarding the role of AI deepfakes in this incident.
None. The incident is clearly a financially motivated cyber-enabled fraud campaign using synthetic media.
Technology
Convincing AI Video Synthesis
AI tools allowed scammers to clone doctors' visual appearance realistically.
Convincing AI Voice Cloning
Scammers used AI to clone the familiar voices of trusted public figures.
Data Inputs
Public Media of Targets
Abundant public videos of doctors provided training data for AI cloning.
Human Factors
Public Trust in Known Doctors
Victims trusted the AI-generated recommendations due to familiar faces.
Lack of Digital Literacy
Victims, especially elderly, struggled to identify AI deepfakes.
Process and Methods
Flawed Ad Screening on Platforms
Social media platforms failed to detect and block AI-generated scam ads.
Management
Poor Platform Moderation Policy
Social media companies prioritized ad revenue over rigorous safety screening.
Regulatory Environment
Jurisdiction Limitations
Police closed cases because crimes were committed outside Swedish jurisdiction.
Lack of Deepfake Regulation
Insufficient legal frameworks to prevent malicious deployment of deepfakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
