This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
An investigation by Full Fact revealed that hundreds of AI-generated deepfake videos were circulating on TikTok, X, Facebook, and YouTube, impersonating prominent UK health experts. These videos used manipulated footage and cloned voices to falsely endorse supplements from a company called Wellness Nest, while spreading medical misinformation regarding menopause. The incident highlights the challenges of platform moderation and the misuse of AI to exploit the credibility of medical professionals for commercial gain.
In the UK, purported deepfake videos reportedly impersonated Professor David Taylor-Robinson and other health experts on TikTok and other platforms to promote supplements linked to Wellness Nest. The videos allegedly altered real footage and cloned voices to spread misleading medical claims about menopause, misuse identifiable individuals' likenesses, and expose viewers seeking health advice to health misinformation and deceptive marketing.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfake videos generated and spread false medical claims, such as the fabricated 'thermometer leg' symptom, polluting the health information ecosystem.
The incident involves the targeted exploitation of specific victims (the doctors) and consumers using synthetic media (voice clones and deepfakes) to conduct a commercial scam for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was driven by malicious human actors who intentionally used deployed AI deepfake tools to create deceptive videos for financial gain.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A commercial scam utilizing AI-generated deepfakes of UK medical experts to promote health supplements. While it highlights the growing ease of generating highly realistic synthetic media and the challenges of social media platform moderation, it constitutes a consumer fraud and public health misinformation issue with negligible direct national security implications.
The AI system was used as a tool by malicious actors to generate synthetic media (deepfake videos and cloned voices) from existing public footage, operating on direct inputs to produce specific outputs without autonomous goal-directed planning.
Limited Risk: The incident involves AI-generated deepfakes, which are classified under the EU AI Act as posing a moderate risk that requires specific transparency obligations to ensure users are informed.
The primary function of the AI system was to generate highly realistic deepfake videos of doctors, which also required cloning their voices to deliver fabricated endorsements.
The reports from Full Fact and The Guardian provide highly detailed, credible, and consistent accounts of the deepfake campaign, naming specific platforms, victims, and the nature of the manipulated content.
The incident could be viewed primarily as a standard advertising fraud case, but the central role of sophisticated AI voice and video cloning makes it a clear AI safety incident.
While the specific AI models used are not named, this information is not strictly necessary to classify the incident's risk domain or causal factors.
Technology
Sophisticated AI Deepfake Tools
AI tools allowed realistic voice cloning and video manipulation of doctors.
Inadequate Automated Detection
Platforms struggle with automated detection of sophisticated deepfake videos.
Data Inputs
Unprotected Public Footages
Publicly available conference and hearing videos were used to train/clone AI.
Human Factors
Exploitation of Medical Trust
Viewers trust medical professionals, making them vulnerable to fake advice.
Process and Methods
Slow Content Removal Process
Platforms took weeks to take down reported deepfakes, allowing them to spread.
Inconsistent Moderation Decisions
Initial moderation reviews falsely cleared some deepfakes as compliant.
Management
Unmonitored Affiliate Networks
Wellness Nest failed to monitor global affiliates generating deepfake ads.
Regulatory Environment
Lack of Digital Impersonation Laws
No clear legal framework to prosecute digital medical impersonators.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
