This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
ITV presenter Kate Garraway was the target of an online hoax involving AI-generated deepfake images that falsely depicted her in a relationship with a fictitious partner. These images and associated false headlines caused emotional distress for Garraway and her children, particularly due to fabricated claims regarding her son's reaction to the alleged relationship. The incident highlights the broader societal concern regarding the erosion of trust in media when AI can convincingly fabricate events.
ITV presenter Kate Garraway reported that purported AI-generated images falsely depicting her in a relationship with a fictitious partner circulated online, prompting false rumors about her personal life. Garraway stated the images caused confusion and emotional distress for her children, including claims about her son's reactions that she said were untrue.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The AI-generated deepfakes and associated headlines spread false information that misled the public and the victim's acquaintances.
The incident involves the targeted creation of AI-generated deepfakes of a specific individual to manipulate public belief and cause targeted distress and humiliation.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human actors intentionally creating and deploying AI-generated deepfake images as part of an online hoax.
Added categories peak at 2: Minor (Psychological Harm, Direct)
An online hoax utilizing AI-generated deepfake images of UK television presenter Kate Garraway caused localized emotional distress to her family. While illustrating the growing accessibility of synthetic media and its potential to erode public trust in information, the incident is a personal celebrity hoax with negligible national security implications.
The AI system was used as a tool to generate deepfake images of the presenter. The reports describe 'AI-created deepfake images' and 'artificial intelligence creating something that didn't exist' without indicating autonomous agency or planning.
Risk Level 3. Limited Risk: The incident involves AI-generated content, specifically deepfakes, which require transparency obligations under the EU AI Act.
The AI system was used to generate deepfake images of Kate Garraway with a fictitious partner.
The reports provide consistent, detailed accounts of the incident from the victim's perspective, including direct quotes and specific details about the impact on her family.
None
Technology
AI Deepfake Generation
AI tools allowed creation of realistic fake images of the presenter.
Algorithmic Recommendation
Recommendation algorithms automatically pushed fake headlines to users.
Data Inputs
Unverified Synthetic Media
AI-generated fake images and false narratives were used as input data.
Human Factors
Erosion of Public Trust
Inability of the public to easily distinguish real news from AI fakes.
Initial Naivety
Victim initially dismissed the fake images as harmless jokes.
Process and Methods
Automated Content Delivery
Platforms distributed unverified AI-generated news without human oversight.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
