This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A 36-minute AI-generated deepfake video impersonating Pope Francis was circulated on YouTube, falsely depicting him addressing the leader of Burkina Faso. The Vatican officially debunked the video, confirming it was entirely fabricated. The incident highlights the increasing sophistication of AI lip-sync technology and the challenges it poses to public trust and information verification.
A purported 36-minute AI-generated deepfake video circulated online portraying Pope Leo XIV delivering a speech to Burkina Faso's President Ibrahim Traoré. The Vatican Press Office and Catholic broadcaster Patrick Madrid publicly confirmed the video was fabricated.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The video generated false information about the Pope's statements, contributing to the spread of deceptive content.
The incident involved the intentional creation and dissemination of a high-quality deepfake of a major global religious leader addressing a political leader, aiming to influence public opinion and political processes at scale.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human actors intentionally using deployed AI lip-sync and deepfake tools to fabricate a video of Pope Francis.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
An AI-generated deepfake video of Pope Francis addressing Burkina Faso's leader was circulated and quickly debunked. While representing an evolved capability in long-form synthetic media, the national security impact remains minor as it did not disrupt government functions or cause physical harm.
The AI system was used as a tool by human creators to perform a specific, well-defined function of lip-syncing and voice cloning to generate the deepfake video.
Limited Risk: The report describes an AI-generated deepfake video. Under the EU AI Act, deepfakes and AI-generated content are classified as limited risk, requiring transparency obligations to inform users that the content is artificially generated.
The AI system was used to generate a deepfake video of Pope Francis with lip-syncing and voice cloning.
The report clearly describes the nature of the incident (a deepfake video of Pope Francis on YouTube), the technology used (AI lip-sync), and the response (Vatican debunking). There is little ambiguity about what transpired.
None
Technology
AI Lip-Sync Technology
Advanced AI lip-sync tools allowed highly convincing facial manipulation.
Voice Cloning Tools
Sophisticated AI voice cloning replicated the Pope's voice accurately.
Data Inputs
Abundant Source Media
Plentiful public video and audio of the Pope were used to train the AI.
Human Factors
Viewer Credulity
Users trusted the video due to its realistic appearance and serious tone.
Lack of Digital Literacy
Viewers struggled to identify sophisticated synthetic media markers.
Process and Methods
Inadequate Platform Moderation
YouTube failed to proactively detect and flag the synthetic deepfake video.
Easy Distribution Channels
Public sharing platforms allowed rapid dissemination of unverified content.
Management
Inadequate Content Verification
Platform management did not enforce robust verification for public figures.
Regulatory Environment
Lack of Deepfake Regulations
Absence of strict policies or laws governing synthetic media distribution.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
