This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In July 2024, a deepfake audio clip circulated online featuring a manipulated voice of Philippine President Ferdinand Marcos Jr. ordering military action against China. The Presidential Communications Office debunked the content as entirely fake, noting it was designed to sow confusion and influence public opinion amid ongoing maritime disputes. The incident highlights the growing use of AI-generated synthetic media in political disinformation campaigns and its potential to impact national security and regional stability.
A purported deepfake audio clip portraying Philippine President Ferdinand Marcos Jr. ordering an attack on China spread online in July 2024, fueling tensions in the West Philippine Sea. The Presidential Communications Office reportedly debunked it as fake, attributing it to foreign actors.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The AI system was used to generate false and misleading information regarding a presidential military directive.
The deepfake was deployed as part of a coordinated effort to influence public opinion and national foreign policy on a geopolitical scale.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by malicious human actors who intentionally created and distributed the deepfake audio to manipulate public opinion.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A malicious actor deployed a deepfake audio clip of Philippine President Marcos Jr. ordering military action against China during a period of high maritime tension. While quickly debunked, the incident demonstrates a substantial threat to information security and sovereignty by using generative AI to fabricate national security directives and manipulate public opinion.
The AI system functioned as a generative tool used by human actors to synthesize the President's voice based on input data, without exhibiting autonomous planning or decision-making capabilities.
Limited Risk: The incident involves an 'audio deepfake' which falls under Risk Level 3 as it is an AI-generated deepfake requiring transparency and labeling obligations under the EU AI Act.
The AI was primarily used to clone and generate the voice of President Marcos Jr. to create a faked audio directive.
Multiple independent news reports consistently describe the deepfake audio, the platform it was hosted on, the specific faked statement, and the official government denial. There is high consensus on the facts of the incident.
None
Technology
Generative AI Voice Mimicry
AI advances allowed highly realistic replication of the President's voice.
AI-Assisted Persona Creation
AI-generated profile pictures and avatars helped spread propaganda.
Algorithmic Recommendation
YouTube algorithms amplified sensational deepfake content for engagement.
Data Inputs
Repurposed Media Footage
Old military exercise footage was fed into systems to mislead viewers.
Unlabeled Synthetic Audio
Deepfake audio was uploaded without any digital watermarks or labels.
Human Factors
Low Media Literacy
Over half of Filipinos struggle to identify fake news online.
Cognitive Vulnerability
High geopolitical tensions made viewers susceptible to fear-mongering.
Viewer Confirmation Bias
Polarized viewers accepted and shared the fake news as truth.
Process and Methods
Reduced Platform Moderation
Social media platforms scaled back fact-checking and moderation teams.
Delayed Detection Systems
Lack of real-time AI detection tools allowed the video to go viral.
Reliance on Manual Flagging
The government had to manually identify and report the deepfake video.
Management
Platform Engagement Focus
Tech companies prioritized engagement metrics over content safety.
Inadequate Platform Safeguards
Platforms failed to proactively block high-risk political deepfakes.
Slow Incident Response
Lack of immediate platform action required government intervention to take down.
Regulatory Environment
Lack of AI-Specific Laws
The Philippines lacks enforceable regulations targeting deepfake creation.
Ineffective Platform Policies
Platforms lack legally binding rules to enforce synthetic content labeling.
Weak Cross-Border Enforcement
Difficulty in prosecuting foreign actors or individual sources of deepfakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
