This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Singapore Prime Minister Lee Hsien Loong and Deputy Prime Minister Lawrence Wong were targeted by deepfake videos using AI voice cloning and manipulated footage. These videos falsely depicted the officials promoting cryptocurrency investment scams and spreading misinformation. The officials warned the public to remain vigilant and report such content via the ScamShield Bot.
A deepfake video falsely depicted Singapore’s Prime Minister Lee Hsien Loong promoting a cryptocurrency investment scam. Scammers used AI-generated voice cloning and manipulated footage from official events to create a convincing but fraudulent video interview with China Global Television Network. Lee warned the public and urged reporting through the ScamShield Bot.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The deepfakes also spread false information regarding the government planning to implement a Covid-19 circuit breaker.
The incident involves scammers using AI voice cloning and deepfake technology to impersonate Singaporean government officials in order to promote fraudulent cryptocurrency schemes.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by human scammers intentionally using deployed AI deepfake generation tools to deceive the public for financial gain.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
Singapore's Prime Minister and Deputy Prime Minister were targeted by sophisticated deepfakes and cloned voices to promote cryptocurrency scams and spread fake government policy news. While representing an evolved capability in generative AI exploitation, the national security impact remains minor as it was a financially motivated scam rather than a state-sponsored influence operation.
The AI system was used as a tool to perform a specific function, namely generating synthetic video and cloning voices based on direct inputs of real footage, without exhibiting autonomous agency or planning.
Risk Level 3. Limited Risk: The report describes AI-generated content such as deepfakes which are subject to transparency obligations under the Act.
The AI was used to generate convincing deepfake videos of Singaporean officials, combining manipulated video footage with cloned voices.
The report clearly describes the nature of the deepfakes, the targets (PM Lee and DPM Wong), and the intent of the scammers (cryptocurrency fraud and spreading misinformation). There is little ambiguity regarding the AI's role as a generative tool used for malicious impersonation.
None. The incident is a straightforward case of deepfake-enabled financial fraud and misinformation.
Technology
AI Voice and Image Mimicry
AI technology allows scammers to realistically mimic voices and images.
Footage Manipulation Tech
Real official footage is easily transformed into convincing bogus videos.
Data Inputs
Availability of Official Footage
Real footage taken from official events is used to create deepfakes.
Human Factors
Public Vulnerability to Scams
Targets are enticed by promises of guaranteed investment returns.
Lack of Public Vigilance
Difficulty in discerning real official communications from fake ones.
Process and Methods
Online Dissemination Channels
Social media and messaging platforms allow rapid circulation of deepfakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
