This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The Royal Brunei Police Force has issued a public warning regarding the use of AI-generated deepfake videos and audio on social media platforms like TikTok, Facebook, and Instagram. These videos impersonate police officers to promote a fraudulent investment scheme called 'Real Money Magic,' which promises guaranteed financial returns. Authorities have cautioned the public against these scams, noting that they exploit trust to induce victims into transferring money for fake investments.
The Royal Brunei Police Force issued a public warning about purportedly AI-generated deepfake videos impersonating police officers on TikTok, Facebook, and Instagram. The videos allegedly promote a fraudulent investment scheme known as "Real Money Magic," reportedly claiming guaranteed financial returns. Authorities report that scammers use synthetic video and audio to gain victims' trust and induce money transfers. The scam has not been linked to any official institutions.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves scammers using AI-generated deepfakes to impersonate police officers and run a fraudulent investment scam targeting individuals for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by human scammers who intentionally used deployed AI tools to generate deepfakes for fraudulent purposes.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
The Royal Brunei Police Force issued a warning regarding AI-generated deepfakes impersonating police officers to promote a fraudulent investment scheme. While the incident represents an exploitation of state authority and trust, its national security impact is minor, primarily constituting localized financial cybercrime rather than a coordinated threat to state sovereignty or critical infrastructure.
The report describes scammers using AI as a tool to create manipulated videos and audio, acting on direct input to perform a specific function without autonomous planning.
Risk Level 3: Limited Risk. The report describes AI-generated content such as deepfakes, which are subject to specific transparency obligations under the Act.
The AI system was used to create manipulated videos and audio that convincingly resemble real police personnel.
The report clearly outlines the nature of the scam, the platforms used, the impersonated entity (police officers), and the specific fraudulent scheme ('Real Money Magic'). There is little ambiguity about the malicious intent or the technology used (AI deepfakes).
None
Technology
AI Deepfake Generation
AI tools used to create realistic manipulated video and audio of police.
Social Media Distribution
Platforms like TikTok and Facebook allow rapid circulation of deepfakes.
Data Inputs
Misuse of Officer Likeness
Scammers use real police officers' images and voices to train AI models.
Human Factors
Exploitation of Public Trust
Scammers exploit the trust and authority associated with police officers.
Vulnerability to Financial Scams
Victims are lured by promises of quick profits and guaranteed returns.
Process and Methods
Inadequate Content Moderation
Social media platforms fail to detect and remove fraudulent deepfake videos.
Regulatory Environment
Lack of AI Content Controls
Absence of strong regulations to prevent the malicious deployment of deepfakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
