This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Scammers in Malaysia are increasingly utilizing generative AI to create hyper-realistic deepfake videos and voice clones of public figures and family members to conduct large-scale financial fraud. These scams, which include fake investment schemes and emergency-themed impersonations, have resulted in significant financial losses for thousands of victims. Authorities and cybersecurity experts have warned that the sophistication of these tools is eroding public trust and poses risks to national stability by blurring the lines between authentic and manipulated content.
Purported AI-generated deepfake videos depicting Malaysia's Prime Minister Anwar Ibrahim and other officials, political leaders, and business leaders have reportedly been used to promote fraudulent investment schemes. A total of 13,956 cases were reported last year, with RM2.11 billion allegedly lost to these scams. Victims were allegedly misled by hyper-realistic fake endorsements circulated via Facebook, WhatsApp, and Telegram. Scammers allegedly adapt quickly, generating new deepfakes when content is removed.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The AI-generated deepfakes and voice clones present highly convincing false information that misleads victims into believing they are interacting with real people.
Scammers are using AI-generated deepfakes and voice clones to impersonate trusted individuals and public figures for illegitimate financial benefit.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk is caused by human scammers intentionally utilizing deployed generative AI models to create deepfakes and voice clones for financial fraud.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
Widespread AI-enabled financial fraud in Malaysia utilizing hyper-realistic deepfakes of public figures and cloned voices of family members. While primarily financially motivated rather than a state-sponsored attack, the scale of economic loss (RM2.11 billion) and the erosion of public trust present substantial challenges to societal stability and economic security.
The AI systems are used as tools by scammers to perform specific, well-defined functions, namely generating hyper-realistic videos and cloning voices based on direct inputs like public TikTok videos or photos.
Limited Risk: The reports describe the use of AI-generated content such as deepfakes and cloned voices, which fall under Risk Level 3 due to transparency obligations to ensure users are aware they are interacting with AI-generated media.
The AI systems were primarily used to generate hyper-realistic deepfake videos of public figures to promote fraudulent investment schemes, and secondarily to clone voices of family members for emergency scams.
The reports from multiple reputable Malaysian news outlets provide consistent statistics on financial losses (RM2.11 billion) and cases (13,956), along with direct quotes from CyberSecurity Malaysia and victims. The role of AI in generating deepfakes and voice clones is explicitly stated, making the classifications highly reliable.
None. The events are clearly identified as AI-enabled financial fraud.
Technology
Hyper-realistic Deepfake Videos
AI generates highly convincing videos of trusted public figures to deceive.
AI Voice Cloning
Scammers clone voices from public clips to impersonate family or friends.
Rapid AI Content Generation
Scammers quickly generate new fakes to stay ahead of platform takedowns.
Data Inputs
Publicly Available Media
Scammers harvest short public TikTok videos to clone target voices.
Lack of Media Verification
Social media feeds lack robust verification of video and audio authenticity.
Human Factors
Emotional Exploitation
Scams create false urgency, pushing victims to make hasty financial decisions.
Trust in Public Figures
Victims believe endorsements from trusted politicians and celebrities.
Lack of Public Awareness
Many users cannot easily distinguish AI-generated fakes from real media.
Process and Methods
Ineffective Platform Detection
Social media platforms lack strong mechanisms to detect and block deepfakes.
Slow Content Takedown Process
Scammers outpace manual or slow automated content removal by authorities.
Weak Platform Verification
Social media platforms often overlook verification of promotional content.
Regulatory Environment
Loose AI Legislation
Authorities call for tighter legislation against the misuse of AI media.
Jurisdictional Gaps in Enforcement
Technical response units must refer non-technical fakes to regulators.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
