This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Mumbai businessman was defrauded of Rs 80,000 after receiving a call from scammers using AI voice cloning to impersonate his son. The perpetrators claimed the son had been arrested in Dubai and demanded an immediate money transfer. A similar incident involving a professor losing Rs 1 lakh was also reported, highlighting the growing prevalence of AI-enabled voice cloning scams in the region.
A Mumbai businessman reportedly identified as KT Vinod reportedly lost Rs 80,000 after receiving a call from someone claiming to be a representative of the Indian Embassy in Dubai, who said his son had been arrested. The caller allegedly used AI-generated voice cloning to simulate the voice of Vinod's son, pleading for help. Reportedly convinced of the urgency, Vinod instructed a money transfer via Google Pay. The scam was discovered only after he contacted his son directly.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves fraudsters using AI voice cloning to impersonate family members and execute targeted financial scams against specific individuals.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human fraudsters intentionally using deployed AI voice cloning technology to deceive and steal money from victims.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
This incident involves localized financial fraud in Mumbai utilizing AI voice cloning to impersonate family members. While distressing to the victims and representing a growing cybercrime trend, it carries negligible national security implications as it does not target critical infrastructure, government functions, or strategic economic systems.
The AI voice cloning software and social media data harvesting tools were used by human fraudsters as tools to generate specific outputs (cloned voices and profile details) based on direct inputs, without exhibiting autonomous planning or agency.
Limited Risk: The system involves 'AI-generated content such as deepfakes' (voice cloning), which poses a moderate risk and requires transparency obligations so users are aware they are interacting with synthetic content.
The primary function of the AI system was to generate a realistic clone of the victims' sons' voices. A secondary function was modeling behavior/details harvested from social media.
The reports provide clear, consistent details about the two scam incidents, the amounts lost, the methods used (AI voice cloning and social media harvesting), and the police investigations. There is little ambiguity regarding the events or the role of AI.
None
Technology
AI Voice Cloning Tools
Readily available online tools allow creating realistic replicas of voices.
Sophisticated Voice Replicas
Highly realistic cloned voices make it difficult to distinguish fake calls.
Data Inputs
Social Media Voice Data
Fraudsters extract voice samples of family members shared on social media.
Social Media Profile Details
Scammers harvest family and personal relationships from public profiles.
Human Factors
Panic and Emotional Distress
Fear for son's safety led victim to bypass crucial safety verification.
Lack of Information Verification
Victim failed to contact the son or embassy directly before paying.
Process and Methods
Urgent Financial Demands
Scammers demanded immediate transfers to prevent victim from rethinking.
Impersonation of Authorities
Using fake embassy or police identities to establish false credibility.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
