This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In February 2025, a Colorado woman was targeted by a sophisticated extortion scam involving AI-generated voice cloning. Perpetrators impersonated her daughter to stage a fake kidnapping, coercing the victim into wiring $2,000 to Mexico. The victim was unable to recover the funds, and law enforcement could not trace the perpetrators.
In February 2025, a Colorado woman was scammed by a voice-cloning fraud in which criminals used what sounded like her daughter’s voice to stage a fake kidnapping. Under duress and believing her daughter was in danger, she wired $2,000 to Mexico. The scammers exploited generative AI to simulate the daughter’s voice and manipulated the victim psychologically. Law enforcement could not trace the perpetrators or recover the funds.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves scammers using AI voice-cloning technology to impersonate a family member and defraud the victim of $2,000.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by human scammers who intentionally used deployed generative AI voice-cloning technology to execute a fraudulent extortion scheme.
Added categories peak at 2: Minor (Psychological Harm, Direct)
A localized AI-enabled voice cloning extortion scam targeted a US citizen, resulting in a $2,000 financial loss. While the incident caused individual distress, it represents a standard criminal exploit of commercial technology with negligible implications for national security.
The AI system was used as a tool by criminals to clone a voice based on short audio samples. It performed the specific function of voice replication without exhibiting autonomous goal-directed behavior or planning.
Risk Level 3: The system involves AI-generated content such as deepfakes (voice cloning), which falls under the limited risk category requiring transparency obligations.
The AI system's primary function was to clone and generate the voice of the victim's daughter to make the scam believable.
The report clearly details the events of the scam, the specific financial loss ($2,000), and the psychological impact on the victim. The role of generative AI voice cloning is explicitly discussed as the enabling technology for the impersonation.
None. The incident is a straightforward case of AI-enabled financial fraud.
Technology
AI Voice Cloning
Generative AI clones voices with 85% accuracy using three seconds of audio.
Voice Synthesis Flexibility
AI easily approximates voices of any age, gender, or dialect.
Data Inputs
Public Voice Sharing
Users share voice clips online, providing source data for cloning.
Human Factors
Cognitive Hijack under Stress
Fear triggers fight-or-flight, suspending rational judgment.
Trust in Auditory Cues
Victim trusted the cloned voice, believing it was her daughter.
Process and Methods
No Identity Verification
No process existed for the victim to verify her daughter's safety.
Weak Transfer Fraud Checks
Money transfer services allowed rapid, irreversible transfers to Mexico.
Management
Rigid Fraud Liability Rules
Banks refuse refunds for authorized transfers, leaving victims helpless.
Regulatory Environment
Lack of Voice AI Regulation
Absence of strict controls on generative AI voice cloning tools.
Jurisdictional Limitations
International money transfers make prosecution by local police unlikely.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
