This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Marine Corps veteran was defrauded of $2,500 after purchasing worthless 'Trump Golden Eagles' coins promoted through AI-generated deepfake videos. The videos featured synthetic likenesses of Donald Trump, Elon Musk, and the CEO of Bank of America, falsely claiming the coins could be traded for cash or stock. The victim, who believed he would become a millionaire, discovered the items were essentially worthless after professional testing.
Reports surfaced of a purportedly AI-generated scam falsely promoting the Trump Golden Eagles Project. The purported deepfake videos of Donald Trump, Bank of America CEO Brian Moynihan, and Elon Musk are alleged to have claimed that buyers could trade collectible coins for cash or Tesla stock. A Bay Area veteran reportedly lost $2,500 believing he would earn millions. The scam reportedly circulated via Telegram, and Bank of America denied any involvement.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involved the use of AI-generated deepfakes to execute a financial scam targeting an individual for the perpetrators' personal gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human scammers who intentionally created and deployed AI deepfakes to defraud victims.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A Marine Corps veteran was defrauded of 2,500 dollars through a financial scam utilizing AI-generated deepfakes of Donald Trump, Elon Musk, and the Bank of America CEO. While highlighting the growing capability of malicious actors to deploy realistic synthetic media for fraud, the national security impact remains minor, as the incident constitutes a localized criminal scam rather than a coordinated threat to critical infrastructure, government functions, or national security.
The AI system was used as a tool by human scammers to generate synthetic video and voice clones of public figures based on direct inputs.
Risk Level 3: Limited Risk. The report describes the use of AI-generated content such as deepfakes, which are subject to transparency obligations under the Act.
The AI system's primary function in this incident was generating synthetic videos and cloned voices of public figures to deceive viewers.
The report provides clear, detailed, and consistent information about the scam, the victim's losses, and the specific role of the AI-generated deepfakes.
None.
Technology
AI Deepfake Video Generation
Scammers generated realistic fake videos of Trump and Musk to deceive victims.
Voice Cloning Technology
Realistic synthetic voices were used to mimic trusted public figures.
Data Inputs
Use of Public Figure Likeness
Publicly available media of Trump and Musk was used to train models.
Human Factors
Victim Credulity
The victim ignored warnings from colleagues due to get-rich-quick promises.
Trust in Public Figures
The victim trusted the scam because it featured familiar leaders and branding.
Process and Methods
Telegram Distribution Channels
Scammers used Telegram to distribute deepfakes directly to target audiences.
Lack of Platform Content Review
Telegram lacked proactive moderation to detect and remove AI-generated scams.
Management
Platform Safety Prioritization
Platforms prioritized user growth over robust safety and verification.
Regulatory Environment
Weak Deepfake Regulations
Lack of strict legal frameworks governing the creation of deepfakes.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
