A homebuyer was defrauded of $112,000 after receiving highly convincing, AI-generated phishing emails that impersonated a title company lawyer. The scammer used the AI to create professional, error-free communication to solicit a wire transfer. This incident highlights a growing trend of using generative AI to lower the barrier for entry in complex financial fraud schemes.
A real estate scam is reported to have used AI-generated phishing emails to impersonate a title company lawyer, tricking homebuyer Raegan Bartlo into wiring $255,000 to a fraudulent account. The emails were alleged to be convincing, with no grammatical errors or tone issues. Bartlo recovered part of the funds but lost $112,000.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves a scammer using generative AI to draft a highly persuasive email impersonating a lawyer to defraud a specific victim of $112,000.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human scammer who intentionally used a deployed generative AI system to draft a highly convincing phishing email to defraud a homebuyer.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
A consumer was defrauded of 112,000 dollars using highly convincing, AI-generated phishing emails impersonating a title company lawyer. While demonstrating how generative AI lowers the barrier for sophisticated social engineering, the incident remains a localized criminal matter with negligible direct implications for national security.
The AI system acted as a writing assistant, generating a highly professional and grammatically correct email based on the scammer's prompts to impersonate a lawyer.
Limited Risk: The report describes the use of a generative AI chatbot to produce text content, which falls under the category of chatbots and AI-generated content requiring transparency.
The AI system was used as a writing assistant to generate a professional, business-toned email that replicated the style of a title company lawyer.
The report provides clear, firsthand accounts from the victim, who has a cybersecurity background, along with corroborating statements from FBI officials and cybersecurity experts regarding the rise of AI-generated phishing scams. While it is noted that it is difficult to prove AI was used in this specific case, the characteristics of the email strongly align with generative AI capabilities.
The phishing email could have been written by a highly proficient English-speaking human scammer without the aid of AI.
Technology
Generative AI Text Generation
AI models generate highly realistic and convincing business emails.
Voice Cloning Technology
AI can clone voices in seconds to mimic trusted professionals.
Lowered Barrier to Entry
Free AI tools allow low-skilled actors to execute complex scams.
Data Inputs
Compromised Transaction Data
Scammers hack accounts to gain specific transaction details.
Public Real Estate Databases
Public listings provide persuasive details to add to scam emails.
Human Factors
Transaction Fatigue
Buyers are fatigued by the process and act quickly to close.
Lack of AI Phishing Awareness
Victims do not expect AI-generated emails to lack typical errors.
Trust in Professional Personas
Buyers easily trust emails appearing to come from their lawyers.
Process and Methods
Inadequate Wire Verification
Lack of out-of-band verification before wiring large sums.
Insecure Email Communication
Using standard email for sensitive financial instructions.
Regulatory Environment
AI Use is Not Inherently Illegal
Legality of AI tools makes tracking and prevention difficult.
Lack of AI-Specific Laws
Absence of regulations targeting AI-enabled financial fraud.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.