This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A Brazilian bricklayer was deceived by an AI-generated persona on social media, which promised a romantic relationship and a life on a farm. Believing the persona was real, he traveled over 2,000 km to Belo Horizonte, only to discover the woman did not exist. He became stranded without funds and required municipal assistance to return home, marking the third such incident in the city in six months.
A Brazilian bricklayer reportedly traveled over 2,000 km from Imperatriz, Maranhão, to Belo Horizonte, Minas Gerais, after believing videos of a purportedly AI-generated woman offering a relationship and life on a farm. He exhausted his money on lodging and needed municipal help to return home. The profile operator later denied having private conversations with him. The identity of the operator and the generation tool were not established.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The victim formed an intense emotional attachment to the AI persona due to loneliness, leading to unsafe real-world actions like traveling 2,000 km.
The incident involves the use of an AI-generated persona to run romance scams, manipulating victims into believing they are interacting with a real person to gain personal or financial advantage.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by an AI-generated persona sending automated responses to users post-deployment, intentionally designed to simulate a real person and attract interactions.
Added categories peak at 2: Minor (Psychological Harm, Direct)
An AI-generated social media persona was used to conduct automated romance scams in Brazil, leading to emotional distress and financial loss for multiple victims. While demonstrating an evolved capability in automated fraud, the national security impact remains minor and localized, manageable by standard municipal and law enforcement services.
The AI system operated independently as a social media persona, automatically generating and sending responses to users who interacted with its posts without direct human intervention in each interaction.
Risk Level 3: The system is an AI-generated persona and chatbot ('figura gerada por inteligencia artificial que enviava respostas automaticas') which interacts with users without disclosing its artificial nature, falling under the category of chatbots and deepfakes.
The AI system functioned primarily as an interactive chatbot that automatically replied to social media users, while also generating social media content (videos and posts) to attract targets.
The report clearly details the victim's experience, the location, the dates, and the mechanism of deception (AI-generated persona with automated responses). It also mentions two other similar cases, providing good context. However, technical details about the specific AI model or its creators are absent.
The incident could be viewed purely as a traditional catfishing scam where AI was merely a tool, rather than an AI-specific safety failure.
Technology
AI Persona Generation Tools
AI generated realistic videos and profiles to deceive users.
Automated Response Bots
Bots sent automated messages to simulate genuine human interaction.
Data Inputs
Deceptive Video Training Data
AI models used attractive female videos to create realistic fakes.
Human Factors
Extreme User Loneliness
Grief and isolation made the victim highly susceptible to deception.
Limited Digital Literacy
Victim could not distinguish between a real person and an AI bot.
Process and Methods
Weak Profile Verification
Social media platforms allowed unverified AI bots to contact users.
Poor Automated Detection
Lack of active monitoring for repetitive AI-driven catfishing scams.
Management
Negligent Platform Oversight
Platform management failed to curb systemic automated fraud accounts.
Regulatory Environment
Absence of AI Identity Laws
Lack of regulations requiring disclosure of AI-generated personas.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
