This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Google has filed a lawsuit against a China-based cybercrime network known as 'Outsider Enterprise' for using Gemini and other AI tools to facilitate large-scale phishing scams. The network used AI-generated software kits to create thousands of fraudulent websites and sent 2.5 million scam messages to Android users in May 2026, resulting in millions of dollars in financial losses for hundreds of thousands of victims.
Google alleged in a civil lawsuit that the China-based network Outsider Enterprise used Gemini and other AI tools to help create phishing websites for large-scale text-message scams impersonating companies and government services. Google said the network coordinated through Telegram, generated thousands of fake sites and fraudulent URLs, sent 2.5 million Android messages during a two-week period in May 2026, and financially scammed hundreds of thousands of people.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The AI was used to generate highly convincing fake websites and deceptive messages that misled users into believing they were interacting with legitimate organizations.
The cybercrime network used Gemini to create fake websites and mass-produce scam messages to defraud hundreds of thousands of victims for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by the intentional actions of a human cybercrime network using a deployed AI system to conduct financial scams.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A China-based cybercrime network named Outsider Enterprise leveraged Google's Gemini AI to scale a massive phishing campaign targeting U.S. citizens, resulting in millions of dollars in losses. The incident highlights the growing threat of AI-enabled economic fraud and the dual-use risks of large language models, prompting coordinated intervention by the FBI, Google, and major telecom carriers.
The report describes the cybercrime network using Google's Gemini AI system to generate content for fake websites and mass-produce scam messages, acting as an assistant to augment their fraudulent operations.
Limited Risk: The AI system involved, Gemini, is a general-purpose chatbot and generative AI system used to generate text and website content, which falls under the category of chatbots and AI-generated content requiring transparency.
The AI system Gemini was used as a writing assistant to generate text, code, and templates for fake websites and scam messages.
The reports provide consistent and detailed coverage of the lawsuit filed by Google against the cybercrime network, including specific metrics such as the number of messages sent (2.5 million), fake websites created (9,000), and software kits (131). The role of Gemini is explicitly stated, and the financial and human impact is well-scoped, leaving little ambiguity about the nature of the incident.
None.
Technology
Gemini Vulnerability to Misuse
Gemini was used to generate fake websites mimicking trusted brands.
AI-Powered Software Kits
Criminals created 131 kits to easily mass-produce scam websites.
High Conviction Generation
AI-generated scams are highly convincing and hard to detect.
Human Factors
User Trust in Mimicked Brands
Victims trusted fake websites mimicking USPS, E-ZPass, and Google.
Malicious Collaboration
Scammers used Telegram to share AI tools and coordinate campaigns.
Process and Methods
Mass Messaging Distribution
Scammers sent 2.5 million messages to Android users in two weeks.
Inadequate Abuse Prevention
Google lacked proactive controls to block Gemini-assisted scams.
Management
Delayed Industry Coordination
First coordinated effort with FBI and carriers occurred after the event.
Regulatory Environment
Lack of Preemptive Regulation
No regulatory standard prevented the deployment of scam-enabling AI.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
