This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In August 2023, Retool suffered a security breach after an attacker used an AI-generated deepfake voice to impersonate an IT employee, tricking a staff member into revealing a multi-factor authentication code. The attacker subsequently exploited Google Authenticator's cloud-syncing feature to gain unauthorized access to internal systems and GSuite accounts, impacting 27 cloud customers. Retool disclosed the incident to highlight the risks of social engineering and the security implications of cloud-synced MFA tokens.
In August 2023, a hacker reportedly was successful in breaching Retool, an IT company specializing in business software solutions, impacting 27 cloud customers. The attacker appears to have initiated the breach by sending phishing SMS messages to employees and later used an AI-generated deepfake voice in a phone call to obtain multi-factor authentication codes. The breach seems to have exposed vulnerabilities in Google's Authenticator app, specifically its cloud-syncing function, further enabling unauthorized access to internal systems.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The breach resulted in unauthorized access to GSuite accounts and internal systems, compromising 27 cloud customers.
The incident involved a hacker using an AI-powered voice deepfake to impersonate an IT staff member, successfully executing a targeted social engineering scam to gain unauthorized access.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The security breach was initiated and executed by a human hacker who intentionally used social engineering and an AI voice deepfake to compromise Retool's systems.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A security breach at Retool where an attacker used an AI-generated voice deepfake to impersonate an IT employee, bypassing multi-factor authentication and compromising 27 cloud customers. The incident highlights the growing threat of AI-enabled social engineering to corporate cybersecurity, though its direct national security impact remains minor.
The AI system (Google Authenticator) operates as a tool, performing a specific, deterministic function of generating multi-factor authentication codes based on direct inputs without autonomous decision-making.
Risk Level 3: Limited Risk. The incident involves the use of AI-generated content, specifically an AI-powered voice deepfake, which falls under the category of deepfakes requiring transparency obligations.
The hacker used an AI-powered voice deepfake to clone an IT employee's voice for impersonation.
The report provides a clear, detailed account of the attack vector, the role of the voice deepfake, and the specific vulnerability in Google Authenticator's cloud sync that enabled the breach.
None. The facts of the social engineering attack and subsequent breach are straightforward.
Technology
AI Voice Deepfake Generation
Attacker generated highly realistic voice clone of IT team member.
Authenticator Cloud Syncing
Google Authenticator synced MFA codes to compromised Google account.
Data Inputs
Reconnaissance Data on Staff
Attacker used specific details about coworkers and office layouts.
Employee Voice Samples
Attacker sourced voice recordings to train the AI deepfake model.
Human Factors
Vulnerability to Social Engineering
Employee trusted the realistic deepfaked voice and shared MFA code.
Phishing Link Interaction
Employee clicked a malicious link in an SMS pretending to be IT.
Process and Methods
Inadequate Voice Verification
No process to verify identity of callers claiming to be IT staff.
MFA Code Sharing via Phone
Lack of strict protocols preventing sharing of MFA codes over calls.
Management
Inadequate Phishing Training
Training failed to prepare staff for AI-driven vishing attacks.
Unmonitored MFA Configuration
Management failed to restrict or audit Google Authenticator cloud sync.
Regulatory Environment
Lack of Deepfake Regulations
Absence of strict controls on commercial voice cloning technologies.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
