This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A female passenger in a Waymo autonomous taxi was harassed by two men who stood in front of the vehicle, forcing it to stop and remain stalled in a busy intersection. The passenger felt trapped and unsafe during the encounter, which lasted several minutes. Waymo's in-car support system provided assistance, and the company later followed up with the rider.
A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The passenger had no manual override controls to take over the vehicle and drive away from a threatening situation, removing human agency.
The Waymo vehicle lacked the capability to safely maneuver around pedestrians who were intentionally blocking it, leaving the passenger trapped and vulnerable to harassment.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The vehicle's autonomous decision to remain completely stopped in response to pedestrians blocking its path, while safe for the pedestrians, unintentionally trapped the passenger and exposed her to harassment.
A localized incident where a Waymo autonomous vehicle was temporarily blocked by two individuals in San Francisco, resulting in the brief harassment of a passenger. While highlighting technical limitations in autonomous vehicle routing and passenger safety during human-robot interactions, the incident has negligible national security implications.
The Waymo vehicle operates independently in real-time, responding to environmental inputs (such as pedestrians in the road) using learned patterns and making driving decisions without human intervention or explicit planning.
High Risk: The AI system is used in critical infrastructure (road traffic management and autonomous transport), which has significant implications for public safety and passenger security.
The primary function of the Waymo vehicle is fully autonomous driving to transport passengers to their destinations safely.
The reports provide consistent, detailed accounts of the incident, including direct quotes from the passenger and Waymo spokespersons, as well as video evidence of the encounter. There are no major conflicting details regarding the primary event.
The incident could be viewed purely as a human harassment issue rather than an AI safety failure, though the AI's inability to route around the obstacle is a key technical constraint that enabled the harassment.
Technology
Inability to Maneuver Around Obstacles
The vehicle is unable to drive around pedestrians blocking its path.
Lack of Passenger Control Mechanisms
Passengers cannot take over or command the vehicle to drive away from danger.
System cannot distinguish harassment
System cannot distinguish harassment from normal pedestrian presence.
Data Inputs
Sensor Obstruction Sensitivity
Sensors trigger immediate halts when pedestrians stand directly in front.
Lack of Contextual Threat Detection
Vehicle input data lacks the context to identify malicious passenger harassment.
Human Factors
Exploitation of Vehicle Safety Rules
Pedestrians exploit the vehicle's design to stop for humans to trap it.
Passenger Visibility and Anxiety
Sitting in front with untinted windows made rider visible and feel trapped.
Passenger Lack of Driving Ability
Rider's inability to drive increased panic and helplessness during incident.
Process and Methods
Passive Stay-Inside Policy
Waymo advises passengers to remain inside even during external harassment.
Routing Through High-Risk Areas
Routing algorithms do not actively avoid areas with high pedestrian incidents.
In-Car Support Reactivity
Support system is reactive, only initiating help after passenger triggers it.
Management
Prioritizing Collision Avoidance
Management prioritized avoiding pedestrian collisions over passenger security.
Underestimating Harassment Risks
Company treated passenger harassment scenarios as exceedingly rare anomalies.
Lack of Proactive Security Measures
Management relied on reactive Rider Support instead of proactive prevention.
Regulatory Environment
Lack of AV Passenger Safety Standards
No regulatory standards address passenger safety from external harassment.
Focus on Traffic Law Compliance
Regulators focus on traffic violations rather than passenger security risks.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
