This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
During the 2017 Southern California wildfires, navigation apps including Waze, Google Maps, and Apple Maps directed motorists into active fire zones. The apps' algorithms prioritized routes with low traffic, failing to account for the fact that these roads were empty due to fire-related closures and evacuation orders. This led to life-threatening situations for drivers and obstructed emergency response efforts, prompting local law enforcement to advise against using navigation apps in the area.
Waze, a Google-owned directions app, led California drivers into the 2017 Skirball wildfires as they tried to evacuate the area.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
Drivers over-relied on navigation apps during active natural disasters, trusting the technology to steer them safely out of danger zones despite warnings.
The navigation apps failed to perform robustly under extreme environmental conditions, misinterpreting evacuated, fire-threatened roads as optimal routes due to a lack of real-time situational capability.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The routing algorithms of the navigation apps unintentionally directed drivers into active fire and flood zones post-deployment while attempting to optimize for low traffic.
Added categories peak at 2: Minor (Psychological Harm, Direct)
During the 2017 Southern California wildfires, routing algorithms of popular navigation apps directed drivers into active fire zones by misinterpreting evacuated, empty roads as optimal, low-traffic routes. This caused minor localized physical risks and temporarily obstructed emergency response vehicles, highlighting systemic safety limitations of consumer AI systems operating in disaster zones.
The navigation apps act as assistants by providing routing suggestions and real-time traffic information to augment human driving, but they require human oversight and the driver retains final decision-making authority.
High Risk: The AI systems are used in critical infrastructure, specifically traffic management and road safety, where failures can lead to life-threatening situations.
The primary function of Waze, Google Maps, and Apple Maps is to assist users with turn-by-turn navigation and route optimization.
The reports provide consistent, multi-source accounts of navigation apps directing drivers into fire and flood zones due to algorithmic traffic optimization. The technical mechanism (empty roads appearing attractive to the algorithm) is clearly explained across several articles, and statements from both local authorities and Google/Waze confirm the events.
None. The causal link between the routing algorithms and the unsafe directions is clear and undisputed.
Technology
Traffic-Optimization Bias
Algorithms routed drivers to empty roads which were actually on fire.
Lack of Hazard Awareness
Routing algorithms had no native capability to detect wildfire zones.
Real-Time Map Update Lag
Apps failed to instantly reflect fast-moving environmental hazards.
Data Inputs
Missing Evacuation Data
Algorithms lacked real-time boundaries of active evacuation zones.
Delayed Road Closure Reports
Official closures took hours to be transmitted and updated on maps.
Reliance on Crowdsourcing
Crowdsourced reports were too slow during rapidly evolving crises.
Human Factors
Driver Overreliance on GPS
Users blindly followed app directions despite visible smoke and fire.
Distracted Driving in Crises
Stressed drivers relied on apps instead of local emergency signs.
Process and Methods
Slow Verification Checks
Official closure data required multi-step checks before app update.
Inadequate City Coordination
No automated system existed to share real-time city data with apps.
Management
Prioritization of Speed
Management prioritized travel time savings over safety in emergencies.
Inadequate Disaster Planning
App companies did not prepare for rapid, unpredictable crises.
Regulatory Environment
No Mapping Liability Standards
Lack of legal framework holding app makers liable for unsafe routing.
Lack of Emergency Routing Rules
No regulatory mandates forcing apps to integrate disaster hazards.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
