This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A group of tourists driving in Vermont followed navigation directions from the Waze app, which led them down a boat ramp and onto the frozen surface of Lake Champlain. The vehicle slid 100 feet into the water and sank, though the occupants were able to escape safely. The vehicle remained submerged for approximately one week before being recovered by a salvage team.
The tourists driving through Vermont blamed Waze for directing them into a boat launch in Lake Champlain, prompting the vehicle to slide into the water by the time the drivers realized their location in the dark and foggy weather.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The driver relied heavily on the GPS instructions despite dark and foggy conditions, demonstrating overreliance on the technology.
The Waze navigation app failed to perform reliably by directing the driver onto a boat launch and into a lake, representing a lack of capability or robustness in its mapping and routing system.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Waze navigation app providing incorrect routing instructions post-deployment, which was an unintentional outcome of its goal to navigate the users.
A consumer navigation error by the Waze app led tourists onto a frozen lake in Vermont. The incident resulted in minor property damage and no physical injuries, presenting negligible national security implications.
Waze acts as a navigation assistant, providing routing suggestions to the driver who retains ultimate control and decision-making authority over the vehicle. The report notes that Google reminded users to 'use all environmental information available to them to make the best decisions as they drive'.
Minimal or No Risk: The Waze app is a general consumer navigation tool used for convenience, which does not fall under the high-risk categories of the EU AI Act.
The primary function of the Waze app is to provide real-time navigation assistance and routing directions to drivers.
The reports provide consistent, clear details about the incident, including the location, date, number of passengers, and the specific failure of the Waze app directing them onto a boat launch.
The incident could be interpreted primarily as driver error due to poor visibility (dark and foggy conditions) and alcohol consumption, rather than an AI failure, though the app's faulty routing was verified by the owner later.
Technology
Faulty Routing Algorithm
Waze algorithm directed the vehicle onto a boat launch instead of a road.
Lack of Hazard Warning
The app did not warn the driver that the route ended at a water body.
Data Inputs
Inaccurate Map Data
The map data incorrectly categorized a boat launch as a standard road.
Human Factors
Over-reliance on Navigation App
The driver blindly followed GPS instructions despite environmental risks.
Reduced Visibility
Dark and foggy conditions prevented the driver from seeing the lake ahead.
Process and Methods
Unverified Map Edits
Map updates rely on user edits without sufficient validation for safety.
Management
Defensive Corporate Response
Google prioritized liability protection over immediate root cause analysis.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
