This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In December 2019, a Tesla Model S driver using the Autopilot system failed to stop at a red light in Gardena, California, while traveling at 74 mph. The vehicle struck a Honda Civic, resulting in the deaths of two individuals. The driver was subsequently charged with vehicular manslaughter, marking a significant legal case regarding the use of partially automated driving systems.
In 2019, a Tesla Model S driver on Autopilot mode reportedly went through a red light and crashed into a Honda Civic, killing two people in Gardena, Los Angeles.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The driver exhibited automation complacency, overrelying on the Autopilot system and failing to maintain active supervision as required.
The Tesla Autopilot system failed to detect the red light and brake, demonstrating a critical lack of capability and robustness in handling intersection environments.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident occurred post-deployment due to an unintentional failure of the Tesla Autopilot system to detect and react to a red light, combined with driver inattention.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A fatal domestic traffic accident in 2019 involving a Tesla Model S on Autopilot that resulted in two civilian deaths. While a tragic public safety incident that set a novel legal precedent regarding criminal liability for drivers using semi-autonomous systems, it has negligible national security implications.
The Tesla Autopilot system operated the vehicle's steering, speed, and braking in real-time, executing driving maneuvers independently until the collision occurred.
High Risk: The system is used in critical infrastructure and transport safety (autonomous driving/traffic management), where failures can lead to significant safety risks and loss of life.
The primary goal of Tesla's Autopilot system is to provide semi-autonomous driving capabilities, including autosteer, traffic-aware cruise control, and lane-keeping.
The reports provide consistent, detailed, and verified factual accounts of the primary 2019 crash, including the speed, location, victims, driver, and the active status of Autopilot confirmed by federal investigators (NHTSA).
None. The role of Autopilot is well-documented and confirmed by regulatory bodies.
Technology
Failure to Detect Red Light
The Autopilot system did not detect or stop for the red traffic light.
Inadequate Emergency Braking
The automatic emergency braking system failed to engage before the collision.
Permissive System Design
System design permitted driver disengagement and automation complacency.
Data Inputs
Stationary Object Limitations
A.I. struggled to separate stationary objects and lights from background.
Data Biases in Training
Potential data biases favoring high-income areas where more Teslas drive.
Human Factors
Driver Inattention
The driver failed to monitor the road or react to warning signs.
Automation Complacency
Overreliance on the system led the driver to stop actively driving.
Abuse of Autopilot System
Drivers bypassing safeguards or using the system while impaired.
Process and Methods
Inflated Consumer Expectations
Marketing and videos overstated capabilities, downplaying safety risks.
Inadequate Driver Monitoring
Lack of robust active driver monitoring to ensure hands-on attention.
Management
Prioritizing Data over Safety
Using public roads for data gathering, accepting high risk for future gains.
Rejection of Safety Features
Management rejected speed limits and complexity in favor of simplicity.
Regulatory Environment
Lack of Pre-market Approval
No strict regulatory standards for deploying semi-automated systems.
Regulatory Gaps in Oversight
Federal agencies investigate crashes post-hoc rather than enforcing rules.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
