This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In August 2019, a Tesla Model 3 operating on Autopilot crashed into a Ford Explorer on a California freeway. Data and video from the vehicle indicated that the system failed to slow down until a fraction of a second before impact. The collision resulted in the death of a fifteen-year-old passenger, Jovani Maldonado. The incident has led to a lawsuit and raised concerns regarding the safety, monitoring, and performance of Tesla's Autopilot system.
A Tesla Model 3 on Autopilot mode crashed into a pickup on a California freeway, where data and video from the company showed neither Autopilot nor the driver slowing the vehicle until seconds before the crash.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The report highlights that Tesla's weak driver-monitoring system allows or encourages drivers to overrely on Autopilot, leading to inattention.
The primary failure was the Autopilot system's inability to detect and brake for a slowing vehicle in front of it, representing a lack of capability or robustness in real-world driving conditions.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Tesla Autopilot system failing to detect and brake for a vehicle in its path after it had been deployed to consumers.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
A fatal traffic accident in California involving a Tesla Model 3 on Autopilot highlights safety and regulatory challenges for consumer autonomous vehicle technologies, but carries negligible national security implications.
The report describes Tesla's Autopilot as a system that 'can steer, brake and accelerate a car on its own' and make real-time driving decisions based on environmental inputs, which aligns with the Autonomous behavior type.
High Risk: The system is used in critical transport infrastructure and safety-critical applications (autonomous driving/assisted driving), which has significant implications for physical safety and life.
The Autopilot system is designed to steer, brake, and accelerate a car on its own, which is the core function of Autonomous Driving.
The report provides clear, detailed factual evidence regarding the specific crash, including vehicle data, video evidence, police reports, and statements from experts and family members. There is little ambiguity about the sequence of events or the primary failure of the Autopilot system.
Tesla argues that the driver is solely responsible for remaining attentive, suggesting the incident could be interpreted primarily as driver negligence rather than system failure.
Technology
Ignored Radar Sensor Data
Radar was equipped but outputs were likely not used to prevent the collision.
Inadequate Obstacle Detection
Autopilot failed to detect and brake for the slowing truck in its path.
Data Inputs
Camera Sun Glare Susceptibility
Cameras facing the sun may have been blinded or degraded by glare.
Visual Scene Confusion
The system was likely confused by the vehicle ahead of the Explorer.
Human Factors
Driver Inattention and Misuse
Driver trusted the system too much and failed to monitor the road.
False Sense of Security
Overreliance on Autopilot capabilities led to driver complacency.
Process and Methods
Weak Driver Monitoring
System only checks steering wheel torque, which is easy to cheat.
Lack of Eye Tracking Safeguards
Unlike competitors, the system did not track the driver's eyes.
Management
Aggressive Marketing of Autopilot
Promoting Autopilot capabilities created overconfidence in its autonomy.
Failure to Implement Safeguards
Management chose not to deploy robust eye-tracking driver monitoring.
Regulatory Environment
Absence of Strict Standards
Regulators did not mandate robust driver monitoring systems.
Lack of Active Federal Intervention
NHTSA did not force Tesla to disable or modify the weak Autopilot system.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
