This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
This record documents a series of fatal and injury-producing traffic accidents involving Tesla vehicles operating with the 'Autopilot' driver-assistance system engaged. Investigations by the NTSB and NHTSA have highlighted systemic issues where the system failed to detect stationary objects, such as tractor-trailers and emergency vehicles, and concerns regarding driver over-reliance on the automation. Tesla has consistently maintained that the system requires driver vigilance, while safety advocates and regulators have criticized the company for the system's naming, marketing, and lack of effective driver-monitoring safeguards.
Multiple unrelated car accidents result in varying levels of harm have been occurred while a Tesla's autopilot was in use.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
Drivers routinely over-relied on the system, engaging in distracted behaviors like watching movies or looking at phones due to the system's branding and marketing.
The primary failure stems from the Autopilot system's inability to reliably detect and respond to stationary objects and lane boundaries under varying conditions.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incidents were caused by the Autopilot AI system making erroneous steering and braking decisions after being deployed to the public.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A series of fatal and injury-producing traffic accidents in the US involving Tesla vehicles operating on Autopilot. The incidents stem from system limitations in detecting stationary objects and driver over-reliance. While raising significant transport safety and regulatory issues, the national security impact remains minor and manageable under standard domestic safety procedures.
The Autopilot system physically controls the vehicle's steering, acceleration, and braking in real-time based on environmental inputs and sensor data, making reactive decisions without high-level planning.
High Risk: The system is a safety component of a passenger vehicle operating in critical transport infrastructure, directly impacting physical safety and public interest.
The primary function of Tesla's Autopilot is to assist or perform lane-keeping, steering, and speed adjustments on highways, which is a form of autonomous driving.
The reports include official NTSB executive summaries, police statements, and detailed journalistic accounts of multiple crashes, providing high-quality factual evidence.
Tesla argues the incidents are purely human driver negligence, whereas regulators and safety advocates view them as system design failures.
Technology
Limited Sensor Capabilities
Sensors failed to distinguish white trailer or detect stationary vehicles.
Inadequate Driver Monitoring
Torque sensor was easily defeated and failed to ensure driver attention.
Flawed Lane Tracking
Autopilot steered into gore area/median instead of maintaining correct lane.
Data Inputs
Radar False-Braking Filtering
System tuned out stationary objects to avoid unnecessary braking events.
Lack of Real-time Hazard Data
Lack of updated road data regarding damaged infrastructure like attenuators.
Inadequate Visual Data Processing
Computer vision failed to contrast white trailer against a bright sky.
Human Factors
Driver Overreliance on Automation
Drivers assumed system was fully autonomous, leading to severe distraction.
Delayed Human Intervention
Drivers failed to override Autopilot despite receiving multiple warnings.
Tricking Steering Wheel Sensors
Drivers bypassed hands-on warnings using weights or other workarounds.
Process and Methods
Testing Beta Software on Public Roads
Deploying unproven driver-assist features in public beta risks human lives.
Inconsistent Safety Validation
Lack of rigorous testing under diverse, real-world edge cases.
Misleading System Nomenclature
Naming system 'Autopilot' creates false sense of complete autonomy.
Management
Prioritizing Deployment Over Safety
Releasing features before perfecting driver engagement monitoring.
Defensive Public Communication
Blaming drivers rather than addressing systemic automation limitations.
Ignoring Regulatory Recommendations
Failure to officially respond to NTSB recommendations on driver engagement.
Regulatory Environment
Lack of Autonomous Vehicle Standards
Absence of federal regulations for Level 2 driver-assist safety systems.
Inadequate Oversight of Beta Deploys
Regulators allowed public beta testing without strict safety mandates.
No Standardized Driver Monitoring
Regulators did not mandate robust eye-tracking systems for driver engagement.
