This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
On January 22, 2018, a Tesla Model S operating on Autopilot collided with a parked Culver City fire truck on Interstate 405. The NTSB investigation concluded that the driver was inattentive, having his hands off the steering wheel for the majority of the final drive segment, and over-relied on the Autopilot system. The vehicle's automatic emergency braking system failed to engage prior to the impact, resulting in the total loss of the Tesla, though no injuries were reported.
A Tesla Model S operating on Autopilot mode crashed into the back of a parked fire truck on a freeway in Culver City, California in a non-fatal collision.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.
Also classified as
The Autopilot system and automatic emergency braking failed to detect the stationary firetruck and instead accelerated into it.
The driver over-relied on the Autopilot system, ignoring multiple hands-on warnings to eat breakfast, which led to a collision when the system failed to brake for a parked firetruck.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Tesla Autopilot system failing to detect a parked firetruck and accelerating into it, which was an unintentional post-deployment failure.
A Tesla Model S operating on Autopilot collided with a parked fire truck due to driver inattention and system limitations. While highlighting safety challenges in autonomous driving, the incident has negligible implications for national security.
The Tesla Autopilot system operates the vehicle's steering, acceleration, and braking independently in real-time based on environmental inputs, representing an Autonomous behavior type, even though it requires human oversight.
High Risk: The Autopilot system is an AI safety component in road transport infrastructure and vehicles, which has significant implications for public safety. The report notes the system 'permitted driver disengagement' and failed to prevent a collision with an emergency vehicle.
The primary function of Tesla's Autopilot is to control the steering, acceleration, and braking of the vehicle, which falls under Autonomous Driving.
The reports are based on official NTSB investigation findings, providing precise telemetry data (speed, duration of Autopilot engagement, hands-on-wheel duration, warning counts) and clear statements from both the driver and Tesla. This allows for highly confident classifications.
The incident could be viewed purely as driver negligence (Human entity) rather than an AI failure, but the technical failure of the AEB and Autopilot to detect a stationary firetruck makes the AI-centric classification highly appropriate.
Technology
AEB Failure to Engage
Automatic emergency braking did not activate to prevent the collision.
Late Forward Collision Warning
Warning occurred only 0.49 seconds before impact, leaving no time to react.
Autopilot Tracking Failure
System failed to detect or brake for the stationary firetruck in its lane.
Data Inputs
Lead Vehicle Occlusion
The firetruck was hidden from sensors until the lead vehicle changed lanes.
Human Factors
Driver Inattention
Driver was eating breakfast and not watching the road.
Overreliance on Autopilot
Driver trusted the system to handle driving tasks without active supervision.
Hands off the Steering Wheel
Driver kept hands off the wheel for almost the entire drive segment.
Process and Methods
Permissive Autopilot Design
System permitted driver disengagement from active driving tasks.
Ineffective Driver Monitoring
System allowed continued operation despite ignored hands-on warnings.
Management
Inconsistent Safety Guidance
Tesla promoted Autopilot capability while warning drivers to stay engaged.
Regulatory Environment
Lack of Federal Regulations
Few government regulations existed for autonomous and driver-assist systems.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
