This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
On June 1, 2020, a Tesla Model 3 operating on Autopilot collided with an overturned truck on a highway in Taiwan. The vehicle failed to detect the stationary truck and a pedestrian standing nearby, who had to jump out of the way to avoid being struck. The driver reported that he expected the system to automatically brake for the obstacle, but it did not slow down until the final moments before impact.
On a highway in Taiwan, a Tesla Sedan, reportedly operating on Autopilot mode, crashed into a large overturned truck, barely missing a pedestrian.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The driver over-relied on the Autopilot system, expecting it to brake automatically, and failed to maintain sufficient attention to the road.
The Tesla Autopilot system failed to detect a large stationary truck and a pedestrian in clear daylight, demonstrating a lack of capability and robustness in its perception system.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Tesla Autopilot system failing to detect and brake for an obstacle, which was an unexpected failure of the system post-deployment.
A Tesla Model 3 operating on Autopilot collided with an overturned truck in Taiwan due to sensor detection limitations. This is a localized consumer safety and transport incident with negligible national security implications, representing an established risk category of human-supervised AI failures.
The Tesla Autopilot system was operating the vehicle's steering and braking controls in real-time, responding to environmental inputs autonomously at a set speed of 110 km/h, although it failed to react to the stationary truck.
High Risk: The system is an AI safety component in a road vehicle (traffic/transportation infrastructure), which has significant implications for physical safety. The report notes that 'Tesla's Autopilot is a driver assist system' with 'steering and braking capabilities' that failed to prevent a high-speed collision.
The primary function of Tesla Autopilot is to assist or automate driving tasks such as steering, accelerating, and braking on highways.
The reports provide consistent, detailed accounts of the crash from multiple sources, including eyewitness statements, police reports, and technical analysis of why the sensors failed. There is high certainty regarding the sequence of events, the role of the Autopilot system, and the lack of physical injuries.
The accident could be interpreted purely as driver negligence due to inattention, rather than an AI failure, given that Autopilot is a level 2 assist system requiring constant driver oversight.
Technology
Inadequate Radar Resolution
Radar could not distinguish stationary truck from median on a curve.
Lack of LIDAR Sensor
Absence of LIDAR reduced ability to detect the 3D shape of the obstacle.
Inadequate Driver Monitoring
Steering torque check allowed driver to remain highly inattentive.
Data Inputs
Untrained Classifier Models
Image classifiers were not trained on overturned trucks lying sideways.
Overexposed Camera Images
Bright sun and white truck paint caused overexposure, blinding the camera.
Lack of Lane-Level Map Data
Absence of HD maps prevented filtering radar noise from actual obstacles.
Human Factors
Driver Inattention
Driver assumed Autopilot would handle everything and did not monitor the road.
Overreliance on Autopilot
Driver believed the vehicle would automatically brake for all obstacles.
Process and Methods
Filtering of Stationary Radar Targets
System filtered out stationary objects to prevent dangerous phantom braking.
Ineffective Attention Checks
Hands-on-wheel check failed to ensure the driver was looking at the road.
Management
Deprecation of Key Sensors
Management rejected LIDAR and HD maps as unnecessary crutches.
Inadequate Autopilot Safeguards
Management failed to implement robust safety guardrails for system misuse.
Regulatory Environment
Lack of Driver Monitoring Rules
Regulators did not mandate active gaze-tracking for driver assist systems.
Permissive Autopilot Branding
Inadequate regulatory limits on marketing misleading terms like Autopilot.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
