A Tesla Model S operating on the Traffic-Aware Cruise Control (TACC) feature of Autopilot collided with a stationary van on a Swiss highway. The driver reported that the vehicle failed to detect the stationary obstacle and instead accelerated, causing significant damage to the front of the car. While the owner's manual warns that TACC may not detect stationary objects, the driver noted that both the TACC and the automatic emergency braking system failed to engage as expected.
A Tesla Model S operating on the Traffic-Aware Cruise Control (TACC) feature of Autopilot was shown on video by its driver crashing into a parked van on a European highway in heavy traffic, which damaged the front of the car.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.
Also classified as
The Autopilot system and automatic emergency braking failed to detect the stationary van and instead accelerated, demonstrating a lack of capability in handling stationary obstacles.
The driver over-relied on the Autopilot system, admitting that because it worked correctly 1,000 times they trusted it to work again, leading to a delayed reaction when the system failed to detect the stationary van.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The collision was caused by the Autopilot system failing to detect a stationary van and accelerating into it after the system had been deployed to the public.
A consumer Tesla Model S on Autopilot failed to detect a stationary van on a Swiss highway, resulting in a minor traffic collision. The incident represents a localized consumer safety and human-computer interaction failure with negligible national security implications.
The Tesla Autopilot system operates as an autonomous driving aid, adjusting speed and attempting to navigate traffic in real-time based on sensor inputs, as described: 'Tesla's ACC and Autopilot systems use a camera and a series of sensors to monitor surrounding traffic and dynamically adjust speed'.
High Risk: The system is used in critical infrastructure and transport (autonomous driving/traffic management), which has significant implications for physical safety. The report describes 'Tesla's Adaptive Cruise Control engaged' on a highway, which fits the category of safety components of road vehicles.
The primary function of Tesla's Autopilot and Traffic-Aware Cruise Control is autonomous driving, specifically controlling the vehicle's speed and distance relative to other traffic.
The reports provide consistent, clear accounts of the crash from both media perspectives and the driver's own uploaded video comments. The technical limitation of the TACC system regarding stationary objects is well-documented and confirmed by the owner's manual quotes.
The incident could be interpreted purely as driver negligence due to the explicit manual warnings, but the automation bias induced by the system's previous successful operations points directly to an AI safety overreliance risk.
Technology
TACC Stationary Object Limitation
TACC fails to detect and brake for stationary vehicles at high speeds.
AEB Failure to Engage
Automatic Emergency Braking did not trigger to mitigate the collision.
Delayed Forward Collision Warning
The alert triggered too late to allow the driver to react and brake.
Data Inputs
Target Lock on Lead Vehicle
System tracked the lead vehicle and missed the stationary van in path.
Stationary Object Filtering
Radar filters out stationary objects to avoid false positive braking.
Hazard Light Detection Failure
The camera system did not recognize the stationary van's hazard lights.
Human Factors
Automation Complacency
Driver over-trusted the system after many successful automated stops.
Driver Distraction
Driver was looking to the right to merge instead of watching the road.
Delayed Takeover Reaction
Driver took too long to realize the system failed and to take control.
Process and Methods
Inadequate System Warnings
Crucial safety limitations are buried in the vehicle owner's manual.
Lack of Driver Monitoring
No active system monitored driver attention during Autopilot use.
Poor Post-Incident Support
Tesla support provided no useful info, claiming normal operation.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.