This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The National Highway Traffic Safety Administration (NHTSA) is investigating Tesla's 'Smart Summon' and 'Actually Smart Summon' features following reports of at least 16 collisions. The investigation covers approximately 2.6 million vehicles and focuses on the system's failure to detect obstacles like walls and other cars, as well as concerns regarding user reaction times and Tesla's failure to report these incidents as required by federal regulations.
Tesla's "Actually Smart Summon" feature, a remote parking system controlled via a smartphone app, reportedly failed to detect obstacles such as cars, walls, and parking signs, resulting in at least 16 collision incidents. The NHTSA is investigating safety concerns, including delayed user response times, potential overreliance on camera-only navigation, and noncompliance with crash reporting rules.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
NHTSA noted concerns regarding users having too little reaction time to avoid a crash when relying on the remote app button to stop the vehicle.
Tesla failed to report the crashes to regulators despite standing general orders requiring the reporting of incidents involving automated features.
The incident was primarily caused by the AI system's failure to perform reliably under varying conditions, specifically failing to detect and avoid obstacles like posts, walls, and parked cars.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The collisions were caused by the AI system failing to detect obstacles, which was an unintended outcome of the system's operation after deployment.
A regulatory investigation by the NHTSA into Tesla's 'Smart Summon' features following 16 low-speed parking lot collisions. The incident represents consumer safety and regulatory compliance issues with negligible implications for national security.
The vehicle uses cameras to navigate across a parking lot without anyone behind the wheel, making real-time driving decisions independently based on environmental inputs.
High Risk: The system is an autonomous driving feature deployed in passenger vehicles, which represents a safety-critical application in transport infrastructure.
The primary function of Actually Smart Summon is to autonomously drive the vehicle across a parking lot to the user's location.
The reports provide consistent details regarding the NHTSA investigation, the specific vehicles covered, the nature of the failures, and the lack of physical injuries.
None, the incident is clearly a technical failure of an autonomous vehicle feature.
Technology
Camera-only Vision Transition
Removal of radar and ultrasonic sensors reduced obstacle detection redundancy.
Inadequate Obstacle Detection
System failed to recognize posts or parked vehicles in its path.
Data Inputs
Missing Sensor Data
Lack of radar and ultrasonic data inputs limited spatial awareness.
Visual Occlusion
Camera-only approach struggled with blind spots or poor line of sight.
Human Factors
Slow App Button Release
Users had too little reaction time to release the app button to stop crashes.
Insufficient Line of Sight
Users operated the vehicle without adequate direct line of sight.
Process and Methods
Insufficient Operational Limits
Lack of robust top speed and public road operating restrictions.
Inadequate Safety Reporting
Tesla did not report crashes under standing general orders.
Management
Aggressive Sensor Removal
Management prioritized cost or simplicity over sensor redundancy.
Inadequate Risk Assessment
Management failed to assess risks of reduced user reaction times.
Regulatory Environment
Inadequate Reporting Enforcement
NHTSA rules on crash reporting for automated systems were not enforced.
Lack of Pre-market Approval
No regulatory framework prevented deployment of camera-only summon features.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
