This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Tesla recalled and disabled a 'rolling stop' feature in its Full Self-Driving (FSD) beta software after it was determined that the system allowed vehicles to enter all-way-stop intersections without coming to a complete halt. This functionality, which was active in certain driving profiles, was identified as potentially increasing collision risks and violating traffic laws. Tesla confirmed that while no crashes or injuries were reported, the feature was removed via an over-the-air firmware update.
The “rolling stop” functionality within the “Aggressive” Full Self Driving (FSD) profile that was released via a Tesla firmware update was recalled and disabled.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The FSD profiles allowed users to select 'Assertive' mode, which encouraged unsafe driving behaviors like smaller following distances and illegal rolling stops.
The FSD system's rolling stop feature represents a lack of capability or robustness to safely and legally navigate intersections, creating a safety risk that prompted a regulatory recall.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk is presented as the AI system's autonomous driving behavior, specifically its decision to perform rolling stops at intersections.
Tesla recalled its Full Self-Driving Beta software to disable a rolling stop feature that allowed vehicles to cross intersections without stopping, violating traffic laws. The recall affected over 53,000 vehicles but resulted in no crashes or injuries, presenting minor physical security risks that were managed through standard regulatory processes.
The FSD Beta system operates the vehicle autonomously in real-time, making driving decisions such as executing rolling stops based on environmental inputs without human intervention.
High Risk: AI systems used in critical infrastructure, such as road traffic management and autonomous vehicles, are classified as High Risk under the EU AI Act due to their significant implications for public safety.
The primary goal of Tesla's FSD Beta is to enable autonomous driving capabilities, allowing the vehicle to navigate and travel through intersections without human intervention.
The reports include official NHTSA recall documentation which provides precise figures (53,822 vehicles) and clear technical conditions under which the rolling stop feature activated. Media reports corroborate the details of the FSD profiles ('Chill', 'Average', 'Assertive') and the regulatory response, leaving very little ambiguity about the nature of the incident.
None
Technology
Rolling stop software design
Software allowed vehicles to travel through stop signs up to 5.6 mph.
Aggressive driving profiles
Profiles like Assertive reduced following distance and increased risk.
Flawed FSD beta software updates
Beta 10.3 released with bugs in left turns and unexpected stopping.
Data Inputs
Object detection reliance
System relied on detecting pedestrians, cyclists, and cars to roll stops.
Visibility and speed inputs
Relied on road speed limit and visibility data to trigger rolling stops.
Safety Score system data
System prioritized drivers based on controversial safety metrics.
Human Factors
Driver selection of risky modes
Drivers could select Assertive mode, choosing convenience over safety.
Misleading marketing names
Terms like 'Full Self-Driving' cause driver over-reliance on Level 2.
Over-reliance on Level 2 system
Drivers treating driver-assistance features as fully autonomous.
Process and Methods
Prioritizing rider preference
System designed to mimic human errors like rolling stops for convenience.
Public road beta testing
Testing unproven software with a large consumer fleet on public roads.
Lack of rigorous pre-release testing
Releasing updates like 10.3 that had to be immediately pulled.
Management
Prioritizing growth over safety
Management pushed out FSD beta updates despite unresolved safety issues.
Programming illegal maneuvers
Decision to program vehicles to violate traffic laws for user comfort.
Monetization of beta software
Increasing prices to 12,000 dollars while still in beta.
Regulatory Environment
Lack of proactive AV standards
No regulations prevented programming vehicles to perform illegal stops.
Delayed regulatory action
NHTSA intervened only after 53,822 vehicles received the software.
Lack of federal AV oversight
Regulators allowed beta expansion before resolving basic safety issues.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
