This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Tesla's Autopilot and Full Self-Driving (FSD) systems have been documented repeatedly misidentifying objects such as the moon, billboards, and signs as traffic signals. These misclassifications cause the vehicles to brake unexpectedly, creating hazardous conditions for the driver and surrounding traffic. Despite Tesla's marketing, the FSD software remains in beta and requires constant human intervention to prevent collisions and erratic driving behavior.
Tesla's Autopilot was shown on video by its owner mistaking the moon for a yellow stop light, allegedly causing the vehicle to keep slowing down.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The marketing of the system as 'Full Self-Driving' encourages users to rely on it, creating safety risks when they must suddenly intervene to correct critical system failures.
The incident is primarily characterized by the AI system's failure to perform robustly and reliably under real-world conditions, misclassifying common environmental objects like the moon and signs.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The safety risks and erratic driving behaviors were caused by the AI system's perception errors and unexpected braking actions after being deployed to consumers.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
Tesla's FSD Beta exhibited perception failures, misidentifying objects like the moon as traffic signals and causing erratic braking. While presenting local road safety hazards, the incident carries negligible national security risk as it is a commercial product issue requiring human supervision and is manageable through standard regulatory frameworks.
The Tesla FSD system operates independently in real-time, making driving decisions such as steering, accelerating, and braking based on its perception of environmental inputs without explicit human planning.
High Risk: The AI system is used as a safety component in road vehicles, which has significant implications for public safety and is subject to strict regulatory requirements.
The primary goal of Tesla's FSD and Autopilot systems is to enable autonomous driving by navigating roads and reacting to traffic conditions.
The reports provide detailed, first-hand accounts of the AI system's behavior, backed by social media video evidence and professional journalistic testing. The system's failures are clearly documented without conflicting narratives.
None. The incidents are clearly software perception and control failures rather than driver error.
Technology
Flawed Object Classification
Deep learning models misidentify celestial bodies and signs as traffic lights.
Lack of Spatial Depth Perception
System fails to recognize that the moon is extremely far away.
Erratic Path Planning Algorithms
Software executes jerky turns and sudden, random braking maneuvers.
Data Inputs
Ambiguous Visual Stimuli
System cannot distinguish 2D billboard signs or the moon from real signals.
Unstructured Urban Environments
Chaotic streets with dense traffic, pedestrians, and construction zones.
Human Factors
Driver Fatigue and Stress
Drivers must remain constantly on guard to prevent sudden system failures.
Over-reliance on Human Intervention
Safety model assumes the driver can react instantly to erratic maneuvers.
Process and Methods
Inadequate Edge Case Validation
Failing to test and resolve obvious environmental bugs before release.
Reliance on Post-Release Patches
Fixing critical driving bugs only after they are reported by users.
Management
Premature Marketing Promises
CEO promises full autonomy while the system is still highly flawed.
Public Deployment of Beta Software
Releasing unfinished safety-critical software to untrained public drivers.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
