This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A 17-year-old student in North Carolina was struck by a 2022 Tesla Model Y while exiting a school bus. The vehicle was allegedly operating on Autopilot, and the driver had reportedly used weights to bypass the system's driver-monitoring safety features. The student suffered severe injuries, including a fractured neck and broken leg. This incident is part of a broader investigation into Tesla's driver-assistance technologies and their role in road accidents.
A 17-year-old student in Hollister, North Carolina who exited the school bus and was walking across the street to his house was hit by a 2022 Tesla Model Y allegedly operating on Autopilot mode, suffering a fractured neck and a broken leg.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The driver exhibited automation complacency, using steering wheel weights to bypass safety checks and failing to maintain active oversight of the vehicle.
The Tesla Autopilot system failed to perform reliably by failing to detect and stop for a clearly marked, stopped school bus, demonstrating a lack of capability and robustness in real-world driving conditions.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Tesla Autopilot system failing to detect and stop for a school bus post-deployment, resulting in an unintentional collision.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A localized traffic accident in North Carolina where a student was injured by a Tesla on Autopilot. The driver bypassed safety features using steering wheel weights. The incident represents a minor physical safety concern regarding consumer autonomous systems, but carries negligible implications for broader national security.
The Tesla Model Y was operating in Autopilot mode, which is designed to maneuver the vehicle, maintain speed, and respond to road hazards in real-time without human intervention, though it requires driver monitoring.
High Risk: The system is used in critical infrastructure and transport safety, specifically as an advanced driver-assistance system in road traffic management where failures can result in severe physical injury or death.
The Tesla Autopilot system's primary function is to autonomously control the steering, acceleration, and braking of the vehicle on the roadway.
The reports provide clear, detailed, and consistent accounts of the specific crash, the injuries sustained, the driver's actions (using weights to bypass safety checks), and the broader context of NHTSA investigations into Tesla Autopilot.
The crash could be interpreted purely as a case of driver negligence and distracted driving rather than an AI safety failure, given the driver's intentional bypass of safety features.
Technology
Autopilot Detection Failure
System failed to detect and slow down for the stopped school bus.
Easily Bypassed Safeguards
Steering wheel pressure check was bypassed with aftermarket weights.
Lack of Redundant Sensors
Removal of radar sensors left the system reliant solely on cameras.
Data Inputs
Missing Radar Sensor Data
Stripping vehicles of radar deprived the AI of critical distance data.
Camera-Only Vision Limitations
Camera inputs alone failed to resolve the school bus hazard.
Human Factors
Automation Complacency
Driver over-trusted the system, leading to severe distraction.
Active System Deception
Driver attached weights to the wheel to trick the hands-on sensor.
Misleading System Naming
The term 'Autopilot' encouraged drivers to believe the car was autonomous.
Process and Methods
Public Beta Testing of FSD
Testing experimental software on public roads with untrained drivers.
Inadequate Safety Verification
Deploying updates to fix critical flaws only after incidents occurred.
Management
Aggressive Rollout of FSD
Expanding FSD from 12k to 400k users increased exposure to crashes.
Removal of Critical Sensors
Management stripped radar sensors from vehicles to simplify hardware.
Prioritizing Deployment over Safety
Management pushed technology deployment despite known safety flaws.
Regulatory Environment
Lack of Strict AV Regulations
Absence of federal standards preventing deployment of unverified AV tech.
Redaction of Safety Critical Data
Tesla redacted software details from public NHTSA crash databases.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
