An AI-equipped 'Smart Tram' in Saint Petersburg, Russia, crashed during a test run, injuring multiple pedestrians. The incident occurred after the AI system reportedly shut off unexpectedly and the tram's primary and emergency braking systems failed to stop the vehicle. Authorities have launched a criminal investigation into the incident.
During a test run in Saint Petersburg in Russia a reportedly AI-powered "Smart Tram" failed, leading to a crash that injured several pedestrians and trapped a woman under its wheels. The tram's AI system reportedly shut off unexpectedly, and both primary and emergency brakes failed despite pre-test checks.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
The AI system failed to perform reliably, turning off unexpectedly during operation, which contributed to a catastrophic braking failure and subsequent crash.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the unexpected shutdown of the AI driver assistance system during an active test run on public tracks.
Added categories peak at 2: Minor (Psychological Harm, Direct)
A localized transit accident in Saint Petersburg, Russia, involving an AI-equipped 'Smart Tram' that crashed during a test run due to system shutdown and braking failure. While resulting in pedestrian injuries and representing a setback for municipal driverless transit plans, the incident carries negligible to minor national security implications.
The tram was designed to eventually operate as a 'smart unmanned tram' and was undergoing testing to 'remove human factors', indicating a high degree of independent operation.
High Risk: The AI system was deployed in public transport infrastructure, which is classified as critical infrastructure under the EU AI Act.
The AI system was designed as a driver assistance system for a smart tram, aiming towards fully driverless operation.
The reports provide clear details about the crash, the parties involved, the specific technical failure of the AI system shutting down, and the resulting physical injuries.
The brake failure could be viewed as a purely mechanical issue independent of the AI system, though reports link the two events directly.
Technology
AI System Sudden Shutdown
The AI driver assistance system unexpectedly turned off during the test run.
Primary Brake Failure
The main braking system failed when the driver attempted to reduce speed.
Emergency Brake Malfunction
The backup emergency brake system did not fully work when applied.
Process and Methods
Inadequate Integration Testing
Integration between AI control and mechanical brakes was not fully verified.
Management
Premature Public Track Testing
Testing experimental AI systems on public tracks with active pedestrians.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.