This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
During the Season Beta 1.1 Roborace event, two autonomous racing vehicles experienced significant navigation failures. One vehicle collided with a wall, while another suffered positioning errors that caused it to become lost on the track, leading to the termination of its race.
An autonomous Roborace car drove itself into a wall in round one of the Season Beta 1.1 race.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
The autonomous racing vehicles failed to perform reliably under racing conditions, resulting in a direct collision with a wall and positioning errors.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the autonomous driving systems of the racing cars failing to navigate the track correctly post-deployment, leading to an unintentional crash and positioning errors.
During a closed-track autonomous racing event, two self-driving cars suffered navigation and positioning failures, resulting in one crash and one vehicle getting lost. This was an unintentional technical failure during a research and entertainment event with negligible national security implications.
The report describes 'self-driving' and 'autonomous' racing cars navigating a track at high speeds and making real-time driving decisions without human intervention.
Minimal or No Risk: The AI systems are used in an autonomous racing competition, which is a form of entertainment and research on a closed track, posing low risk to public safety.
The AI systems were designed to pilot autonomous racing cars around a track without human intervention.
The report clearly describes the physical events of the race, including the crash of one vehicle and the positioning failure of another. There is no ambiguity about the AI's role or the outcomes.
None
Technology
Steering Control Anomaly
Car abruptly steered directly into a wall on a gentle curve.
Positioning System Error
Vehicle lost its tracking and got lost on the track.
Data Inputs
Positioning Data Loss
Loss of tracking data caused the vehicle to get lost.
Process and Methods
High-Speed Decision Deficit
Algorithms failed to react quickly enough at high racing speeds.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
No population impact data reported.
