This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Two autonomous food delivery robots operated by Serve Robotics and Coco crashed into separate bus shelters in Chicago, shattering the glass structures and prompting public safety concerns.
A Serve Robotics delivery robot reportedly struck a glass bus shelter in Chicago's West Town neighborhood, shattering panels and scattering glass across the sidewalk. The company said all three sensor systems failed to detect the wall and later changed how its robots operate near bus shelters while updating their perception software and hardware.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
The robots failed to perform reliably under real-world conditions due to a technical limitation where their sensor systems failed to detect glass walls.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The crashes were caused by the autonomous navigation and sensor systems of the deployed robots failing to detect glass obstacles.
Two autonomous delivery robots suffered simultaneous sensor failures and collided with bus shelters in Chicago, causing minor property damage. The incident represents a local municipal safety and regulatory concern with negligible implications for national security.
The delivery robots operate independently on public sidewalks, navigating and reacting to environmental obstacles in real-time without active human intervention.
High Risk: The AI systems operate in public spaces and interact with physical infrastructure, posing direct physical safety risks to pedestrians and public property.
The robots are designed to autonomously navigate and drive along city sidewalks to deliver food orders to customers.
The report provides clear, factual accounts of two distinct incidents, including the locations, the companies involved, the technical explanation for one failure, and the community response.
None
Technology
Simultaneous Sensor Failure
Three sensor systems failed to detect the bus shelter at the same time.
Glass Interpretation Flaw
The navigation system could not properly interpret glass environments.
Data Inputs
Inadequate Glass Reflection Data
Sensor inputs failed to recognize transparent or reflective glass surfaces.
Process and Methods
Lack of Zone-Specific Caution
Robots did not slow down or behave carefully when near bus shelters.
Management
Premature Urban Deployment
Management deployed robots before verifying reliability around glass structures.
Regulatory Environment
Unstructured Pilot Program
The city pilot allowed sidewalk operation without robust safety verification.
