An XPeng P7 vehicle operating in Navigation Guided Pilot (NGP) mode collided with a flatbed truck on a highway in Shandong, China. The system failed to identify the truck, likely due to the vehicle's unusual shape, leading to a crash that caused slight injuries to the driver. XPeng Motors stated that the system's sensors and warning functions were operating normally prior to the collision.
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The driver over-relied on the assisted driving system, trusting it to slow down automatically and failing to intervene in a timely manner.
The incident was primarily caused by the AI system's failure to perform reliably under varying conditions, specifically failing to recognize an unusually shaped flatbed truck.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The collision was caused by a failure of the XPeng P7's visual perception AI system to detect the flatbed truck, which was an unexpected outcome during its post-deployment operation.
An unintentional highway collision involving an XPeng P7 vehicle in assisted driving mode failing to detect a flatbed truck. The incident represents a localized consumer safety failure with negligible national security implications.
The XPeng P7 was operating in NGP mode, which is described as an 'automatic navigation assisted driving system' that requires human oversight and driver intervention when necessary.
High Risk: The system is an assisted driving feature used in transport/critical infrastructure, where failures can directly endanger human safety and physical health.
The system's primary function is to assist in driving and navigation, controlling the vehicle's speed and path autonomously under human supervision.
The report provides clear details about the vehicle, the specific driving mode (NGP), the nature of the collision, the technical hypothesis for the perception failure, and the resulting minor injuries.
The incident could be viewed primarily as driver negligence due to overreliance, but the technical failure of the perception system to detect a large vehicle is the primary trigger.
Technology
Visual Perception Failure
Visual camera failed to recognize the unusually shaped flatbed truck ahead.
Inaccurate Distance Identification
The system did not accurately identify the distance of the front vehicle.
Data Inputs
Unusual Vehicle Shape
The flatbed truck had an extended tail with no cargo, causing misjudgment.
Human Factors
Driver Overreliance on System
The driver trusted the system to slow down and failed to intervene in time.
Delayed Driver Intervention
Driver did not take manual control despite approaching the truck rapidly.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.