This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Honda's Collision Mitigation Braking System (CMBS) has been the subject of numerous consumer complaints and class-action lawsuits due to 'false positive' obstacle detection. The system, which uses radar and cameras to trigger automatic braking, has reportedly engaged without cause, leading to sudden deceleration, whiplash injuries, and property damage. Plaintiffs allege that the manufacturer failed to disclose these safety defects and that the system's design is inherently flawed, creating risks rather than mitigating them.
Honda's Collision Mitigation Braking System (CMBS) allegedly caused accidents to consumers due to frequent instances of false obstacle detection.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The report also discusses a fatal Tesla crash where occupants reportedly operated the vehicle in an unsafe 'driverless' mode, demonstrating overreliance on Autopilot.
The incident is primarily a lack of capability or robustness because the CMBS failed to perform reliably, falsely detecting obstacles and executing sudden, unsafe braking maneuvers.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The sudden braking is caused by the AI-driven CMBS making incorrect decisions post-deployment, which was an unintentional outcome of its collision avoidance programming.
The incident involves safety defects in Honda's Collision Mitigation Braking System and Tesla's Autopilot, leading to phantom braking, injuries, and lawsuits. While presenting serious consumer safety and regulatory challenges, the national security impact is negligible, as it does not involve malicious actors, critical infrastructure attacks, or threats to state sovereignty.
The CMBS operates independently to scan the environment and make real-time braking decisions based on sensor inputs. The report states the system 'applies brake pressure when an unavoidable collision is determined' without human intervention.
High Risk: The system is integrated into critical transport infrastructure and vehicle safety systems. The report notes that 'automated vehicles, which depend on technologies like automatic emergency braking, hold the promise of being the means that will prevent human choice or error'.
The primary goal of the CMBS is to assist in autonomous driving functions by automatically detecting threats and applying brakes to avoid collisions.
The report provides clear, firsthand and legal accounts of the CMBS failures, detailing the technology, the nature of the malfunction, and the resulting physical injuries and lawsuits. The details are consistent across multiple sources cited.
The sudden braking could be interpreted as hardware sensor failure rather than software/AI decision-making, though the report argues it is primarily an AI software fault.
Technology
Imperfect Software Coding
Programs contain bugs or design errors that lead to phantom braking.
Radar and Camera False Positives
Sensing tech falsely detects obstacles from opposing traffic.
GPS Signal Vulnerability
AI systems rely on imperfect GPS signals susceptible to dropouts.
Data Inputs
False Hazard Detection
Sensing system falsely identifies non-hazards as imminent collisions.
Human Factors
Driver Distraction from Warnings
Numerous false warning messages distract drivers from watching the road.
Lack of Driver Education
Dealership reps fail to explain AI features and risks to buyers.
Process and Methods
Inability to Predict Variables
Software fails to account for unpredictable real-time driving variables.
Limited Programmer Imagination
Software choices only cover scenarios the programmers could anticipate.
Management
Failing to Disclose Defects
Selling vehicles despite knowing about safety defects in the system.
Hubris in AI Capabilities
Belief that software can outperform human drivers in all conditions.
Regulatory Environment
Government Pressure to Deploy AI
NHTSA pushes for rapid AI deployment to mitigate human driver errors.
Lack of Mandatory Standards
Courts block some lawsuits because NHTSA lacks clear mandatory standards.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
