This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A facial recognition system deployed by Ningbo police for jaywalking enforcement incorrectly identified the face of a prominent businesswoman, Dong Mingzhu, from an advertisement on the side of a passing bus. The system subsequently displayed her image and partial ID information on a public shaming billboard. The police later acknowledged the error and stated that the system would be upgraded to improve accuracy.
Facial recognition system in China mistakes celebrity's face on moving billboard for jaywalker
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The system publicly exposed the victim's name and partial government ID number on a public billboard.
The system generated and publicly displayed a false accusation that the victim had committed a traffic violation.
The AI system failed to perform robustly under real-world conditions because it lacked liveness detection, mistaking a 2D advertisement on a moving bus for a 3D human pedestrian.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Intellifusion DeepEye AI system making an erroneous identification post-deployment, which was an unintended failure of its classification capabilities.
A municipal facial recognition system in China autonomously and incorrectly identified a prominent businesswoman from a bus advertisement as a jaywalker, displaying her details on a public shaming billboard. The incident highlights minor localized human rights and privacy concerns regarding automated surveillance systems but has negligible broader national security impact.
The system operates independently in real-time, capturing images from traffic cameras, matching them against databases, and displaying results on public screens without human intervention in the loop.
High Risk: The system is a real-time biometric identification and law enforcement application used by state authorities for public surveillance and traffic management.
The system's primary function was to perform real-time facial recognition on pedestrians to identify jaywalkers, operating as part of a smart surveillance network.
The reports are highly consistent across multiple reputable news outlets, providing clear details of the technical failure, the parties involved, and the resolution.
None
Technology
Lack of Liveness Detection
System failed to distinguish 2D bus ad from a real 3D human.
No Speed or Motion Filtering
System did not filter out faces moving at vehicle speeds.
Database Mismatch Error
System misidentified the surname as Ju during database lookup.
Data Inputs
Bus Advertisement Image
A large, high-resolution portrait on a moving bus was captured.
Unvalidated Reference Database
Database entries contained errors leading to incorrect name mapping.
Human Factors
Lack of Human Verification
No human operator verified the AI's match before public display.
Overreliance on AI Accuracy
Operators assumed the facial recognition system was infallible.
Process and Methods
Automated Public Shaming
Process immediately displays suspected offenders on public screens.
Inadequate System Testing
System deployed without testing against common urban visual noise.
Management
Rapid Surveillance Scaling
Prioritized rapid deployment over technical accuracy and safety.
Vendor Quality Oversight
Police accepted the AI system without rigorous edge-case testing.
Regulatory Environment
Weak Privacy Protections
Inadequate laws allowed rapid deployment of invasive surveillance.
Absence of AI Standards
No regulatory standards required liveness checks in public systems.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
