This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
During the COVID-19 pandemic, Walmart's Everseen AI-based theft-deterrence system generated frequent false positives, requiring employees to intervene in customer transactions. This increased physical contact between staff and customers, which employees argued created an unnecessary health risk during a period of high viral transmission.
Walmart's theft-deterring bagging-detection system allegedly exposed workers to health risks during the coronavirus pandemic when its false positives prompted workers to unnecessarily step in to resolve the issue.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
The incident was primarily caused by the Everseen AI system's lack of robustness, specifically its high rate of false positives that incorrectly flagged legitimate transactions.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk arose from the AI system's unintentional false positive errors occurring after its deployment in retail stores.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
Walmart's deployment of Everseen's AI theft-deterrence system during the COVID-19 pandemic resulted in high false-positive rates, forcing employees into close contact with customers. While this raised valid workplace safety and public health concerns for essential workers, the incident remains a commercial operational failure with negligible national security implications.
The system independently monitors customer movements using computer vision and makes real-time decisions to flag potential non-scans and alert employees without direct human prompting.
Minimal or No Risk: The system is a retail theft-deterrence tool, which generally poses low risk to users and society under normal conditions, falling outside the high-risk categories defined in the Act.
The system's primary purpose is theft deterrence by detecting unscanned items, which is a form of threat/loss detection, utilizing camera tracking to monitor customer movements.
The report provides clear, detailed accounts of the AI system's deployment, its specific technical failure (false positives), and the resulting real-world safety risks for employees. The causal link between the AI's errors and the increased health risk is well-established.
The incident could be viewed primarily as a labor management issue regarding pandemic safety protocols rather than an AI safety failure, though the AI's technical inaccuracy was the direct trigger for the safety protocol violations.
Technology
Frequent False Positives
The system flagged legitimate scans as 'non-scans' triggering alerts.
Computer Vision Limitations
Algorithms struggled to accurately differentiate bagging from scanning motions.
Data Inputs
Unsynchronized Motion Data
Discrepancies between camera tracking and register logs caused false alerts.
Human Factors
Forced Physical Proximity
Alerts forced employees to approach customers, violating social distancing.
Varied Shopper Behaviors
Diverse customer handling of items led to misinterpretation by the AI.
Process and Methods
Removal of Weight Sensors
Replacing physical sensors with AI removed a backup validation method.
Proximity-Based Alert Resolution
The resolution protocol required physical intervention rather than remote checks.
Management
Prioritizing Asset Protection
Management prioritized inventory loss prevention over employee health.
Failure to Suspend System
Corporate chose to keep the error-prone system active during the pandemic.
Regulatory Environment
Inadequate Pandemic Mandates
Lack of enforceable retail safety rules allowed high-contact systems to remain.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
