This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
South Wales Police deployed NEC's NeoFace Watch facial recognition system at the 2017 Champions League final in Cardiff. The system produced a 92% false positive rate, incorrectly flagging over 2,000 innocent people. Following legal challenges, the Court of Appeal ruled the deployment unlawful, citing inadequate legal frameworks, insufficient data protection assessments, and a failure to properly evaluate the risk of demographic bias.
South Wales Police (SWP)’s automated facial recognition (AFR) at the Champion's League Final football game in Cardiff wrongly identified innocent people as potential matches at an extremely high false positive rate of more than 90%.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The Court of Appeal found that the police failed to comply with the Public Sector Equality Duty by not verifying if the software possessed racial or gender bias.
The primary failure was the facial recognition system's extremely high false positive rate of 92%, demonstrating a severe lack of capability and robustness under real-world deployment conditions.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the NeoFace Watch AI system generating an extremely high rate of false positive matches post-deployment, which was an unintentional outcome of its security monitoring goal.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
South Wales Police's unlawful deployment of NEC's facial recognition system at a major sporting event resulted in a 92 percent false positive rate, violating privacy rights for thousands. The subsequent landmark legal ruling established key precedents regarding the human rights and data protection boundaries of public biometric surveillance.
The NeoFace Watch system functions as a tool that performs the specific task of matching captured video frames against a database of custody images. It operates on direct CCTV inputs and produces match alerts without maintaining an independent goal-directed state or planning capabilities.
High Risk: The system is a law enforcement application using remote biometric identification (facial recognition) in public spaces, which is explicitly classified as high risk under the EU AI Act.
The system's primary function was to scan crowds and perform real-time facial recognition to identify individuals on a police watchlist.
The reports provide highly detailed, consistent factual accounts of the incident, including specific statistics on false positives (2,297 out of 2,470), the specific AI software used (NEC NeoFace Watch), and the detailed legal findings from the Court of Appeal ruling.
None; the facts of the deployment, the high error rate, and the subsequent legal ruling are uncontested.
Technology
High False Positive Rates
The NeoFace system had a 92% false positive rate at the Champions League.
Unknown Training Data Bias
Police did not know the training dataset, risking demographic bias.
Data Inputs
Poor Quality Watchlist Images
Low-quality photos from partner agencies like UEFA caused matching errors.
Blanket Biometric Processing
System scanned faces indiscriminately, processing data of innocent people.
Human Factors
Broad Officer Discretion
Officers had wide discretion on watchlist inclusion and deployment locations.
Process and Methods
Deficient Impact Assessments
DPIA failed to assess risks to rights and potential demographic bias.
No Bias Verification Process
No process was in place to test or verify the software for racial or sex bias.
Management
Lack of Transparency
Management kept demographic data and internal audits hidden from the public.
Insufficient Risk Oversight
Failed to establish redress mechanisms for individuals harmed by the tech.
Regulatory Environment
Inadequate Legal Framework
Lack of clear legal standards governing the deployment of live facial scans.
Non-compliance with PSED
Failure to meet Public Sector Equality Duty requirements before deployment.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
