This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
An analysis of internal Chicago Police Department records from 2017-2018 revealed that the ShotSpotter gunshot detection system had an accuracy rate of approximately 47% in identifying confirmed shootings in the city's tenth district. The system frequently failed to alert officers to incidents where individuals were struck by gunfire, raising concerns about delayed emergency responses and the efficacy of the technology as a public safety tool.
SoundThinking's (formerly ShotSpotter's) system in Chicago, with a reported 47% accuracy rate for detecting actual gunshots, led to potential public safety risks by failing to alert police to real shootings, possibly delaying emergency response to violent incidents and misdirecting law enforcement resources.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The technology was disproportionately deployed in Black and brown communities, leading to concerns about systemic bias and dangerous over-policing in these neighborhoods.
The Chicago Police Department continued to rely on and expand the system despite internal data showing it missed more than half of the shootings where people were struck.
The ShotSpotter system failed to perform reliably under operational conditions, achieving only a 47% accuracy rate and missing 72 actual shooting incidents.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the ShotSpotter AI system failing to perform its intended function of detecting gunshots, which was an unintentional and unexpected failure post-deployment.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
The performance failure of the ShotSpotter gunshot detection system in Chicago represents a local public safety and civil liberties concern rather than a national security threat. While the 47 percent accuracy rate and disproportionate deployment in minority neighborhoods raise significant municipal policy, privacy, and human rights questions, the incident does not impact national critical infrastructure, sovereignty, or strategic security.
The ShotSpotter system operates as a tool designed to perform a specific, well-defined function: detecting and localizing acoustic gunshot sounds based on direct sensor inputs without maintaining long-term context or executing complex autonomous plans.
High Risk: The system is used in law enforcement applications, specifically for gunshot detection and police deployment, which is explicitly classified as high risk under the EU AI Act.
The primary goal of the ShotSpotter system is to detect and locate outdoor gunfire in real-time using acoustic sensors.
The report provides highly detailed, empirical data from internal Chicago Police Department tracking spreadsheets, including specific accuracy rates (47%) and the exact number of missed shooting incidents (72 out of 135). It also details the financial contracts and community responses, leaving very little ambiguity about the system's performance and deployment context.
None
While details on the specific medical outcomes of the missed shooting victims would be valuable, the available information is fully sufficient to classify the incident and assess the primary risks.
Technology
Low Gunshot Detection Accuracy
System only detected 47 percent of shootings where a person was struck.
Outdoor Gunfire Design Limitation
System is designed only for outdoor gunfire, missing indoor shootings.
Data Inputs
Flawed Validation Data
Accuracy studies relied on self-reported police data instead of field tests.
Acoustic Signal Classification
Validation focused on sound classification rather than overall detection.
Human Factors
Leadership Overreliance
Superintendents defended technology despite documented performance failures.
Lack of Operator Understanding
Officers and public misunderstood how acoustic detection actually works.
Process and Methods
Inadequate Performance Tracking
CPD lacked standardized processes to track and map missed gunshots.
Flawed Study Methodology
Commissioned studies failed to conduct independent field testing.
Management
Ignoring Performance Reports
Leadership signed contract extensions despite known 47 percent accuracy rate.
Prioritizing Tech Rebranding
CPD prioritized high-tech policing to rebuild trust amidst legitimacy crisis.
Regulatory Environment
Lack of Independent Oversight
No regulatory body audited the performance claims of the surveillance system.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
