This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Evolv Technology's AI-powered weapons scanners were found to have significant reliability issues, including failing to detect weapons and generating high rates of false positives. The FTC alleged that the company deceptively marketed the system's accuracy, leading schools to rely on ineffective security measures. These failures resulted in operational chaos and, in at least one instance, a failure to detect a knife used in a student stabbing.
Evolv's AI-powered weapons scanners were advertised as superior to metal detectors but reportedly failed to detect actual weapons while generating excessive false positives. The FTC alleged that misleading claims about the system's accuracy and speed contributed to schools relying on unreliable detection, with at least one incident in October 2022 involving a missed knife that resulted in a student being stabbed.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
School districts placed inappropriate trust in the unproven AI system for critical safety, leading to a false sense of security and a failure to prevent a physical attack.
The primary issue is the AI system's lack of capability and robustness, as it failed to reliably detect weapons while generating high rates of false alarms on benign objects.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Evolv Express AI system failing to perform its core function of detecting weapons, which was deployed post-training in schools.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
AI-powered weapons scanners deployed in US schools failed to detect actual weapons (resulting in a student stabbing) and generated high rates of false positives. While causing operational disruption and localized safety failures, the incident represents a minor national security threat, highlighting vulnerabilities in AI procurement and performance verification for public safety.
The Evolv Express system operates independently in real-time, using learned patterns to scan individuals and autonomously decide whether to trigger a threat alert based on sensor inputs.
High Risk: The AI system is used as a safety component in critical public infrastructure (schools and public transit) and for law enforcement/security screening, which has significant implications for public safety and fundamental rights.
The primary function of the Evolv Express system is to detect concealed weapons (threats) such as guns and knives using AI-powered sensors.
The reports provide extensive, concrete evidence from FTC complaints, SEC investigations, and internal school district emails obtained via public records requests, detailing specific technical failures and operational impacts.
None. The failure of the AI system to perform as advertised is well-documented by regulatory bodies and internal communications.
Technology
Flawed Classification Algorithm
AI failed to distinguish weapons from everyday items like school binders.
Sensitivity Calibration Tradeoff
Lower settings missed Glocks while higher settings caused extreme false alarms.
Brittle Hardware and Software
Scanners suffered frequent error messages and required manual updates.
Data Inputs
Misclassified Everyday Objects
Laptops, binders, and umbrellas were misidentified as concealed weapons.
Human Factors
Blind Trust in Vendor Claims
Administrators bought unproven AI systems without independent verification.
Operator Distraction
Guards focused entirely on manual bag searches instead of hall monitoring.
Process and Methods
Lack of Independent Testing
Districts failed to test if the scanners actually detected common handguns.
Deceptive Marketing Practices
Vendor falsely claimed 70 percent labor reduction and perfect detection.
Inefficient Maintenance Process
Software updates required tedious manual on-site programming by technicians.
Management
Prioritizing Sales Over Safety
Evolv marketed unproven AI scanners to exploit school safety anxieties.
Suppression of Product Flaws
Evolv hid instruction manuals and accused critics of endangering children.
Ignoring Critical Test Results
School boards ignored warnings that default settings failed to detect Glocks.
Regulatory Environment
Absence of AI Safety Standards
No federal standards verified AI weapons detection claims before deployment.
Delayed Oversight Enforcement
FTC and SEC investigations occurred only after widespread school deployment.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
