This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The Department of Justice's PATTERN recidivism risk assessment tool was found to produce racially biased results, leading to the misclassification of thousands of inmates. The algorithm disproportionately overpredicted the risk for Black, Hispanic, and Asian inmates, which restricted their access to early-release programs under the First Step Act. The Justice Department has acknowledged these disparities and is currently working on revisions to the tool.
Department of Justice’s inmate-recidivism risk assessment tool was reported to have produced racially uneven results, misclassifying risk levels for inmates of color.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The system suffered from fundamental math and human errors that led to the misclassification of 14,000 individuals.
The PATTERN algorithm demonstrated unequal accuracy and performance across demographic groups, overpredicting recidivism risk for Black, Hispanic, and Asian inmates compared to white inmates.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The racial disparities and misclassifications were caused by the PATTERN AI system's biased risk predictions after it was deployed in the federal prison system.
Added categories peak at 3: Substantial (Psychological Harm, Inferred)
The Department of Justice's PATTERN risk assessment tool produced racially biased results, misclassifying approximately 14,000 inmates and restricting eligible inmates of color from early-release programs. While causing notable domestic civil rights concerns, the incident has minimal direct implications for broader national security.
The PATTERN algorithm operates as a Tool, performing the specific function of calculating recidivism risk scores based on static input factors to categorize inmates, without maintaining an independent internal state or executing autonomous plans.
High Risk: The PATTERN algorithm is used in law enforcement and the administration of justice to determine eligibility for early prison release, which directly impacts individual liberty and fundamental rights.
The PATTERN algorithm was specifically designed and deployed to predict the risk of recidivism (returning to crime) among federal inmates to determine early-release eligibility.
The report provides clear, authoritative details from the Justice Department's own findings, including the specific number of affected individuals (14,000) and the nature of the racial disparities. There is high consensus among the sources cited, and the role of the PATTERN algorithm is explicitly defined.
None. The facts of the algorithmic bias and its consequences are uncontested by the Justice Department.
Technology
Mathematical and Coding Errors
The algorithm suffered from math errors that misclassified 14,000 inmates.
Algorithmic Overprediction
Pattern overpredicted recidivism risk for Black, Hispanic, and Asian inmates.
Algorithmic Underprediction
Pattern underpredicted violent recidivism risk for some inmates of color.
Data Inputs
Biased Criminal History Data
Criminal history inputs reflect systemic overpolicing of minority communities.
Socioeconomic Proxy Factors
Education and restitution factors correlate heavily with race and class.
Human Factors
Human Programming Errors
Developers made manual and logical errors during the implementation phase.
False Aura of Objectivity
Users trusted the tool's 'patina of science' over critical human judgment.
Process and Methods
Rushed Tool Development
The Justice Department rushed the tool's creation to meet tight deadlines.
Inadequate Testing and Validation
The initial roll-out lacked rigorous validation to detect disparate impact.
Management
Rushed Implementation Decisions
Management pushed the tool live despite known flaws and racial disparities.
Lack of Transparency
Management failed to provide open auditing or transparent risk assessment.
Regulatory Environment
Strict Congressional Deadlines
Congress imposed tight statutory deadlines under the First Step Act.
Lack of Auditing Standards
No formal regulatory oversight was initially required for algorithmic fairness.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
