This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Researchers analyzed the impact of algorithmic risk assessment tools in Virginia's criminal justice system, finding that they failed to reduce incarceration rates or recidivism. The tools led to harsher sentencing for young defendants and exacerbated racial disparities, as judges used the scores inconsistently and often as a rationalization for existing biases.
Virginia courts’ use of algorithmic predictions of future offending risks were found by researchers failing to reduce incarceration rates, showed racial and age disparities in risk scores and its application, and neither exacerbated or ameliorated historical racial differences in sentencing.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
Judges relied on the algorithmic scores to rationalize harsher sentences or to shield themselves from public backlash, using the tool in critical situations without adequate training.
The algorithm struggled because predicting future recidivism is extremely difficult, and the tool failed to perform reliably or effectively in predicting actual risk.
The algorithmic risk assessment tool introduced and exacerbated unfair sentencing outcomes and systemic discrimination against young and Black defendants based on demographic characteristics.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The negative outcomes, including increased racial and age disparities and lack of incarceration reduction, were unexpected and unintended consequences of deploying the algorithmic risk assessment tool.
Added categories peak at 3: Substantial (Psychological Harm, Inferred)
Virginia's deployment of algorithmic sentencing tools led to unintended racial and age disparities in criminal sentencing. While causing localized civil and human rights concerns, the incident has negligible national security implications and is manageable through domestic legal and policy reforms.
The AI system acts as an Assistant, providing risk scores and recommendations to aid judicial discretion in sentencing, while requiring human judges to make the final decisions.
High Risk: The system is used in the administration of justice and law enforcement, specifically to assist judges in sentencing decisions, which has significant implications for fundamental rights and liberty.
The primary function of the algorithm was to predict the risk of recidivism for defendants, which was then used as judicial decision support for sentencing.
The reports are based on a rigorous academic working paper analyzing tens of thousands of felony convictions in Virginia, providing clear statistical evidence of the algorithm's impact on sentencing, racial disparities, and age disparities. The roles of both the AI system and the human judges are explicitly detailed.
None
Technology
Age-Biased Risk Scoring
Algorithm heavily weighted age, inflating scores for young defendants.
Poor Recidivism Predictability
The tool failed to accurately predict future crime or recidivism rates.
Flawed Sex Offender Scoring
Scoring enabled lower sentences for rapists by shielding judges from blame.
Data Inputs
Biased Demographic Proxies
System used age and marital status as proxies, driving systemic disparities.
Biased Historical Data
Input data reflected historical racial disparities in the justice system.
Human Factors
Lack of Judicial Training
Judges received almost no training on how to interpret risk scores.
Algorithmic Rationalization
Judges used the tool to justify decisions they already wanted to make.
Asymmetric Risk Aversion
Judges feared public backlash unless protected by a low-risk score.
Process and Methods
Unchecked Judicial Discretion
Judges could ignore or apply risk recommendations without accountability.
Lack of Diversion Programs
Some jurisdictions lacked infrastructure to support rehabilitation paths.
Inconsistent Implementation
The tool was deployed without standardizing how judges should use it.
Management
Inadequate Risk Assessment
Management failed to anticipate unintended impacts on vulnerable groups.
Conflicting System Objectives
Tool design goals conflicted with judges' individual sentencing criteria.
Lack of System Accountability
Management did not correct documented racial and age disparities.
Regulatory Environment
Advisory-Only Policy
Advisory nature of the tool meant compliance was entirely optional.
Abolition of Discretionary Parole
State policy changes forced reliance on algorithms to manage prison capacity.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
