This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
UnitedHealthcare and its subsidiary NaviHealth are facing a class-action lawsuit for allegedly using an AI tool called 'nH Predict' to systematically deny coverage for post-acute care to Medicare Advantage patients. The lawsuit claims the algorithm, which has a reported 90% reversal rate upon appeal, was used to override physician recommendations and pressure staff to meet strict length-of-stay targets, resulting in financial harm and premature discharge for vulnerable elderly patients.
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The AI's predictions overrode the clinical recommendations of treating physicians, and corporate targets stripped case managers of their decision-making discretion.
The nH Predict AI system failed to perform reliably or effectively by generating highly inaccurate, rigid predictions that resulted in a 90% error rate upon professional medical appeal.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The financial and physical harms were caused by the systematic deployment of the nH Predict AI tool to automate coverage denials post-deployment.
Added categories peak at 3: Substantial (Psychological Harm, Inferred)
UnitedHealthcare and NaviHealth faced legal and regulatory action for using the nH Predict AI tool to systematically deny post-acute care to Medicare Advantage patients. While causing physical and financial harm to individuals and disrupting federal program administration, the incident represents a regulatory and consumer protection issue with minor national security implications.
The AI system, nH Predict, is designed to analyze patient data and predict the required length of stay to assist insurers and care managers in discharge planning, though in practice, human discretion to deviate from its recommendations was severely restricted.
High Risk: The report describes an AI system used in healthcare to determine patient care and coverage, which falls under High Risk as it has significant implications for safety, fundamental rights, and public interests.
The AI system's primary function is to predict the length of stay and determine the allocation of post-acute care resources and insurance coverage for patients.
The reports are highly detailed, citing specific legal filings, investigative journalism (STAT News), corporate statements, and regulatory responses (CMS memo).
UnitedHealthcare claims the tool is only an advisory guide and that human medical directors make the final decisions, whereas the plaintiffs claim the AI effectively makes the decision due to strict corporate compliance targets.
The reports adequately support the classifications made.
Technology
Flawed nH Predict Algorithm
The model had a 90 percent error rate when predicting patient recovery times.
Rigid Length-of-Stay Predictions
System spits out generic estimates that override treating doctors' judgments.
Lack of Individual Nuance
The tool does not account for complex individual patient circumstances.
Data Inputs
Limited Patient Data Fields
Model only uses a small set of patient factors like age and diagnosis.
Historical Systemic Bias
The database of 6 million records inherits past cost-cutting inequalities.
Exclusion of Comorbidities
Database ignores critical clinical events like catching COVID-19 or pneumonia.
Human Factors
Lack of Patient Appeal Resources
Elderly patients lack the knowledge and resources to appeal denials.
Overreliance on AI Projections
Medical reviewers and case managers treat algorithm predictions as gospel.
Process and Methods
Automated Claims Denial Process
Insurers used automated tools to systematically cut off patient coverage.
Proprietary Data Restrictions
Insurers refused to share nH Predict reports, claiming they are proprietary.
Absence of Manual Reviews
Medical directors made adverse decisions without examining the patients.
Management
Prioritizing Profits Over Care
Management used the tool to reduce care costs and increase corporate profits.
Draconian Performance Targets
Managers forced employees to keep stays within 1 percent of AI predictions.
Disciplinary Action for Deviation
Employees who deviated from the algorithm faced discipline or termination.
Regulatory Environment
Vague Medicare Advantage Rules
Vague rules allowed insurers to use predictive tools to deny care.
Lack of CMS Enforcement
Absence of penalties and audits let insurers bypass original Medicare rules.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
