This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A 32-year-old patient died after a delayed transfer to an intensive care unit in Minas Gerais, Brazil. Her family alleges that the state's new AI-assisted bed regulation system, Core-MG, incorrectly assigned her a lower severity score than her clinical condition warranted, preventing timely prioritization. The state health department denies system failure, asserting that physicians continue to oversee clinical assessments.
The family of a 32-year-old patient in Minas Gerais, Brazil, alleged that Core-MG, an AI-assisted hospital-bed allocation system, understated her condition and delayed intensive care. Her sister said the severity score impeded reprioritization. The patient died hours after transfer. The state health department denied a system failure in her case and said physicians assessed patients according to clinical need and bed availability.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The system reportedly stripped doctors of their autonomy to override the AI-generated severity score, preventing them from prioritizing a critical patient.
The Core-MG system failed to perform reliably by misclassifying a critically ill patient's severity, leading to a delayed transfer.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the Core-MG AI system's scoring algorithm failing to accurately reflect the patient's clinical severity, which was an unintended failure of the deployed system.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
The failure of the Core-MG AI bed regulation system in Brazil led to a patient's death and disrupted regional healthcare infrastructure. While highlighting significant risks in deploying AI for critical public services and the danger of reducing human clinical autonomy, the incident remains a localized administrative and public health crisis with minor national security implications.
The Core-MG system is described as an AI-assisted platform designed to 'assist in the classification of patients and definition of priorities', which fits the Assistant profile as it is meant to augment human medical regulators.
High Risk: The system is an 'AI used in healthcare' and critical public infrastructure, specifically for regulating hospital beds and prioritizing emergency patient transfers.
The primary goal of Core-MG is to allocate hospital beds and prioritize patient transfers. It also acts as a medical diagnosis support tool by calculating clinical severity scores to assist doctors.
The reports provide clear, detailed accounts of the patient's death, the family's specific complaints about the AI scoring system, and the broader systemic issues verified by municipal lawsuits. While the technical details of the algorithm are not fully explained, the operational impact and the role of the AI are clearly documented.
The incident could be interpreted as a general administrative/IT transition failure rather than an AI-specific failure, but the explicit use of AI for patient prioritization makes the AI safety classification highly appropriate.
Technology
Rigid Priority Algorithm
Algorithm assigned low score and restricted manual severity overrides.
Centralized Bed Allocation
Centralized system failed to account for regional distances and transport.
Operational Instabilities
Platform transition caused system errors and data migration failures.
Data Inputs
Flawed Patient Scoring Data
Patient severity score of 6.8 did not reflect critical clinical state.
Incomplete Regional Context
System inputs lacked geographic, logistical, and transport capability data.
Inadequate Data Migration
Transition occurred without automated or proper data migration from SUSFacil.
Human Factors
Loss of Clinical Autonomy
Doctors could not override system scores to prioritize urgent transfer.
Lack of Professional Training
System was implemented without sufficient training for healthcare staff.
Process and Methods
Sudden System Transition
Abrupt switch to Core/MG without a gradual, safe transition phase.
Inflexible Prioritization Process
Rigid queue rules prioritized patients with minor score differences over her.
Centralized Coordination Model
Shifted coordination from macro-regions to centralized Belo Horizonte.
Management
Rushed System Deployment
Management deployed Core-MG without validating regional operational readiness.
Poor Transition Planning
Inefficient management of data migration and risk mitigation during rollout.
Regulatory Environment
Overruled Judicial Suspensions
Government overrode judicial decisions to suspend the unstable Core system.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
