This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A software developer was erroneously fired by his company's automated personnel management system after his manager failed to renew his contract during a corporate transition. The system automatically revoked his building access, system logins, and payroll status, and the process proved irreversible despite intervention from his direct manager and director. The developer was eventually reinstated after three weeks of lost pay, but he subsequently resigned due to the professional stigma caused by the incident.
An employee was laid off, allegedly by an artificially intelligent personnel system, and blocked from access to the building and computer systems without their knowledge.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Delegating by humans of key decisions to AI systems, or AI systems that make decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory, or becoming cognitively enfeebled.
Also classified as
The system failed to perform reliably under exception conditions, specifically failing to allow human override when an error occurred.
The automated system made irreversible decisions to terminate the employee's access and employment, leaving human managers and directors completely powerless to override or stop the process.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by an automated HR system executing an unintended termination sequence due to a missing contract renewal input.
Added categories peak at 2: Minor (Psychological Harm, Direct)
An automated corporate HR system erroneously terminated a software developer and locked him out of physical and digital assets due to a database error. While demonstrating the risks of full system autonomy and lack of human override in private enterprise, the incident has negligible national security implications.
The system operated independently without human intervention once triggered, executing a multi-day sequence of disabling accounts and sending security alerts based on its internal state.
High Risk: The system is an employment and worker management system used to manage employee termination and access, which has significant implications for safety, fundamental rights, and worker management.
The system was designed to automate HR processes, specifically managing employee contracts, system access, and termination workflows.
The reports are highly consistent and based directly on the first-hand viral blog post written by the affected individual, Ibrahim Diallo. The sequence of events, the cause, and the outcomes are clearly documented across multiple reputable sources.
The incident could be viewed as a pure database/software workflow failure rather than an AI failure, but the autonomous decision-making and lack of human override align it with AI safety and automation risks.
Technology
Irreversible Automated Workflows
System lacked a mechanism to halt or reverse the termination chain.
Lack of Human Override
No 'red button' existed for managers to stop the automated process.
Dumb Automation Architecture
System had no fuzzy logic or intelligence to flag anomalies before firing.
Data Inputs
Missing Contract Renewal Data
The system treated an unrenewed contract as an active termination trigger.
Flagged Keycard Scan
Attempted use of deactivated card triggered automated threat emails.
Human Factors
Manager Negligence
Former manager failed to renew Diallo's contract during transition.
Overreliance on Automation
Humans assumed the system's outputs were correct without verification.
Process and Methods
Inadequate Transition Processes
Acquisition transition lacked checks to ensure contract continuity.
Flawed Security Protocols
Automated threat emails sent to security without human verification.
Lack of System Safeguards
No process existed to verify termination decisions with current managers.
Management
Lack of System Accountability
Management failed to retain control and oversight over HR tools.
Poor Risk Assessment
Management did not assess risks of fully automating HR terminations.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
