This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A class action lawsuit alleges that Workday's AI-based applicant screening system facilitates discrimination against African-American applicants, individuals over 40, and people with disabilities. The plaintiff, who was denied employment for numerous positions, claims the system's algorithms and human-defined inputs perpetuate bias. Workday has denied the allegations, stating they are committed to equitable and transparent AI design.
Workday's algorithmic screening systems were alleged in a lawsuit allowing employers to discriminate against African-Americans, people over 40, and people with disabilities.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
The lawsuit alleges that the screening system performs with unequal effectiveness across demographic groups, resulting in systematic bias and rejections for Black, older, and disabled job applicants.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The alleged discrimination was caused by the automated decisions of Workday's deployed applicant screening system, which represents an unintentional biased outcome of its recruitment goals.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A class-action lawsuit alleges that Workday's AI-based applicant screening tool systematically discriminates against Black, older, and disabled job seekers. While highlighting significant concerns regarding algorithmic bias and civil rights, the incident is a domestic civil matter with minor national security implications, manageable through standard legal and regulatory frameworks.
The system is described as an applicant screening tool that 'process and interpret an applicant's qualifications and recommend whether the applicant should be accepted or rejected' to assist employers in hiring decisions.
High Risk: The system is an employment and worker management system used in recruitment, which is explicitly classified as High Risk under the EU AI Act.
The AI system's primary function is to evaluate job applications and recommend whether candidates should be accepted or rejected.
The report clearly outlines the legal allegations, the specific AI system (Workday's screening tool), the affected demographic groups, and the nature of the alleged bias. While it is a lawsuit and the allegations are denied by Workday, the details of the safety risk (algorithmic discrimination in hiring) are unambiguous.
The bias could be attributed to the specific configurations set by Workday's customers rather than Workday's default algorithms, as noted in the claim that tools allow customers to 'manipulate and configure them in a discriminatory manner'.
Technology
Flawed Screening Algorithms
Algorithms allegedly filter candidates based on race, age, or disability.
Configurable Bias Tools
Tools allow customers to manipulate screening in a discriminatory manner.
Data Inputs
Subjective Input Data
Screening relies on subjective inputs that carry historical bias.
Biased Training Data
Human-created inputs reflect conscious or unconscious biases.
Human Factors
Unconscious Bias of Creators
System creators build their own biases into the screening algorithms.
Discriminatory Customer Intent
Customers configure tools to intentionally screen out certain demographics.
Process and Methods
Subjective Screening Practices
Recruitment processes allow subjective, non-standardized evaluation.
Inadequate Algorithmic Review
Review processes failed to catch and mitigate discriminatory outcomes.
Management
Inadequate Risk Mitigation
Management failed to prevent discriminatory tool configurations by clients.
Regulatory Environment
Lack of Algorithmic Audits
Absence of strict legal requirements for auditing AI hiring tools.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
