This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A former Uber Eats delivery driver, Pa Edrissa Manjang, initiated legal action against the company alleging that its facial recognition software, used for identity verification, is racially biased. Manjang claims he was subjected to excessive verification checks and subsequently dismissed due to false mismatches. An employment tribunal has allowed the discrimination claim to proceed to a full hearing, noting that Uber's internal processes were not initially transparent.
A lawsuit by a former Uber Eats delivery driver alleged the company to have wrongfully dismissed him due to frequent false mismatches of his verification selfies, and discriminated against him via excessive verification checks.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The use of biased automated systems for workforce management directly led to the loss of livelihood and degraded employment quality for minority gig workers.
The lack of clarity and transparency regarding Uber's automated deactivation decisions made it difficult for the affected drivers to appeal or understand their dismissal.
The facial recognition software exhibited unequal performance across demographic groups, specifically failing to accurately identify Black drivers, leading to their unfair dismissal.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was triggered by the Real-Time ID Check AI system failing to correctly verify the driver's identity due to algorithmic bias, which was an unintended outcome of its deployment.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A commercial dispute in the United Kingdom involving allegations of racial bias in Uber Eats' facial recognition identity verification tool. While raising important questions about civil rights, algorithmic discrimination, and gig-economy labor standards, the incident has negligible national security implications and is being addressed through standard legal channels.
The Real-Time ID Check system operates as a tool that performs a specific, well-defined function of verifying driver identity using facial recognition on direct selfie inputs.
High Risk: The system is used for employment and worker management, specifically for identity verification and access control affecting a worker's livelihood, which falls under the High Risk category.
The system's primary goal is to identify and verify the identity of the driver using facial recognition, which is then used for workforce administration and monitoring to ensure the correct person is operating the account.
The reports provide clear, consistent details about the driver's dismissal, the technology used (Uber's Real-Time ID Check), and the legal proceedings. While Uber disputes that the automated system was the sole cause of dismissal, the core allegations of racial bias in the facial recognition tool are well-documented and supported by union statements and tribunal decisions.
The dismissal could be interpreted as a human management decision supported by a tool, rather than a purely automated AI decision.
Technology
Racially biased algorithms
Facial recognition is less accurate for ethnic minorities.
Frequent mismatch errors
System repeatedly failed to recognize legitimate couriers.
Data Inputs
Skewed training datasets
Training data skewed towards white men, causing bias.
Human Factors
Lack of human oversight
Support staff failed to manually verify courier photos.
Process and Methods
Flawed deactivation process
Accounts were deactivated automatically based on mismatch flags.
Opaque feedback channels
Couriers were not given clear reasons or verification methods.
Management
Growth over worker welfare
Treating couriers as numbers rather than human beings.
Poor algorithmic risk review
Deploying tech without auditing for racial discrimination risks.
Regulatory Environment
Weak AI employment laws
Lack of regulatory standards for AI use in worker management.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
