This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A study analyzing facial recognition software from Face++ and Microsoft found that these systems exhibit racial bias by consistently interpreting Black faces as having more negative emotions, such as anger or contempt, compared to white faces. This disparity persists even when controlling for facial expressions like smiling. The findings suggest that such AI tools may formalize preexisting societal stereotypes into algorithms, potentially leading to discriminatory impacts in sensitive areas like hiring and public safety.
Emotion detection tools by Face++ and Microsoft's Face API allegedly scored smiling or defaulted ambiguous facial photos for Black faces as negative emotion more often than for white faces.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The systems unfairly represent Black individuals by associating their facial expressions with negative emotions like anger and contempt, reinforcing harmful racial stereotypes.
The AI systems perform unequally across demographic groups, exhibiting significantly lower accuracy and higher rates of negative emotion misclassification for Black faces compared to white faces.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The racial bias is an unexpected and unintentional outcome of the AI systems' emotion classification models, which manifested after the models were trained and deployed.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A scientific study revealed racial bias in facial recognition and emotion analysis software from Face++ and Microsoft, consistently misinterpreting Black faces as having more negative emotions. While posing concerns for civil rights and fair treatment in hiring and law enforcement, the incident has negligible direct national security implications and represents an established algorithmic challenge.
The AI systems function as tools that perform a specific, well-defined function of analyzing facial expressions and outputting emotional scores based on direct image inputs, without context retention or autonomous planning.
High Risk: The report describes facial recognition systems being used in recruitment ('hiring decisions') and public safety ('scan the faces in crowds to identify threats'), which are explicitly classified as high-risk applications under the EU AI Act.
The primary function of the AI systems is facial analysis and emotion recognition from facial images, which is a form of Face Recognition. A secondary goal is Threat Detection, as companies develop this software to scan crowds for threats.
The analysis is based on a structured scientific study with clear quantitative findings comparing Face++ and Microsoft Face API. The methodology, dataset (400 NBA player photos), and specific bias metrics are clearly detailed in the reports.
None.
Technology
Biased Classification Algorithms
Algorithms interpret black faces as angrier or more contemptuous.
Formalization of Stereotypes
Software formalizes preexisting human stereotypes into automatic algorithms.
Data Inputs
Biased Training Datasets
Training data likely reflects human biases in emotion perception.
Human Factors
Preexisting Human Stereotypes
People perceive black men as more threatening, influencing tech design.
Misplaced Trust in Objectivity
Belief that algorithms are naturally objective and free from human bias.
Process and Methods
Inadequate Demographic Audits
Lack of testing to ensure similar emotional assessment across racial groups.
Management
Ignoring Disparate Impact
Failure to prevent technology from exacerbating existing power dynamics.
Invisibility of AI Decisions
Keeping system operations and biases hidden from the people affected.
Regulatory Environment
Lack of Public Accountability
No societal oversight to ensure fairness for groups affected by AI.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
