This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In 2016, the Beauty.AI contest, which used AI algorithms to judge facial attractiveness, produced results that were heavily biased toward white contestants. Researchers and the developers identified that the training datasets lacked sufficient diversity, leading the algorithms to favor lighter skin tones and fail to accurately process images of darker-skinned individuals. This incident highlighted the risks of algorithmic bias stemming from unrepresentative training data.
In 2016, after artificial inntelligence software Beauty.AI judged an international beauty contest and declared a majority of winners to be white, researchers found that Beauty.AI was racially biased in determining beauty.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The final selection of winners heavily favored light-skinned individuals, reinforcing biased and discriminatory standards of beauty.
The AI system performed with lower accuracy and effectiveness for dark-skinned contestants, frequently discarding their photos due to lighting or failing to recognize their features due to underrepresentation in the training data.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The biased selection of beauty contest winners was an automated decision made by the deployed AI system, which was an unintended outcome of its training.
The Beauty.AI incident in 2016 involved an online beauty contest where AI algorithms produced racially biased results due to unrepresentative training data. While it highlighted significant ethical concerns regarding algorithmic bias and discrimination, the incident was entirely within the entertainment domain and carried no national security implications.
The beauty contest was judged by a panel of five distinct algorithms (RYNKL, PIMPL, MADIS, Symmetry Master, and AntiAgeist), each evaluating different facial parameters and coordinating to determine the final 44 winners.
Minimal or No Risk: The AI system was used for an online beauty contest, which is an entertainment application posing low or negligible risks to society under the EU AI Act framework.
The primary function of the Beauty.AI system was to score and rank user-submitted images based on facial symmetry, wrinkles, and other aesthetic parameters.
The reports provide consistent details across multiple sources regarding the Beauty.AI contest, the number of contestants (approx. 6,000), the number of winners (44), the specific algorithms used, and the technical reasons for the bias (lack of diverse training data and lighting issues). There are minor discrepancies in total contestant numbers in some reports (e.g., one mentioning 60,000 or 600,000), but the core facts of the incident are clear and undisputed.
None
Technology
Deep learning model limitations
Models reproduced human biases present in shared databases.
Facial recognition failure in dim light
Algorithms discarded selfies of dark-skinned people if lighting was too dim.
Biased reference database
MADIS compared selfies to databases of models and actors lacking diversity.
Data Inputs
Underrepresentation of minorities
Training datasets lacked an adequate number of samples of people of color.
Skewed contestant submission data
75 percent of contest entrants were European and white, distorting the pool.
Inadequate image quality control
System excluded dark-skinned images due to background and face color contrast.
Human Factors
Entrenched human developer bias
Humans creating algorithms have entrenched biases that reproduce in the AI.
Assumption of algorithmic neutrality
Belief that machines are objective counterparts led to lack of bias checks.
Process and Methods
Shared biased training frameworks
Researchers shared training databases and frameworks without modifying them.
Lack of proactive bias adjustments
No proactive adjustments were made to the algorithms to curb known biases.
Management
Inadequate public relations outreach
Poor outreach in non-European countries led to a skewed entrant demographic.
Lack of pre-launch bias testing
Management failed to test the system for racial bias prior to contest launch.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
