This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Users of the dating app Coffee Meets Bagel reported that the platform's matching algorithm disproportionately suggested matches of the same ethnicity, even when users explicitly selected 'no preference'. The company acknowledged this behavior, explaining it as an empirical strategy to maximize connection rates based on observed user behavior. This resulted in user frustration and perceptions of racial siloing, leading some to quit the service.
Users selecting “no preference” were shown by Coffee Meets Bagels’s matching algorithm more potential matches with the same ethnicity, which was acknowledged and justified by its founder as a means to maximize connection rate without sufficient user information.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
The system failed to robustly handle the 'no preference' input, defaulting to biased empirical averages instead of a diverse distribution.
The algorithm treated users unequally based on their race, resulting in racial siloing and unfair representation of potential matches.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The racial siloing was an unexpected outcome of the AI matching algorithm's optimization process after it was deployed to users.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
In 2013, the Coffee Meets Bagel dating app algorithm was found to disproportionately suggest same-ethnicity matches due to optimization for connection rates. This algorithmic bias caused user frustration but represents a consumer-level issue with negligible implications for national security.
The matching algorithm acts as an Assistant, providing daily match suggestions ('Bagels') to users, who must then make the final decision to 'Like' or 'Pass' within 24 hours.
Minimal or No Risk: The AI system is a matchmaking algorithm for a dating application, which is a consumer entertainment and social platform posing low or negligible risk to safety or fundamental rights under the EU AI Act framework.
The primary function of the Coffee Meets Bagel algorithm is matchmaking, specifically suggesting daily compatible partners ('Bagels') to users based on preferences and behavioral data.
The reports provide clear, first-hand accounts of the matching algorithm's behavior, along with direct explanations from the company's co-founder (Dawoon Kang) confirming the empirical data-driven matching strategy. The mechanics of the racial siloing are well-explained through both user experience and game theory analysis.
The matching behavior could be interpreted as a reflection of existing user biases rather than an algorithmic failure, though the system's design actively reinforced and amplified these biases.
Technology
Flawed Match Optimization
Algorithm prioritizes overall connection rates over match diversity.
Game Theory Feedback Loop
System forces users into exclusionary preferences to get diverse matches.
No Preference Misinterpretation
Algorithm treats 'no preference' as a license to dump skewed matches.
Data Inputs
Skewed Demographic Data
User base is highly skewed toward white, Asian, and Jewish demographics.
Empirical Bias Default
Using historical system-wide matching data to predict individual desires.
Lack of Diverse Match Data
System lacks diverse interaction data for users selecting no preference.
Human Factors
Explicit Racial Preferences
Many users limit their preferences to their own ethnicity.
User Expectation Disconnect
Users expect 'no preference' to yield a diverse mix of matches.
Game Theory Pressure
Users feel forced to adopt exclusionary settings to bypass algorithmic bias.
Process and Methods
Inadequate Algorithmic Testing
Failure to test how 'no preference' settings behave under skewed demand.
Lack of Diversity Metrics
No mechanism to measure or preserve diversity in match recommendations.
Management
Prioritizing Connection Rates
Management prioritized maximizing connection rate over user experience.
Defensive Stance on Bias
Management dismissed user bias concerns as empirical user preferences.
Regulatory Environment
Absence of Algorithmic Standards
No regulatory standards governing bias in dating recommendation algorithms.
Lack of Oversight
No external auditing for discriminatory outcomes in matching systems.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
