In 2016, an investigation by The Seattle Times revealed that LinkedIn's search algorithm exhibited gender bias by consistently suggesting male names when users searched for common female names, while not doing the reverse for male names. LinkedIn attributed the behavior to an algorithm based on past search frequencies rather than intentional gender bias. Following the report, LinkedIn updated its search algorithm to explicitly recognize names and stop suggesting alternative names for search queries.
An investigation by The Seattle Times in 2016 found a gender bias in LinkedIn's search engine.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The search suggestions systematically misrepresented female professionals by prompting users to search for male equivalents instead.
The search algorithm's effectiveness and accuracy differed by demographic group, performing worse for female names by incorrectly suggesting male alternatives while performing correctly for male names.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The gender-biased search suggestions were generated automatically by LinkedIn's deployed search algorithm as an unexpected outcome of analyzing past search frequencies.
An investigation revealed LinkedIn's search algorithm exhibited systemic gender bias by suggesting male names for female queries. This commercial algorithmic bias represents a minor societal equity concern with negligible direct implications for national security.
The search algorithm acts as an assistant by providing spelling and name suggestions ('did you mean') to help users find contacts, requiring the user to make the final decision.
High Risk: The AI system is used within a professional networking platform that directly impacts recruitment and employment access. Under the EU AI Act, 'Employment and worker management systems, such as AI used in recruitment' are classified as High Risk.
The AI system's primary function is to help users search for and find professional profiles on LinkedIn, including suggesting alternative spellings or names during search queries.
The reports provide consistent, detailed accounts of the search algorithm's behavior, the specific names tested, LinkedIn's official response, and the subsequent algorithmic fix. The facts are well-documented across multiple reputable news sources.
LinkedIn argued the behavior was purely mathematical based on user search frequencies rather than systemic gender bias, though the outcome remains functionally biased.
Technology
Spelling Correction Algorithm
Algorithm corrected valid names based on spelling and frequency.
Lack of Name Recognition
System did not recognize inputs as names to prevent correction.
Data Inputs
Biased Search Query History
Algorithm learned from past user queries that favored male names.
Skewed Profile Frequency Data
Relative frequencies of male names in profiles biased the model.
Human Factors
Biased User Search Tendencies
Past search behaviors of users skewed toward male professionals.
Homogeneous AI Workforce
A workforce skewing male may fail to anticipate gender bias issues.
Process and Methods
Inadequate Bias Testing
Testing processes failed to detect asymmetric gender-biased suggestions.
Management
Lack of Proactive Risk Assessment
Management did not assess risks of algorithmic bias before launch.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.