This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A University of Washington study found that Google Image search results for various occupations significantly underrepresented women in leadership roles compared to real-world labor statistics. The researchers demonstrated that these biased search results could measurably influence users' perceptions of gender ratios in the workforce. Furthermore, the study noted that images of women in male-dominated fields were often sexualized or depicted as unprofessional, reinforcing harmful stereotypes.
Google Image returns results that under-represent women in leadership roles, notably with the first photo of a female "CEO" being a Barbie doll after 11 rows of male CEOs.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
The biased search results misled users, shifting their real-world perceptions of occupational gender ratios by 7%.
The ad delivery system showed significantly fewer high-paying executive job ads to women, potentially restricting their employment opportunities.
The incident involves the systematic underrepresentation and stereotyping of women in search results, leading to unfair representation of this group.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The bias was caused by Google's search and ad algorithms processing data post-deployment, resulting in unintentional discriminatory outputs.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
Studies in 2015 revealed systemic gender bias in Google's Image Search and ad-delivery algorithms, showing underrepresentation of women in leadership roles and discriminatory ad targeting for high-paying jobs. While this represents a notable societal concern regarding algorithmic fairness and discrimination, its national security impact is negligible to minor, lacking any physical threat, state-sponsored information warfare, or compromise of sovereign functions.
The Google Image Search and ad-delivery systems operate as tools that perform specific, well-defined functions based on direct user queries and profile inputs, producing outputs without independent goal-directed planning.
High Risk: The report describes an AI system used in employment and recruitment advertising, which falls under systems affecting access to employment and vocational opportunities.
The primary system analyzed is Google Image Search, which retrieves images based on queries. The secondary system is Google's ad-delivery platform, which targets job advertisements to users.
The assessment is based on two highly credible, peer-reviewed academic studies from major universities (University of Washington/Maryland and Carnegie Mellon University) with specific, quantified data points. The reports consistently describe the same core findings regarding search bias and ad delivery disparities.
The search results could be interpreted as merely reflecting existing web content biases rather than an algorithmic failure, though the studies show the algorithm actively exaggerates these biases.
Technology
Algorithmic Bias
Algorithms reflect and exaggerate societal stereotypes in search results.
Ad-Personalization Bias
Ad delivery system shows fewer high-paying executive ads to women.
Image Recognition Flaws
Flickr auto-tagging tool misidentified Black people as animals.
Data Inputs
Biased Web Content
Search results reflect biased naming, labeling, and linking on the web.
Stereotypical Stock Photos
Media and stock libraries underrepresent diverse professionals.
Skewed Training Data
Algorithms learn from historically biased search histories and clicks.
Human Factors
User Search Behavior
Sexist and racist search habits reinforce biased algorithmic learning.
Societal Gender Stereotypes
Users hold existing preconceptions about gender ratios in professions.
Advertiser Targeting Choices
Advertisers select specific demographics, excluding women from executive ads.
Process and Methods
Lack of Algorithmic Transparency
Algorithms operate in closed boxes without external scrutiny.
Engagement-Based Ranking
Algorithms prioritize PageRank and click-through rates over fairness.
Inadequate Search Auditing
Lack of systematic methods to evaluate and balance search representation.
Management
Prioritizing User Preferences
Designing algorithms to show what they think users want to see.
Lack of Accountability
Search companies declining to comment or address systemic bias actively.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
