This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In June 2016, it was widely reported that Google Image searches for 'three black teenagers' returned predominantly police mugshots, while the same search for 'three white teenagers' returned positive stock photography. This disparity sparked a significant public debate regarding algorithmic bias, the role of search engines in reinforcing societal stereotypes, and the responsibility of technology companies for the content surfaced by their automated systems.
On June 6, 2016, Google image searches of "three black teenagers" resulted in mostly mugshot images whereas Google image searchers of "three white teenagers" consisted of mostly stock images, suggesting a racial bias in Google's algorithm.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
The search engine's effectiveness and dignity of output differed significantly based on the demographic group specified in the query.
The algorithm failed to robustly handle sensitive demographic queries, lacking the capability to account for social context or systemic bias.
The search engine's output unfairly represented and stereotyped Black teenagers by predominantly associating them with mugshots and criminality, leading to biased representation.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The biased search results were generated by Google's deployed search algorithm, which unintentionally reflected and amplified societal prejudices present in web data.
Added categories peak at 2: Minor (Psychological Harm, Direct)
In June 2016, a viral Google Image search disparity highlighted systemic racial bias in search algorithms, returning mugshots for 'three black teenagers' and positive stock photos for 'three white teenagers'. While sparking significant public debate on algorithmic discrimination, the incident posed minor national security risks, primarily serving as an early public example of unintentional bias.
The Google Image Search engine operates as a tool that performs a specific, well-defined function of retrieving and ranking images based on direct user queries without independent goal-directed planning.
Minimal or No Risk: General-purpose search engines and simple information retrieval tools are generally classified as posing minimal or no risk under the EU AI Act, as they do not fall under prohibited or high-risk categories.
The primary function of the AI system involved is Google Image Search, which retrieves and ranks images based on user queries. It also acts to recommend content based on popularity and metadata.
The reports provide consistent, detailed accounts of the viral incident, Google's response, and the underlying algorithmic mechanisms (SEO, metadata, search frequency). Multiple sources confirm the exact search terms and results, leaving little ambiguity about what occurred.
Some commentators argued the issue is purely a reflection of societal bias rather than an AI failure, but this does not change the classification of the AI's role in reproducing that bias.
Technology
Algorithmic Popularity Bias
The search algorithm prioritizes highly clicked and shared negative images.
Relying on Alt-Tags and Metadata
The technology relies on human-created alt-tags which can be biased.
No Algorithmic Context Awareness
The algorithm cannot understand social context or racial implications.
Data Inputs
Biased Media Representation
News sites disproportionately associate black teens with crime stories.
Lack of Positive Stock Photos
Fewer stock photos of black teens exist due to market demographic demand.
Unbalanced Arrest Coverage
Black arrests receive disproportionately high media coverage and tagging.
Human Factors
Societal Prejudice and Bias
User search and clicking behaviors reflect institutional racial prejudices.
Media Stereotyping
Writers select mugshots for black teens but wholesome photos for white ones.
Overreliance on Search Credibility
Users trust search results as objective truths rather than biased reflections.
Process and Methods
Unvetted Automated Indexing
Web crawling relies on unverified user-generated metadata and captions.
No Proactive Query Filtering
Google lacks processes to proactively filter or balance sensitive search terms.
Lack of Transparent Output Vetting
Search results are displayed without transparency of how they are manipulated.
Management
Prioritization of Fiduciary Interests
Google prioritizes business interests over active search result curation.
Deflection of Responsibility
Management blames societal bias rather than taking accountability.
Inadequate Risk Assessment
Google failed to assess risks of racial stereotyping in search queries.
Regulatory Environment
Lack of Algorithmic Bias Regulation
No legal frameworks exist to hold search engines accountable for bias.
Narrow Definition of Consumer Harm
Regulators fail to recognize representational bias as actionable harm.
Lack of Oversight on Tech Monopolies
Regulatory bodies lack oversight on search engine indexing practices.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
