This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A 2013 study by Harvard professor Latanya Sweeney revealed that Google AdSense disproportionately served advertisements for criminal background checks when users searched for names associated with black individuals. The study found that these ads, often suggesting the subject had been arrested even when they had no criminal record, appeared significantly more frequently for black-identifying names than for white-identifying names. This bias raised concerns about the potential for online advertising algorithms to perpetuate structural racism and negatively impact the professional and personal reputations of individuals.
Advertisements chosen by Google Adsense are reported as producing sexist and racist results.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
The discriminatory ads risked harming the employment prospects of black job seekers whose names were searched by potential employers.
The 'black box' nature of Google's AdSense algorithm made it difficult for researchers to pinpoint the exact cause of the discriminatory ad delivery.
The AI system disproportionately associated black-identifying names with arrest records, resulting in unfair representation and racial discrimination.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The discriminatory ad delivery was an unexpected, unintentional outcome of Google's automated ad-serving algorithms operating in a post-deployment environment.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A landmark 2013 study revealed systemic racial bias in Google's AdSense algorithm, which served arrest-related ads disproportionately for Black-identifying names. While representing a significant civil rights concern and establishing a major precedent for algorithmic bias, the national security impact remains minor and manageable within standard legal, regulatory, and corporate policy frameworks.
The system operates independently to optimize ad delivery based on learned patterns of user clicks and keyword bids, making real-time decisions on which ad copy to display without direct human intervention for each search.
High Risk: The system's outputs directly impact employment and worker management, specifically affecting access to employment and recruitment, which is classified as high risk under the EU AI Act.
The primary function of Google AdSense is automated ad delivery, which relies on behavioral modeling of user clicks to optimize ad placement.
The reports provide detailed, consistent information about Latanya Sweeney's peer-reviewed study, including specific percentages, methodologies, and responses from Google and Instant Checkmate. The core facts of the algorithmic bias are well-documented.
The bias could be interpreted as a reflection of societal prejudice (user clicks) rather than a direct failure of Google's technology design.
Technology
Smart Optimization Algorithms
Algorithmic optimization prioritizes CTR, reinforcing biased click patterns.
Black Box Ad Delivery
Complex, opaque ad-serving systems make bias detection difficult.
Cloud-Caching Strategies
Caching strategies might bias ad delivery toward previously loaded ads.
Data Inputs
Racially Associated Names
First names predict race, serving as proxy inputs for ad targeting.
User Click-Through Data
Historical click data contains and perpetuates societal racial biases.
Ad Template Variations
Advertisers provided templates that interacted with names to trigger ads.
Human Factors
User Click Biases
Users click arrest ads more frequently for black-sounding names.
Societal Prejudices
Deeply ingrained racial stereotypes influence user behavior online.
Lack of Diversity in AI
Homogenous thinking among creators leads to biased technology design.
Process and Methods
Lack of Algorithmic Auditing
No proactive methods to review algorithms for discriminatory outcomes.
Flawed Ad Customization Tools
Transparency tools fail to show all inferred interests used for targeting.
No Proactive Value Design
Engineering processes fail to design for social and legal consequences.
Management
Prioritization of Revenue
Ad systems maximize revenue and clicks over social fairness.
Denial of Responsibility
Management shifts blame to advertisers and user behavior.
Inadequate Risk Assessment
Google failed to assess racial bias risks in ad delivery systems.
Regulatory Environment
Lack of Online Ad Regulations
Existing civil rights laws do not easily apply to online ad delivery.
Opaque Pricing Enforcement
Challenging to enforce anti-discrimination laws in opaque commerce systems.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
