Pokémon Go, an augmented reality game, faced criticism for 'digital redlining' after researchers found that PokéStops were disproportionately located in majority-white neighborhoods compared to minority communities. This disparity stemmed from the developer's reliance on crowdsourced location data from a previous game, Ingress, which had a skewed user demographic. Furthermore, the game's mechanics, which encourage players to wander public spaces, raised concerns about the safety of black men who may face increased police suspicion while playing.
Through a crowdsourcing social media campaign in 2016, several journalists and researchers demonstrated that augmented reality locations in the popular smartphone game Pokemon Go were more likely to be in white neighborhoods.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
The game's mapping system performed unequally across demographic groups, providing significantly fewer PokéStops in minority neighborhoods due to biased historical training data.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The unequal distribution of PokéStops was caused by the automated mapping system's reliance on biased historical data, which was an unintended outcome of Niantic's goal to deploy the game quickly.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
An augmented reality game's map layout exhibited digital redlining due to reliance on biased historical crowdsourced data. While raising valid civil rights concerns regarding resource distribution and potential racial profiling during public play, the incident has negligible national security implications.
The AI system operates as a Tool, performing the specific, well-defined function of mapping and placing virtual PokéStops and Gyms based on historical geospatial data inputs.
Minimal or No Risk: The system is an entertainment application (mobile game), which poses low or negligible risks to users and society under the EU AI Act framework.
The system's primary function is to allocate virtual resources (PokéStops and Gyms) across physical geographic locations based on historical data. It also generates game content dynamically on the map.
The reports provide consistent accounts of the digital redlining issue, backed by empirical data from the Urban Institute (55 vs 19 PokéStops). The technical root cause (reliance on Ingress crowdsourced data) is clearly explained by the developer and independent researchers. The safety concerns for Black players are well-documented through first-hand essays and anecdotes.
The disparity could be interpreted purely as a legacy data issue rather than an active algorithmic bias, though the resulting impact remains discriminatory.
Technology
Legacy Map Reusage
Niantic reused map data from Ingress to populate PokeStops.
Geospatial Data Dependence
The game relied heavily on historical geospatial coordinates.
Data Inputs
Biased Crowdsourced Inputs
Map data was sourced from Ingress players who were mostly white and male.
Demographic Imbalance
Lack of diverse user inputs led to fewer stops in minority areas.
Human Factors
Racial Profiling Risks
Black players face suspicion and police stops while playing in public.
Homogeneous User Base
Ingress player demographics shaped the original geographic map layout.
Process and Methods
Lack of Map Bias Review
Niantic did not evaluate the racial equity of reused geospatial data.
Frozen PokeStop Requests
Niantic suspended new PokeStop requests during the initial launch phase.
Management
Prioritizing Global Launch
Management prioritized rapid deployment over addressing geographic bias.
Delayed Corrective Action
Niantic deferred addressing PokeStop disparities until after global launch.
Regulatory Environment
No AR Equity Regulations
No regulatory standards govern fair distribution of digital resources.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.