This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Multiple Chinese technology firms, including Alibaba, Huawei, Megvii, and SenseTime, developed facial recognition technologies capable of identifying individuals by ethnicity, specifically targeting Uyghur Muslims. These systems were intended to facilitate government surveillance and tracking, raising significant human rights concerns regarding state-sponsored persecution and discrimination.
Various Chinese firms were revealed by patent applications to have developed facial recognition capable of detecting people by race, which critics feared would enable persecution and discrimination of Uyghur Muslims.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
The technology was designed to facilitate large-scale government surveillance and tracking of the Uyghur population.
The AI systems were specifically designed to profile and identify individuals based on their Uyghur ethnicity, directly enabling state-sponsored discrimination and surveillance.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The development and testing of ethnicity-detection AI systems were intentional human decisions aimed at profiling specific ethnic groups post-deployment.
Added categories peak at 4: Severe (Psychological Harm, Inferred)
The development and deployment of ethnicity-detection AI by Chinese tech firms to target Uyghur Muslims represents a severe violation of human rights and a significant advancement in state-sponsored mass surveillance capabilities. This incident has prompted coordinated international responses, including sanctions and technology export controls, highlighting its impact on global technology security.
The reports describe the systems as facial recognition algorithms and ethnicity detection software that identify pedestrians by attributes or alert authorities when a specific face is detected. These function as specialized tools processing direct inputs to produce deterministic classification outputs.
Unacceptable Risk: The reports describe AI systems used for biometric categorization to profile and target individuals based on race and ethnicity, as well as state-sponsored mass surveillance, which are prohibited outright under the Act due to severe violations of fundamental rights.
The primary function of the AI systems described is facial recognition and identification of individuals, specifically classifying them by ethnicity.
The reports provide clear, consistent accounts from multiple tech companies admitting to the existence of these patents or trial technologies, backed by investigations from IPVM. There is high certainty regarding the intended functionality of the AI systems.
None. The evidence of ethnicity-detection software development is clear and acknowledged by the companies involved.
Technology
Ethnicity Detection Algorithms
AI models trained specifically to identify Uighur and other ethnic groups.
Automated Alerting Systems
Uighur alarm systems designed to automatically flag individuals to police.
Data Inputs
Discriminatory Ethnic Tagging
Training data and product offerings labeled with explicit ethnic tags.
Unmonitored Customer Databases
Sensitive profiling data hosted in cloud environments without access controls.
Human Factors
Lack of Ethical Design Awareness
Engineers and researchers developing profiling systems without ethical review.
Process and Methods
Flawed Patent Review Processes
Patents with discriminatory tech were approved and filed without intervention.
Inadequate Product Testing Controls
Trial technologies tested in cloud environments without safety safeguards.
Management
Lack of Algorithmic Governance
Corporate oversight failed to detect and stop discriminatory AI development.
Compliance with State Surveillance
Prioritizing government contracts and mandates over ethical AI policies.
Regulatory Environment
Government Surveillance Mandates
State projects mandating ethnic analytics and surveillance across regions.
Absence of Discriminatory AI Bans
Lack of strong legal frameworks prohibiting automated ethnic profiling.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
