This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Ping An, a major Chinese insurance company, implemented an AI-driven facial recognition system to assess customer trustworthiness and health insurance premiums. Critics and analysts argue that the system relies on flawed metrics like micro-expressions and BMI, leading to potential discrimination against ethnic minorities and low-income populations. The case serves as a cautionary example of how AI can perpetuate systemic bias in the insurance industry.
Customers’ untrustworthiness and unprofitability were reportedly determined by Ping An, a large insurance company in China, via facial-recognition measurements of micro-expressions and body-mass indices (BMI), which critics argue was likely to make mistakes, discriminate against certain ethnic groups, and undermine its own industry.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
Also classified as
The report strongly questions the scientific validity and technical capability of using facial micro-expressions to accurately detect deception.
The AI system is used to discriminate against individuals based on BMI and is projected to unfairly exclude low-income individuals and ethnic minorities like Uyghurs from insurance coverage.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk arises from the active deployment of Ping An's facial recognition AI to make real-world decisions about customer insurance eligibility and premiums.
Ping An deployed an AI-driven biometric system using facial recognition and micro-expressions for insurance underwriting. While a commercial application, it poses substantial risks to societal stability and human rights by enabling systemic discrimination against marginalized populations, specifically low-income groups and ethnic minorities like the Uyghurs.
The report states that Ping An is using facial recognition software to 'help decide' truthfulness and insurance terms, indicating that the AI acts as an assistant to human underwriters rather than making entirely independent, unreviewed decisions.
Risk Level 2. High Risk: The report describes 'facial recognition software' used to evaluate individuals for insurance eligibility, which falls under biometric identification and essential private services.
The AI's primary stated function is to analyze micro-expressions to determine if customers are being truthful (trustworthiness scoring) and to evaluate health metrics to set insurance premiums (underwriting).
The report clearly outlines the AI system's deployment by Ping An, its intended functions (micro-expression and BMI analysis), and the specific socio-economic risks of discrimination. While it is an analytical piece, the core facts of the deployment are clearly stated.
The system could be viewed as a standard fraud-detection and risk-assessment tool rather than an inherently discriminatory instrument.
Technology
Flawed Micro-expression Detection
Using unproven science to determine truthfulness from facial micro-expressions.
Inaccurate BMI and Health Estimation
Using facial recognition to estimate BMI and penalize health premiums.
Data Inputs
Unrepresentative Training Data
Algorithm trained on laboratory lies which do not match real-world behavior.
Omission of Undetected Lies
Training data lacks real-world lies that were never caught or discovered.
Proxy Data for Marginalized Groups
Claims data correlates poverty and minority status with high insurance risks.
Human Factors
Overreliance on Algorithmic Decisions
Insurers trust AI claims of truthfulness without human verification.
Behavioral Masking by Good Liars
Good liars control expressions, causing the AI to misidentify dishonesty.
Process and Methods
Unfair Risk-Profiling Methods
Profiling customers based on demographic and physical traits to deny coverage.
Lack of Scientific Validation
Deploying truth-detection methods without robust scientific proof of efficacy.
Management
Prioritizing Profit Over Fairness
Management focuses on avoiding expensive claims at the expense of equity.
Erosion of Risk-Pooling Principles
Redefining insurance to exclude those who actually need the coverage.
Regulatory Environment
Absence of Anti-Discrimination Laws
Lack of regulatory mandates preventing insurers from excluding high-risk groups.
Repeal of Universal Coverage Mandates
Weakening of laws that require insurers to cover all individuals equally.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
