This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A New Zealand man of Asian descent had his passport application rejected by an automated facial recognition system that incorrectly identified his eyes as closed. The incident sparked public discussion about algorithmic bias and racial sensitivity in facial recognition technology. The Department of Internal Affairs stated the error was a generic response to lighting issues, and the applicant eventually successfully renewed his passport.
New Zealand passport robot reader rejects the application of an applicant with Asian descent and says his eyes are closed.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
The facial recognition software performed poorly on an individual of Asian descent due to his epicanthal folds, demonstrating unequal accuracy and effectiveness based on demographic characteristics.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the automated passport photo checker's failure to correctly process the user's photo, which was an unexpected outcome of its deployment.
An automated passport photo checker in New Zealand rejected an Asian man's photo due to facial recognition bias, misidentifying his eyes as closed. While highlighting ongoing challenges with demographic disparities in AI, the incident has negligible national security implications and was resolved administratively.
The passport photo checker operates as a tool that performs a specific, deterministic function of evaluating whether an uploaded image meets passport criteria without maintaining context or executing autonomous plans.
High Risk (Level 2): The system is a biometric verification application used by a government department for passport control, which has significant implications for public interest and fundamental rights.
The system's primary goal is to perform facial recognition on uploaded photos to verify if they meet official passport standards.
The reports provide consistent, detailed accounts of the incident, including statements from the affected individual and the government department. The technical cause of the failure (lighting/shadows vs. algorithmic bias on epicanthal folds) is discussed clearly from both perspectives.
The incident could be interpreted purely as a routine technical glitch related to lighting rather than systemic algorithmic bias.
Technology
Flawed Eye Detection Algorithm
The software interpreted epicanthal folds as being closed.
Sensitivity to Eye Shadows
Uneven facial lighting and eye shadows caused the system to misread the eyes.
Generic Error Message System
System sent a generic 'eyes closed' error instead of explaining actual issues.
Data Inputs
Uneven Facial Lighting
The uploaded photograph had shadows and uneven lighting on the face.
Biased Algorithm Design
System was not optimized for diverse facial features like epicanthal folds.
Human Factors
User Uploads Shadowed Photo
The applicant uploaded an initial photo with uneven lighting and shadows.
Process and Methods
Inflexible Automated Rejection
The system automatically rejected the photo without immediate human review.
No Immediate Human Escalation
No automatic routing to staff after multiple failed online submissions.
Management
High Accepted Rejection Rate
Management accepted a high 20 percent rejection rate as normal for the system.
Reliance on Generic Errors
Management deployed a system that used generic errors for complex failures.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
