This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The Brazilian government's 'Meu INSS' app, which uses AI to automate social security claims, has been reported to improperly reject complex claims from rural workers. The system's reliance on automated decision-making, combined with its inability to process complex agricultural documentation and lack of accessible human review, has led to wrongful denials and significant delays for vulnerable citizens.
Brazil’s AI-powered Meu INSS app allegedly misclassified a retirement claim filed by Josélia de Brito, a former sugarcane worker, by purportedly recording her as male. De Brito reportedly suffers from multiple chronic illnesses and faced repeated denials of social benefits due to minor filing errors. Analysts cited in the reporting suggest the system's design may disadvantage rural and digitally excluded users.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The system fails to reliably process complex documents and makes basic errors like misidentifying a female claimant's gender.
The AI system exhibits unequal performance and effectiveness, disproportionately failing to accurately process complex claims from rural and agricultural workers compared to simpler urban claims.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The automated rejections and demographic misclassifications were caused by the deployed Meu INSS AI system operating in production, which was an unintentional outcome of the government's automation efforts.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
The Brazilian government's integration of the 'Meu INSS' AI system led to wrongful denials of social security benefits for tens of thousands of rural workers due to document processing errors. While causing significant financial hardship and digital exclusion for vulnerable citizens, the incident remains a domestic administrative and human rights issue with negligible to minor national security implications.
The Meu INSS app operates independently to analyze documents and make automated decisions to approve or deny social security claims without direct human intervention in each case.
High Risk: The AI system is used by a public authority to automate decisions regarding eligibility for social security and retirement benefits, which has significant implications for fundamental rights and public interests.
The primary function of the Meu INSS AI system is to evaluate and process applications for social security and retirement benefits. It also performs identity verification tasks on submitted documents.
The reports provide consistent, detailed accounts of the Meu INSS app's deployment, its automated decision-making process, and the specific negative impacts on rural workers, supported by statistical data on denied claims and a detailed personal case study.
None. The reports clearly attribute the wrongful denials to the automated system's limitations.
Technology
Algorithmic Identification Errors
AI system misidentified female claimant as male, denying benefits.
Inability to Process Complex Cases
NLP and CV algorithms cannot interpret nuanced social security claims.
Inaccurate Generative AI Responses
Chatbot provided vague or inaccurate information to agency staff.
Data Inputs
Incomplete Government Databases
Rural workers lack sufficient registration data, causing AI rejections.
Strict Sensitivity to Minor Errors
Algorithms automatically reject claims due to minor document discrepancies.
Sensitive Data Upload Risk
Lack of guidance led to risks of uploading sensitive personal data to AI.
Human Factors
Low Digital Literacy in Rural Areas
Vulnerable claimants struggle to navigate complex digital interfaces.
Inadequate Staff Training
Training video failed to instruct staff on secure AI chatbot usage.
Process and Methods
Lack of Effective Recourse
Automated rejections force users into lengthy, 278-day appeal processes.
Insufficient Human Oversight
Complex claims are processed by AI without necessary manual review.
Rushed Codebase Rewrites
Fast-paced AI-assisted coding risks introducing system-wide software errors.
Management
Prioritizing Automation Over Welfare
Governments push for rapid automation without preparing the target population.
Aggressive Workforce Reductions
Cutting staff to force AI adoption causes system chaos and errors.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
