This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A class action lawsuit against SafeRent Solutions alleged that its AI-powered tenant screening tool discriminated against Black and Hispanic rental applicants and housing voucher holders by using biased credit and debt data. The case resulted in a $2.275 million settlement and injunctive relief requiring the company to stop using such scores for voucher holders. The Department of Justice and HUD intervened, affirming that the Fair Housing Act applies to algorithmic screening systems.
SafeRent’s AI-powered tenant screening tool used credit history and non-rental-related debts to assign scores, disproportionately penalizing Black and Hispanic renters and those using housing vouchers. The reported discriminatory housing outcomes violated the Fair Housing Act and Massachusetts law. A class action lawsuit (Louis, et al. v. SafeRent Solutions, et al.) resulted in a $2.275 million settlement and changes to SafeRent’s practices.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The algorithm resulted in systemic housing discrimination and unfair outcomes for minority applicants.
Landlords delegated key housing decisions to the automated tool, leaving applicants with no meaningful human review or appeal route.
The screening tool's predictive accuracy and scoring outcomes differed significantly by demographic group, performing worse and unfairly penalizing Black and Hispanic voucher holders.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The discriminatory outcomes were caused by the deployed SafeRent scoring algorithm, which produced unintended disparate impacts on protected groups.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
A landmark U.S. class-action lawsuit and federal intervention resolved allegations of systemic algorithmic discrimination by SafeRent Solutions' tenant screening tool against Black and Hispanic applicants. While a significant civil rights and regulatory event, it carries minor national security implications.
The AI system acts as an assistant by evaluating applicant data and providing a score and recommendation ('DECLINE' or 'ACCEPT') to help landlords make rental decisions.
High Risk: The system is used for evaluating creditworthiness and screening applicants for essential services like housing, which has significant implications for fundamental rights and public interests.
The AI system's primary function is to evaluate rental applications and assign a score and recommendation to assist landlords in screening tenants.
The reports are highly detailed, consistent, and come from reputable sources including the Department of Justice and court documents. The role of the AI, the nature of the discrimination, the legal outcomes, and the affected parties are clearly documented.
None. The legal settlement and DOJ involvement confirm the discriminatory impact of the algorithmic tool.
Technology
Opaque Scoring Algorithm
The algorithm does not explain how scores are calculated or what they mean.
Inflexible Scoring System
Landlords cannot adjust scores or manually weight housing vouchers.
Data Inputs
Reliance on Credit History
Using credit scores and non-tenancy debt disadvantages minority applicants.
Omission of Housing Vouchers
The algorithm fails to factor in the financial security of housing vouchers.
Human Factors
Overreliance on AI Scores
Landlords deferred to the automated decline recommendation without review.
Avoidance of Direct Engagement
Landlords used software to pass the blame for rejections to a computer.
Process and Methods
Lack of Application Transparency
Applicants were not notified of AI use or given an avenue to appeal.
No Individualized Assessment
Automation replaced holistic reviews of tenant rental history and references.
Management
No Independent Validation
SafeRent did not have its scoring algorithm validated by fair housing groups.
Prioritization of Automation
Designing tools to screen out applicants quickly without bias risk assessment.
Regulatory Environment
Few AI Regulations
Lack of laws limiting AI use in critical life decisions like housing.
Inadequate AI Oversight
Regulatory bodies lacked proactive enforcement for algorithmic discrimination.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
