This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The Portland Water Bureau implemented an AI-driven pilot program developed by SERVUS to identify low-income customers for water bill discounts. The algorithm incorrectly selected a high-wealth individual, Columbia Sportswear CEO Tim Boyle, for a 40% discount. This incident highlights potential flaws in the algorithm's ability to accurately target financial assistance to those in need.
The Portland Water Bureau's AI-driven pilot program for water bill discounts is reported to have randomly selected Tim Boyle, a wealthy high-water consumer, for a 40% discount intended for financially struggling customers. The program, developed by SERVUS, is meant to identify underserved individuals by using machine learning.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
The AI system failed to perform reliably by selecting an extremely wealthy individual for a low-income assistance program, demonstrating a lack of capability in accurately targeting the intended demographic.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The selection of a wealthy CEO for a low-income discount was an unexpected and unintentional outcome of the deployed SERVUS algorithm.
An AI-driven pilot program by the Portland Water Bureau mistakenly allocated a low-income water bill discount to a wealthy CEO. The incident is a localized administrative and algorithmic failure with negligible implications for national security.
The SERVUS machine learning system was deployed to assist the Portland Water Bureau in identifying customers for its discount program, acting as an assistant to human decision-makers rather than operating fully independently.
High Risk: The AI system is used in critical infrastructure and the distribution of essential public services (water utility assistance).
The primary goal of the SERVUS system was to allocate financial discounts to water utility customers, which falls under Resource Allocation, by identifying eligible individuals.
The report clearly outlines the pilot program, the role of the SERVUS algorithm, and the specific outcome involving Tim Boyle. There is little ambiguity about the facts of the incident.
None
Technology
Unconstrained Randomization
The software randomly selected accounts without filtering out wealthy outliers.
Lack of Algorithmic Filters
The ML pilot lacked filters to exclude high-volume water consumers.
Data Inputs
Unfiltered Customer Input Pool
The dataset included all customers regardless of income or water usage.
Missing Financial Data
The system did not utilize financial indicators to pre-screen candidates.
Human Factors
Overreliance on Automation
Staff trusted the automated random selection without manual verification.
Process and Methods
Flawed Pilot Trial Design
The randomized control trial design included extremely wealthy individuals.
No Pre-Screening Process
The bureau did not screen the recipient list before mailing discount offers.
Management
Inadequate Risk Assessment
Management failed to foresee the PR risk of offering discounts to billionaires.
Poor Program Oversight
Approval of a randomized trial without safety boundaries for high-net-worth.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
