The Washington State Department of Licensing implemented an AI-driven phone system that failed to provide requested Spanish-language support. Callers selecting the Spanish option were instead met with an AI voice speaking English with a Spanish accent. The agency attributed the error to staff configuration and technical issues, which created significant accessibility barriers for Spanish-speaking residents.
For months, callers to the Washington State Department of Licensing who selected Spanish reportedly received AI-generated English responses spoken with a Spanish accent rather than actual Spanish-language service. The agency reportedly apologized and said staff configuration caused the error, which purportedly created accessibility problems for callers seeking language support.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Also classified as
The system exhibited a technical failure where it outputted English with a Spanish accent instead of translating the text into Spanish.
The AI-driven phone system failed to perform effectively for Spanish-speaking users compared to English-speaking users, resulting in unequal outcomes and reduced benefits based on language group membership.
Human
Due to a decision or action made by humans
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human configuration errors made by DOL staff when setting up the deployed AI-driven phone system.
An administrative and technical configuration error in the Washington State Department of Licensing phone system resulted in accessibility barriers for Spanish-speaking residents. While it caused localized public service delivery issues, it has negligible national security implications and is being managed through standard administrative procedures.
The system acts as a deterministic text-to-speech tool, converting predefined English text into spoken audio using a selected voice profile without autonomous planning or decision-making.
Limited Risk: The system is an AI-driven automated voice/chatbot service, which falls under transparency obligations where users must be informed they are interacting with an AI.
The system's primary function is generating spoken audio from text to assist callers with licensing information.
The reports are consistent, from reputable sources, and clearly describe the technical glitch, its impact, and the agency's response. The technical cause is identified as human configuration error.
None
Technology
Newer AI Platform Integration
The self-service option runs on newer, AI-driven technology.
Incorrect Voice Model Selection
An AWS voice mimicking Castilian Spanish was selected for English text.
Data Inputs
Untranslated English Text
The system provided English text instead of translating it to Spanish.
Incomplete Translation Variables
Only numbers like 'tres' were translated while main text remained English.
Human Factors
DOL Staff Configuration Error
Agency staff misconfigured the settings on the AWS phone platform.
Lack of User Verification
Staff failed to check how the voice sounded to Spanish-speaking callers.
Process and Methods
Inadequate Pre-testing
Testing on all language options was not completed before deployment.
Delayed Issue Resolution
The system glitch persisted for months without being identified or fixed.
Management
Lack of Project Oversight
Management deployed the system without ensuring proper quality checks.
Poor Feedback Monitoring
No mechanism was active to capture and act on early user complaints.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.