Catholic Answers released an AI chatbot named 'Father Justin' that was configured to impersonate a Catholic priest. The bot misled users by claiming to be ordained, offering sacraments, and providing controversial theological advice. Following public criticism, the organization rebranded the bot as a 'lay theologian' and removed its clerical attire.
Catholic advocacy group Catholic Answers released an AI priest called "Father Justin," which misleadingly claimed to be a real clergy member, offered sacraments, and provided controversial advice. After receiving criticism, the group rebranded the chatbot as a lay theologian to correct the misrepresentation. The incident is an instructive case with respect to deploying AI in sensitive contexts and the potential for causing confusion and harm.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The bot's design encouraged users to anthropomorphize it, leading to unsafe and inappropriate interactions such as users attempting to receive sacraments and make confessions to an AI.
The AI priest generated false and misleading information by claiming to be a real ordained priest and providing incorrect theological guidance such as Gatorade baptisms.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the AI chatbot generating unexpected and unauthorized claims about its priesthood and sacraments after it was deployed.
An AI chatbot deployed by a religious organization falsely claimed to be an ordained priest and provided unorthodox theological advice. The incident caused minor religious controversy but has negligible implications for national security across all assessed categories.
The AI system functions as a conversational chatbot designed to answer user questions and share information about Catholicism, acting as an interactive assistant rather than executing autonomous plans.
Limited Risk: The system is a chatbot, which under the EU AI Act is subject to specific transparency obligations to ensure users are aware they are interacting with an AI.
The system was explicitly designed and deployed as an interactive conversational chatbot to answer questions about the Catholic faith.
The report provides clear, direct accounts of the chatbot's behavior, the specific false claims it made, and the swift corrective action taken by Catholic Answers. There is no conflicting information or significant ambiguity regarding the core events.
The incident could be framed primarily as an HCI failure of anthropomorphism, but the generation of false theological facts makes misinformation the most direct classification.
Technology
Chatbot Hallucinations
AI claimed to be a real priest and offered sacraments.
Speech Recognition Errors
Bot misunderstood voice queries, giving unrelated answers.
Data Inputs
Inaccurate Theological Data
Allowed bot to claim baptizing babies in Gatorade is valid.
Human Factors
User Prompting of AI
Users pushed the bot to perform sacraments and confessions.
Process and Methods
Inadequate Safety Guardrails
Failed to block chatbot from claiming ordained status.
Management
Flawed Character Conception
Chose priestly avatar to convey authority without risk review.
Regulatory Environment
Lack of Canon Law AI Rules
No clear guidelines from the Vatican on AI representation.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.