This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Opera released a browser integrating an AI chatbot, Aria, which is based on OpenAI's GPT technology. The chatbot was found to provide defamatory responses by falsely accusing several renowned war photographers of committing war crimes. The author highlights the lack of fact-checking capabilities and ethical safeguards in such AI products.
When prompted about "photographers accused of committing war crimes," Opera's GPT-based chatbot Aria provided a list of photographers who take photography of military conflicts.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The chatbot failed to perform reliably by hallucinating severe false accusations due to a lack of fact-checking capabilities.
The AI system generated false and defamatory accusations against real individuals, leading to the spread of incorrect and harmful information.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The defamatory output was caused by the AI chatbot generating unintended hallucinations after being deployed to the public.
Added categories peak at 2: Minor (Psychological Harm, Direct)
An integrated browser chatbot, Opera Aria, hallucinated and generated defamatory statements falsely accusing five prominent war photographers of committing war crimes. While the incident highlights ongoing challenges with LLM accuracy and epistemic security, its direct national security impact remains minor and localized to reputational harm for the affected individuals.
The system is described as an 'AI chatbot' integrated into a browser that 'answered one of my questions'. This fits the Assistant profile as it provides information to a user upon request and requires human oversight.
Limited Risk: The system is an 'AI chatbot called Aria' which falls under Limited Risk due to transparency obligations for user-interacting AI systems.
The system is explicitly described as an AI chatbot integrated into a browser that answers user questions.
The report clearly details the specific AI system (Opera Aria based on GPT), the exact nature of the failure (hallucinating war crime accusations), and the specific individuals affected. There is little ambiguity about what occurred.
None
Technology
Statistical Word Associations
AI generates text based on shifting probabilities of words.
Lack of Fact-Checking
The chatbot completely lacks the ability to fact check its outputs.
Blackbox AI Correlations
AI operates as a blackbox of obscure correlations between words.
Data Inputs
Live Web Results Integration
Integrating live web results without verifying their accuracy.
Process and Methods
Lack of Rigorous Testing
The AI product was released to the public without adequate testing.
No Transparent Editorial Policy
System lacks transparent editorial policies to guide generated content.
Lack of Ethical Frameworks
The chatbot outputs are not constrained by common sense or ethics.
Management
Premature Product Release
Management released the chatbot browser integration without safeguards.
Regulatory Environment
Lack of Regulatory Oversight
No regulatory framework prevents dumping untested AI on society.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
