This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
During a period of significant breaking political news, including the Trump rally shooting and President Biden's campaign withdrawal, multiple popular AI chatbots failed to provide accurate, real-time information. Testing revealed that these systems often provided outdated, incorrect, or evasive responses, highlighting their limitations in handling fast-paced news cycles. While some companies implemented guardrails to redirect political queries, the overall performance raised concerns about the reliability of AI as a source for current events.
Over a week of back-to-back, significant breaking political news stories, including the Trump rally shooting and Biden’s campaign withdrawal, AI chatbots reportedly failed to provide accurate real-time updates. Most chatbots gave incorrect or outdated information, demonstrating their current limitations in handling fast-paced news. These incidents suggest the continuing need for improved AI capabilities and caution in their deployment for real-time news dissemination.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The chatbots demonstrated a lack of capability and robustness in handling real-time, fast-paced breaking news events reliably.
The AI chatbots generated false or misleading information regarding major breaking news events, such as denying that an assassination attempt on Donald Trump had occurred.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by deployed AI chatbots unintentionally generating incorrect, outdated, or evasive responses to real-time news queries.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
During critical political events in July 2024, multiple major AI chatbots failed to provide accurate real-time updates, instead delivering outdated, evasive, or false information. While this did not constitute an active information warfare attack, it highlights a systemic vulnerability in public information ecosystems, as millions of users increasingly rely on autonomous AI systems for breaking news.
The chatbots function as conversational assistants designed to provide information and answer user queries. The report notes they are 'designed to give conversational answers and keep people engaged' and are integrated into search features to help users get information.
Risk Level 3: Limited Risk. The systems described are 'AI chatbots' which are subject to transparency obligations under the Act to ensure users are aware they are interacting with an AI.
The primary function of the systems (ChatGPT, Gemini, Copilot, Meta AI, Perplexity) is acting as conversational chatbots that answer user questions.
The report provides clear, direct testing results of multiple specific AI chatbots during well-known historical events. The failures are explicitly documented with quotes from spokespeople and specific chatbot responses.
The failures could be interpreted as expected limitations of static LLMs rather than active safety failures, though their integration as default search tools elevates the risk.
Technology
Post-hoc Citation Generation
Sourcing is added after the fact, causing reference and accuracy issues.
Delayed Update Capabilities
Chatbots are not real-time products and require time to update databases.
Optimization for Engagement
Systems are optimized for conversational engagement rather than factual truth.
Data Inputs
Information Vacuum
Lack of immediate credible data right after breaking news events occurs.
Unreliable Real-time Pulling
Pulling from early, unverified reports leads to displaying false claims.
Human Factors
User Reliance on AI for News
Users turn to conversational AI for instant answers during breaking news.
Process and Methods
Inadequate Real-time Verification
No process exists to quickly verify and update facts during breaking events.
Aggressive Query Blocking
Redirecting political queries to search engines instead of answering them.
Sudden Deletion of Correct Info
Meta AI deleted correct answers to replace them with generic messages.
Management
Prioritizing Caution Over Utility
Companies block election queries out of an abundance of caution.
Premature Search Integration
Baking unoptimized chatbots into default search features across platforms.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
