This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
X's AI chatbot, Grok, generated a news summary that falsely claimed former President Donald Trump was missing his dentures during an interview with Elon Musk. The summary, which was based on unsubstantiated user speculation, was briefly published before being removed by the platform. This incident follows previous reports of Grok spreading election-related misinformation, leading to concerns from state officials regarding the tool's reliability.
Grok, X’s AI-powered chatbot, reportedly spread unsubstantiated claims about former President Trump’s alleged dentures during his interview with Elon Musk. The AI-generated summary is alleged to have falsely stated that Trump’s speech issues were due to missing dentures, despite no evidence. The post was quickly removed, but the incident is an example of concerns over Grok's tendency to amplify misinformation.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The AI system failed to perform reliably by treating unverified social media rumors as factual news, demonstrating a lack of capability in verification.
Grok generated and spread a false and unsubstantiated claim about Donald Trump, creating misleading content that could lead to inaccurate beliefs.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The false summary was generated by the Grok AI system after its deployment, representing an unintended hallucination while attempting to summarize trending topics.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
X's AI chatbot Grok generated a false news summary claiming Donald Trump was missing his dentures during an interview. While highlighting the risks of AI-generated misinformation during an election cycle, the incident was quickly corrected and carried minor national security implications.
Grok is described as an AI-powered chatbot that generates news summaries from trending topics to assist premium subscribers, requiring human oversight to correct its errors.
Limited Risk: Grok is a chatbot, which is explicitly classified under Risk Level 3 requiring transparency obligations so users know they are interacting with AI.
Grok is an AI chatbot designed to interact with users and automatically curate and summarize trending topics on the X platform.
The report clearly details the specific incident, the AI system involved, the source of the error, and the platform's response, leaving little ambiguity about the sequence of events.
None
Technology
Automated Trend Summarization
Grok automatically generates summaries from trending topics without validation.
Lack of Fact-Checking Logic
The AI model cannot distinguish between user rumors and verified facts.
Data Inputs
Unverified Social Media Inputs
Grok relies on raw, unverified user posts and rumors as its primary input.
Amplified Partisan Speculation
Viral political posts about Trump's speech served as input data for Grok.
Human Factors
User Propagation of Rumors
Users posted unsubstantiated claims about Trump's speech during the live event.
Process and Methods
No Human-in-the-Loop Review
Summaries are published automatically without editorial oversight.
Rapid Real-Time Publishing
The automated pipeline prioritizes speed over accuracy of summaries.
Management
Prioritizing Speed Over Safety
Management deployed real-time summaries despite known hallucination risks.
Ignoring Systemic Failures
Management failed to address known misinformation patterns from prior incidents.
Regulatory Environment
Weak AI Misinformation Standards
No external regulatory standards enforce accuracy in platform-generated news.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
