This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
During the aftermath of an assassination at Utah Valley University, multiple AI systems including Perplexity, Grok, and Google AI Overview generated and amplified false information. These systems incorrectly claimed the victim was alive, misidentified a private citizen as the suspect, and falsely linked the victim to a foreign 'enemies' list. This incident highlights the risks of relying on AI chatbots for real-time fact-checking during breaking news events.
Multiple AI systems allegedly spread false claims in the aftermath of Charlie Kirk's assassination at Utah Valley University. Perplexity and Grok chatbots reportedly stated Kirk was alive, mischaracterized authentic video as satire, and wrongly identified Utah Democrat Michael Mallinson as the suspect. A Google AI Overview allegedly claimed Kirk was on Ukraine's Myrotvorets "enemies" list, a reported falsehood that echoed pro-Kremlin narratives.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The chatbots failed to perform reliably under breaking news conditions, confidently hallucinating false facts.
The AI systems generated and spread false information regarding an assassination and a suspect, leading to public confusion and false beliefs.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The false claims and hallucinations were generated by deployed AI systems (Grok, Perplexity, Google AI) attempting to answer user queries.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
Following a high-profile assassination, multiple commercial AI search and chatbot systems generated and amplified significant falsehoods, including falsely accusing an innocent citizen of murder and fabricating geopolitical connections. While not a coordinated state-sponsored operation, the incident highlights the national security risk of epistemic degradation during domestic crises.
The AI systems (Grok, Perplexity, Google AI Overview) operated as conversational assistants or search tools, responding to user queries in real-time to provide information, but they lacked independent goal-directed planning.
Risk Level 3: Limited Risk. The systems involved are chatbots (Grok, Perplexity) and search assistants generating content, which fall under the category of chatbots and AI-generated content requiring transparency.
The AI systems were used by social media users as fact-checkers and question-answering tools to seek clarity during a breaking news event.
The report provides clear, specific examples of the false outputs generated by Perplexity, Grok, and Google AI, including direct quotes and the names of the affected individuals. The role of the AI systems is explicitly documented.
None. The incident is clearly centered on AI-generated misinformation during a breaking news event.
Technology
Confident Hallucination Tendency
AI chatbots provide confident answers even without reliable real-time data.
Inability to Verify Real-time Info
AI cannot perform manual verification tasks like calling local officials.
Data Inputs
Unverified Real-Time Web Scraping
Chatbots ingested false social media rumors and treated them as facts.
Absence of Reliable Real-Time Data
Lack of authoritative real-time sources led AI to rely on unverified claims.
Human Factors
Overreliance on AI for Fact-Checking
Users treat AI systems as reliable sources during breaking news crises.
Weaponization of Liars Dividend
Users falsely label authentic footage as AI-generated to deny real events.
Process and Methods
Deficient Real-Time Moderation
AI-driven content moderation failed to flag and correct false chatbot outputs.
Inadequate Source Attribution Check
Algorithms fabricated citations from reputable outlets like CNN and NYT.
Management
Reduced Human Fact-Checking Investment
Tech companies scaled back human moderation, relying too heavily on AI.
Prioritizing Speed Over Safety
Deploying real-time search features without robust accuracy safeguards.
Regulatory Environment
Lack of AI Safety Standards
Absence of regulations governing real-time information accuracy in AI search.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
