This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
DuckDuckGo and Brave's AI search features falsely claimed that Donald Trump and JD Vance died of rabies after being tricked by a coordinated data-poisoning campaign on Reddit and a pink slime news website.
DuckDuckGo's Search Assist reportedly produced an answer stating that Donald Trump and JD Vance had died of rabies and repeated fabricated details involving Robert F. Kennedy Jr. The answer cited a false WKNA49 article alongside an unrelated ABC News report. Reporting linked the episode to adversarial web content associated with r/poisonai. DuckDuckGo said Search Assist had been "deliberately tricked," fixed the result, and planned updates.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The AI search engines failed to perform robustly by failing to verify sources and cross-reference claims, making them vulnerable to data poisoning.
The AI systems inadvertently generated and spread false information about the deaths of political figures, which could lead to inaccurate beliefs in users.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the AI search engines generating and presenting false information as fact, which was an unexpected and unintentional outcome of their deployment.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
A coordinated data-poisoning campaign by a Reddit community successfully manipulated DuckDuckGo and Brave's AI search features into falsely reporting the deaths of high-profile US political figures. While the incident was a prank with negligible direct national security impact, it highlights an evolved vulnerability in real-time AI information retrieval systems that could be exploited for targeted information operations.
The AI systems involved (DuckDuckGo Search Assist and Brave Search AI) act as search assistants, providing synthesized information and suggestions to users based on web queries, but requiring human oversight and verification.
Limited Risk: The report describes AI chatbots and search assistants generating text content, which fall under transparency obligations to ensure users are aware they are interacting with AI.
The AI systems involved are search engine assistants designed to answer user queries by searching the web and synthesizing the results into a direct answer.
The reports provide consistent, detailed accounts of the incident across multiple sources (Futurism, Tom's Guide, Mimikama), including screenshots, official statements from Brave and DuckDuckGo, and the specific mechanics of the r/poisonai subreddit and the WKNA 49 pink slime website.
The incident could be viewed purely as a successful data-poisoning experiment/prank rather than an AI safety failure, though the AI's failure to verify sources is the core safety issue.
Technology
AI Hallucination and Synthesis
AI merged unrelated ABC News rabies article with false Trump claims.
Weak Source Verification
Search systems failed to verify if cited sources actually backed the claim.
Authoritative Tone of LLMs
AI presented unverified, false information in a highly confident manner.
Data Inputs
Deliberate Data Poisoning
Reddit community r/poisonAI coordinated to flood the web with fake stories.
Pink Slime Web Scraping
AI scraped automated pink-slime news sites that laundered Reddit rumors.
Keyword-Based Association
AI pulled an unrelated ABC News rabies article based purely on keyword match.
Human Factors
User Overreliance on AI
Users trust AI summaries and links without opening them to verify content.
Coordinated Prankster Campaigns
Reddit users actively worked to trick AI systems into spreading rumors.
Process and Methods
Lack of Fact-Checking Filters
Search engines did not run cross-checks with reputable independent media.
Inadequate Satire Detection
AI algorithms struggled to distinguish online sarcasm and satire from reality.
Management
Deflecting Quality Responsibility
Brave management shifted the entire burden of fact-checking onto end users.
Premature AI Search Deployment
Deploying AI search features before establishing robust data-trust measures.
Regulatory Environment
Lack of Pink-Slime Regulation
No standard regulations to prevent automated fake news sites from operating.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
