This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A NewsGuard investigation found that TikTok's search algorithm frequently surfaces false and misleading content, including dangerous health misinformation and political conspiracy theories. Despite TikTok's claims of using AI-driven moderation, the platform's search results were found to be significantly less accurate and more polarizing than those of other search engines. This is particularly concerning as TikTok is increasingly used by young people as a primary search engine for news and information.
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The algorithm exposes users to toxic and harmful content, including dangerous DIY drug recipes and unsafe herbal abortion methods like ingesting pennyroyal.
Young users are increasingly relying on TikTok as a primary search engine, trusting it for critical health and news information, which leads to unsafe use when acting on medical misinformation.
The TikTok search algorithm generated and spread false or misleading information regarding health, politics, and news events, which can lead to inaccurate beliefs and potential physical harm.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The search algorithm's recommendation and query suggestion systems unintentionally surfaced and promoted harmful misinformation to users post-deployment.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
TikTok's search algorithm was found to systematically surface misinformation and conspiracy theories to users. While not a direct kinetic threat, the platform's role as a primary information source for young populations creates substantial vulnerability to information warfare and threatens societal stability through the erosion of shared factual reality.
The TikTok search algorithm acts as an Assistant by suggesting search terms and retrieving videos based on user queries, augmenting the user's ability to find content without taking independent action.
Limited Risk: The search algorithm generates search suggestions and curates content feeds, which requires transparency regarding how results are ranked and suggested to prevent systemic misinformation.
The primary function of the AI system is to allow users to search for video content via keywords, while also recommending search queries and ranking results.
The reports are highly detailed, based on a structured empirical study by NewsGuard with clear methodology (540 search results analyzed across 27 terms). The findings are consistent across both reports, and the role of TikTok's search algorithm is explicitly documented.
One could argue the primary harm is caused by the human creators of the misinformation videos rather than the AI algorithm itself, though the algorithm's active role in suggesting and ranking these videos makes it an AI safety issue.
Technology
Flawed Search Suggestion Algorithm
Algorithm suggests highly misleading and conspiratorial search queries.
Inadequate AI Moderation Detection
AI-driven review failed to detect or flag dangerous medical misinformation.
Engagement-Biased Search Algorithm
Search algorithm prioritized polarizing and sensational content over accuracy.
Data Inputs
Lack of Algorithmic Input Disclosure
The political and data inputs driving the algorithm are not disclosed.
Circumvention via Coded Language
Users bypass word-search filters by avoiding specific terms like 'COVID'.
Human Factors
User Trust in Flawed Search Engine
Teens increasingly use the platform as a primary search tool, trusting results.
Uploader Manipulation of Filters
Creators intentionally design videos to evade automated moderation filters.
Process and Methods
Ineffective Human Moderation Follow-up
Flagged or reported content remained accessible despite violating guidelines.
Weak Algorithmic Safeguards
Platform lacked automated mechanisms to prevent promotion of dangerous remedies.
Management
Failure to Address Algorithmic Bias
Management failed to adjust algorithms that promote polarizing misinformation.
Lack of Transparency in Operations
Management refused to answer inquiries on how search algorithms feed results.
Regulatory Environment
Lack of Algorithm Transparency Rules
No regulatory oversight forcing disclosure of algorithm inputs and biases.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
