This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
An investigation by NewsGuard found that TikTok's 'For You' recommendation algorithm actively promoted disinformation regarding the Russia-Ukraine war to new users within 40 minutes of account creation. The algorithm, which prioritizes engagement, failed to distinguish between reliable news and false propaganda, such as manipulated video game footage and debunked Kremlin narratives. This systemic failure highlights the platform's role in amplifying viral misinformation during a global conflict.
An investigation by NewsGuard into TikTok’s handling of content related to the Russia-Ukraine war showed its “For You” algorithm pushing new users towards false and misleading content about the war within less than an hour of signing up.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Highly personalized AI-generated misinformation creating “filter bubbles” where individuals only see what matches their existing beliefs, undermining shared reality, weakening social cohesion and political processes.
Also classified as
The platform's recommendation engine was exploited by state-backed actors to conduct large-scale, coordinated disinformation campaigns targeting public opinion.
Users, particularly young demographics, overrelied on TikTok as an authentic and primary news source for critical real-time war updates.
The recommendation algorithm systematically polluted the information ecosystem by serving unverified and false war content to users at scale, undermining a shared consensus reality during a major global conflict.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk of spreading disinformation was an unexpected and unintended outcome of the recommendation algorithm pursuing its goal of maximizing user engagement.
Added categories peak at 4: Severe (Epistemic Harm, Direct)
Tiktok's recommendation algorithm autonomously amplified state-backed Kremlin propaganda and false war narratives to new users during the Russia-Ukraine conflict. This represents a substantial information warfare concern, demonstrating how engagement-maximizing AI systems can be exploited to pollute the information ecosystem at scale during active geopolitical crises.
The recommendation algorithm operates independently to curate and serve content in real-time based on user interaction patterns without human intervention.
Unacceptable Risk: The system is described as using behavioral manipulation on a vulnerable young audience, leading to emotional manipulation and distress.
The primary function of the TikTok 'For You' algorithm is to recommend and curate personalized video content to users to maximize engagement.
The reports provide clear, consistent, and empirical evidence of the algorithm's behavior from multiple independent sources (NewsGuard, NYT, Fortune, Guardian). The role of the recommendation algorithm is explicitly defined and tested.
The incident could be viewed as a moderation failure rather than an algorithmic failure, though the algorithm's active promotion of the content makes it an AI safety issue.
Technology
Engagement-driven Algorithm
Prioritizes watch time and pushes users into disinformation rabbit-holes.
Easy Audio Reuse Feature
Allows old or unrelated audio to be paired with misleading war footage.
Inherent Video Moderation Difficulty
Video is a highly complex format for automated moderation algorithms.
Data Inputs
Lack of Content Labeling
Absence of labels distinguishing disinformation from trusted news.
Unverified Video Submissions
Unauthenticated video game footage uploaded as real-time war media.
Misleading Audio Soundtracks
Recycled audio tracks from unrelated past events uploaded to new videos.
Human Factors
User Overtrust of Platform
Young users perceive TikTok content as authentic and fail to fact-check.
Lack of User Digital Literacy
Difficulty among general users in identifying simulated video footage.
Coordinated Influence Campaigns
Pro-Kremlin operatives and paid influencers spreading targeted propaganda.
Process and Methods
Inadequate Content Moderation
Inability to quickly review and remove viral, unverified war footage.
Absence of Trustworthiness Indicators
Failure to provide source credibility ratings, warnings, or fact-checks.
Inadequate Search Filtering
Search suggestions include heavy disinformation in top twenty results.
Management
Prioritizing App Growth
Focus on user retention and engagement over robust safety guardrails.
Delayed Safety Resource Allocation
Safety and security resources were only increased reactively after the crisis.
Inconsistent Account Verification
Verifying state-backed propaganda actors while allowing them to spread myths.
Regulatory Environment
Russian Fake News Law
Forced suspension of local uploads, altering the balance of content.
Lack of Global AI Standards
No uniform regulations requiring algorithmic transparency or safety audits.
Geopolitical State Influence
State-backed media outlets exploiting platforms to push geopolitical agendas.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
