An Instagram algorithmic bug resulted in the 'related hashtags' feature being disabled for Trump-related search terms while remaining active for Biden-related terms. This disparity meant that users searching for Biden were directed to negative and disinformation-laden hashtags, while Trump-related searches were shielded from such associations. Instagram later disabled the feature entirely while investigating the issue.
A bug was reported by Instagram’s spokesperson to have prevented an algorithm from populating related hashtags for thousands of hashtags, resulting in an allege preferential treatment for some politically partisan hashtags.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
Users searching for standard political terms were exposed to abusive, inappropriate, and toxic hashtags suggested by the platform.
The algorithm recommended and propagated hashtags containing false information and baseless smears against a presidential candidate.
The incident stems from a technical error or bug in Instagram's recommendation algorithm that caused it to fail to perform reliably and equitably across parallel search terms.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by an unintentional technical bug in Instagram's deployed related hashtags recommendation algorithm.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
An Instagram algorithmic bug in 2020 resulted in disparate treatment of US presidential candidates, shielding one from negative search terms while directing users to disinformation and smears against the other. This highlighted substantial vulnerabilities in social media recommendation systems that can be exploited or fail during critical democratic processes.
The report describes an algorithm that automatically and independently generates 'related hashtags' to point users to other relevant content based on search inputs, operating without real-time human oversight or explicit planning.
Minimal or No Risk: The AI system is a hashtag recommendation algorithm on a social media platform, which falls under general entertainment and information search applications, posing low direct safety risks under the specified categories.
The primary function of the algorithm is to automatically generate and suggest 'related hashtags' to users who search for or click on a specific hashtag, thereby recommending related content.
The reports from Tech Transparency Project and BuzzFeed News provide clear, consistent details about the nature of the algorithmic bug, the specific hashtags affected, the platform's response, and the political context. Instagram's spokesperson confirmed the technical error, leaving little ambiguity about the occurrence of the event.
Some critics suggested the disparate treatment was intentional political bias or an in-kind campaign contribution, though Instagram maintained it was an unintentional technical bug.
Technology
Algorithmic Suggestion Bug
A technical error suppressed related hashtags for some terms but not others.
Algorithm Vulnerability
The suggestion engine was easily gamed by bad actors to spread disinformation.
Data Inputs
Toxic User-Generated Content
The algorithm ingested vitriolic hashtags like creepyjoebiden as inputs.
Human Factors
Lack of Active Human Oversight
Experts noted political hashtags lacked constant human review before elections.
Process and Methods
Ad-Hoc Policy Application
Hashtag disabling was applied inconsistently across different public figures.
Inadequate Algorithmic Audits
The bug went unnoticed for months, showing a lack of regular system audits.
Management
Asymmetric Safety Guardrails
Management failed to ensure equal protective measures for both campaigns.
Unpreparedness for Election
Despite safety promises, management did not prevent critical algorithmic bugs.
Regulatory Environment
Unclear Campaign Finance Rules
Lax rules failed to prevent asymmetric algorithmic treatment of candidates.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.