This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Facebook's automated misinformation detection system incorrectly flagged eyewitness documentation of the Lekki toll gate shooting in Nigeria as 'false information'. This action suppressed content depicting military violence against #EndSARS protesters, leading to concerns about the platform's role in silencing human rights reporting and delegitimizing the experiences of victims.
Facebook incorrectly labels content relating to an incident between #EndSARS protestors and the Nigerian army as misinformation.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
The system's incorrect flagging of authentic media as false information effectively generated and spread a misleading belief about a real-world event.
The report highlights that it was not completely clear how Facebook's hybrid system arrived at the conclusion to flag the Lekki-related content.
The AI system failed to perform reliably under high-stakes real-world conditions, incorrectly flagging authentic crisis documentation as false and exposing the platform to severe operational errors.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The suppression of legitimate human rights documentation was an unexpected and unintentional outcome of deploying the automated misinformation detection system.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
An automated AI content moderation system on Facebook and Instagram incorrectly flagged and suppressed authentic eyewitness media of military violence during Nigeria's #EndSARS protests. This unintentional system failure resulted in substantial societal stability and human rights impacts by restricting real-time crisis reporting and delegitimizing victims' experiences on a massive scale.
The report explicitly states that 'Facebook uses a hybrid system of human moderators and Artificial Intelligence (AI) to check misinformation' to identify, review, and confirm content.
Limited Risk: The system is an AI-driven content moderation and labeling tool that interacts with users by displaying warning labels, falling under transparency obligations.
The AI system's primary function is to identify, review, and flag potentially inaccurate content to curb viral misinformation on Facebook and Instagram.
The report provides clear details about the incident, the platforms involved (Facebook and Instagram), the specific real-world event (Lekki toll gate shooting), and how the hybrid AI/human system incorrectly flagged the content. The role of the AI system is explicitly stated, and the resulting harms to information dissemination and human rights reporting are well-documented.
None. The event is clearly a content moderation failure that suppressed real-world news.
Technology
Flawed Automated Matching Algorithm
Algorithmic matching falsely linked real images to debunked posts.
Inexact AI Content Classification
AI struggled to distinguish context between real and fake reports.
Data Inputs
Unreliable User Flagging Signals
System relied on user flags which may be coordinated or biased.
Lack of Contextual Metadata
System lacked real-time local context to verify media authenticity.
Human Factors
Fact-Checker Bias or Errors
Third-party partners made incorrect assessments of the incident.
User Inability to Dispute Ratings
Viewers could not challenge incorrect automated false labels.
Process and Methods
Inadequate Review Escalation
No rapid path to override automated flags during breaking news.
Flawed Hybrid Moderation Workflow
Integration between AI flagging and human review failed to sync.
Management
Poor Definition of Misinformation
Facebook management failed to clearly define inaccurate information.
Inadequate Local Risk Assessment
Insufficient preparation for political crises in African markets.
Regulatory Environment
Lack of Government Oversight
No regulatory standards for social media moderation in crises.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
