This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A lawsuit filed by the Ohio Attorney General alleges that Meta (formerly Facebook) misled the public and investors about the negative mental health impacts of its Instagram algorithm on adolescents. The case, supported by internal research disclosures, claims the company prioritized profit over user safety, leading to significant financial losses for investors when the information became public. The company has denied the allegations, stating the suit is without merit.
Facebook was alleged in a lawsuit by the Ohio Attorney General purposely misleading the public about the control of its algorithms and their negative effects on children's well-being, which violated securities law.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
Also classified as
Adolescents developed unsafe reliance and emotional dependence on the platform, leading to worsened mental health outcomes.
The algorithm lacked the capability to safely curate and filter content to prevent psychological harm to vulnerable adolescent users.
The Instagram recommendation algorithm exposed adolescent users to harmful content that worsened body image issues and negatively impacted their mental health.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The underlying psychological harm was caused by the post-deployment operation of the Instagram recommendation algorithm, which unintentionally worsened body image issues for teenage girls.
Added categories peak at 4: Severe (Psychological Harm, Direct)
A federal class-action lawsuit alleges Meta misled investors and the public about the negative mental health impacts of its Instagram algorithm on teenagers. While the incident caused significant financial losses for public pension funds ($100 billion market value drop) and raised serious public health concerns, its direct national security implications remain minor and manageable within standard legal frameworks.
The Instagram algorithm autonomously curates, ranks, and amplifies content for millions of users based on engagement metrics. The reports describe the system as an algorithm that 'amplifies more controversial content' and 'worsened body issues,' operating continuously and independently to serve personalized feeds.
Risk Level 1: Unacceptable Risk. The reports describe an AI recommendation system that allegedly targets and exploits the psychological vulnerabilities of minors (adolescent girls), leading to severe mental health harms such as worsened body image issues.
The primary function of the Instagram algorithm is to recommend and curate content for users to maximize engagement, which in this case led to the amplification of harmful content to teenage girls.
The reports provide clear, consistent details about the lawsuit, the specific AI system involved (Instagram's recommendation algorithm), the whistleblower disclosures, and the resulting financial and psychological harms. The connection between the algorithm's behavior and the mental health impacts is backed by Meta's own internal research.
The incident could be viewed primarily as a corporate governance and securities fraud issue rather than an AI safety failure, though the underlying cause is the AI algorithm's harmful impact.
Technology
Algorithmic Amplification
Algorithm amplified controversial and extremist content to boost engagement.
Instagram Image Delivery
Photo-sharing algorithm worsened body image issues for teenage girls.
Data Inputs
Internal Research Data
Internal data showing mental health harms was kept hidden from the public.
Human Factors
User Mental Health Vulnerability
Adolescent users were highly susceptible to negative body image on Instagram.
Process and Methods
Inadequate Algorithm Control
Flawed controls failed to prevent amplification of harmful content.
Incomplete Risk Disclosure
Reporting processes failed to share internal research findings with investors.
Management
Prioritizing Profit Over Safety
Management prioritized growth and profit over user safety and wellbeing.
Misleading Public Statements
Executives downplayed risks and made false statements about platform safety.
Regulatory Environment
Lack of Regulatory Oversights
Inadequate regulatory rules allowed deceptive statements about product safety.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
