This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Covers risks where AI systems treat people unequally or expose them to harmful content. This includes unfair discrimination based on race, gender, or other characteristics, generation of toxic or abusive material, and performance disparities that lead to reduced benefits for certain groups.
Incident volume relative to governance coverage; each dot is one of 7 domains
Stanford University's Residential and Dining Enterprises used generative AI to alter a promotional image, replacing a Hispanic male student with an AI-generated Black woman and slimming down other students' faces, violating university policy.
Developers: Synthetic media generation technology developers, Synthetic image generation technology developers
Deployers: Universities, Synthetic media creators, Stanford University, Stanford Residential & Dining Enterprises, Educational communities
Schools in Jackson and Hall counties in Georgia were targeted by a series of hoax bomb threats delivered via AI-generated automated voicemails, leading to school evacuations, district-wide class cancellations, and significant disruption.
Developers: Synthetic media generation technology developers, Synthetic audio generation technology developers
Deployers: Synthetic media creators, Malicious actors, Information manipulation actors in the United States, Information manipulation actors, Hoax threat perpetrators
Twenty-six Meta employees have filed a lawsuit alleging that the company used internal AI-assisted systems, including 'Metamate' and an employee-trained 'second brain,' to rank workers for layoffs. The plaintiffs claim these systems disproportionately targeted employees who had taken medical, pregnancy, or family leave, violating anti-discrimination laws. Meta has denied that AI made the layoff decisions, stating that such choices are made by people.
Developers: Meta, Large language model developers, AI-assisted employment decision system developers, AI agent system developers
Deployers: Meta, AI-assisted employment decision system deployers, AI agent system deployers
Entity
Who or what caused the harm
Intent
Whether the harm was intentional or accidental
Timing
Whether the risk is pre- or post-deployment
Requires operators to disclose AI interactions, especially to minors. Prohibits manipulative tactics, sexually explicit content, or misleading mental health claims. Mandates crisis intervention protocols. Subjects violations to penalties and limits enforcement to the attorney general or consumer protection director.
Requires operators of conversational AI services to disclose AI status to all users, apply added safeguards for minors, such as preventing sexually explicit content and simulated emotional dependence, and implement suicide and self-harm crisis-referral protocols. Prohibits presenting outputs as provided by or equivalent to licensed professionals, and requires annual reporting to the Attorney General on crisis referrals and related protocols.
Regulates the use of automated decision-making technology (ADMT) in consequential decisions, requiring deployers to provide disclosures, facilitate consumer rights for correction and human review, and mandates record-keeping by developers. Grants the Colorado Attorney General exclusive enforcement authority, effective January 1, 2027.
of the 272 AI experts surveyed named unfair discrimination and misrepresentation one of the three AI risks they are most concerned about over the next five years (2025–2030).
average probability experts placed on harm from unfair discrimination and misrepresentation reaching catastrophic levels (>1M deaths, >$100B loss, or civilization-scale damage) within five years, falling to 5.5% with pragmatic mitigations.
With pragmatic mitigations
Average severity falls from severe to substantial.
534 classified mentions from 72 companies.
Browse all 534 mentions →Each metric scaled to 0–100% of its peak across all 24 subdomains, so you can compare relative standing across different scales.
