This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Bereaved families are reporting significant emotional distress caused by the proliferation of unauthorized, AI-generated obituaries. These articles, often riddled with factual errors, are produced by content farms to exploit search engine trends for advertising revenue. The practice has been identified as a new strategy to monetize grief, with families finding their loved ones' obituaries replaced or misrepresented by low-quality, automated content.
AI-generated obituaries on various websites are reported to have compounded the grief of bereaved families by spreading incorrect and unauthorized information about their loved ones. These obituaries, produced without the families' knowledge, often contain errors and appear on ad-filled sites, exacerbating the emotional distress of the grieving process.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
Mass AI-generated obituaries are polluting search engine results and social media feeds to capture ad revenue.
The AI-generated obituaries copied, expanded, and effectively displaced the original, carefully written obituaries created by the grieving families.
The AI systems generated obituaries containing significant factual errors, such as false claims about military accolades, which misled readers and caused distress to the families.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk is driven by human operators of content farms who intentionally deploy generative AI tools to scrape and generate unauthorized obituaries for ad revenue.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
The incident involves commercial content farms using generative AI to produce low-quality, error-prone obituaries for search engine optimization and ad revenue. While causing significant emotional distress to bereaved families, it carries negligible national security implications across all assessed categories.
The generative AI systems were used as tools by content farm operators to rapidly rewrite and expand scraped obituary text based on direct inputs.
Risk Level 3: The incident involves the generation of public-facing text content using generative AI tools, which falls under transparency obligations for AI-generated content to ensure users are aware they are interacting with synthetic media.
The AI systems were used as writing assistants to rewrite, expand, and generate text for obituaries based on existing human-written drafts.
The report provides clear, first-hand accounts from multiple affected individuals detailing how AI-generated obituaries impacted them, supported by explanations from an SEO expert. The role of generative AI in content farms is explicitly described.
None. The reports consistently point to automated, AI-driven content generation as the source of the error-strewn obituaries.
Technology
Generative AI Hallucinations
AI tools expanded obituaries with false details like fake military medals.
Automated Content Generators
AI tools allowed rapid, low-cost scaling of low-quality obituary spam.
Data Inputs
Scraped Obituary Data
AI scrapers took legitimate family obituaries without consent to rewrite them.
Lack of Input Verification
No mechanism to verify the truth of AI-expanded details against source data.
Human Factors
SEO-Obsessed Publisher Mindset
Publishers prioritize search traffic over accuracy and respect for the dead.
Negligent Human Review
Hired writers ran text through AI without checking for factual errors.
Process and Methods
Content Chop Shop Model
Processes designed to quickly spin and publish stories using generative AI.
Aggressive SEO Optimization
Exploiting search spikes for deceased names to direct traffic to spam sites.
Management
Prioritizing Ad Revenue Over Ethics
Sites focus on monetizing grief through cheap ads and high content volume.
Exploitative Business Models
Hiring cheap labor to run AI tools to generate profit from tragic events.
Regulatory Environment
Lack of AI Content Regulation
No legal frameworks exist to prevent unauthorized AI-generated biographies.
Weak Search Engine Oversight
Search platforms fail to filter out low-quality AI obituary spam sites.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
