This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Springer Nature published an academic book on AI ethics that contains numerous fabricated citations, likely generated by large language models. Independent researchers verified that many references, including journals, do not exist. This incident highlights ongoing concerns regarding the integrity of academic publishing in the age of generative AI.
'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems,' published by Springer Nature in June 2025, reportedly contains numerous purportedly untraceable academic citations. Independent analyses by multiple researchers allegedly found that a substantial share of references in certain chapters could not be verified, including citations to journals that do not exist. Citation patterns reportedly appear consistent with known large language model hallucination behaviors.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The AI system failed to perform reliably by hallucinating non-existent sources, demonstrating a lack of factual capability.
The AI system generated false and fabricated academic citations, leading to the spread of incorrect information within a published academic book.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by the AI system unintentionally generating fabricated citations (hallucinations) during text generation after the model was deployed.
Added categories peak at 3: Substantial (Epistemic Harm, Indirect)
The incident involves the publication of an academic book containing AI-hallucinated citations. While it highlights critical challenges regarding research integrity and the reliability of academic literature in the age of generative AI, it presents negligible threat to national security across all assessed categories.
The AI system (large language model) acted as an assistant to the authors, generating text and citations to augment their writing process, but failed due to a lack of proper human oversight and verification of the generated references.
Limited Risk: The incident involves AI-generated content (fabricated academic text and citations) from a large language model, which falls under the category of AI-generated content requiring transparency obligations.
The AI system was used by the book's authors to assist in writing academic chapters and generating references, acting as a writing assistant.
The report clearly details the fabrication of citations in a specific academic book published by Springer Nature, verified by independent researchers using detection tools. The role of AI in generating these 'hallucinated' citations is strongly supported by expert analysis, although the exact AI model used by the authors is not explicitly named.
The citations could theoretically have been fabricated manually by human authors without AI assistance, though experts note AI is the simplest and most likely method.
Technology
AI Hallucination of Citations
Generative AI tools fabricated realistic but non-existent academic references.
Inadequate Integrity Detection Tools
Publisher detection tools failed to flag fabricated and erroneous citations.
Data Inputs
Unverified Reference Data
Unverified bibliographic data was included in final draft submissions.
Human Factors
Author Academic Misconduct
Authors used AI to generate text and failed to verify the cited sources.
Peer Reviewer Oversight
Peer reviewers failed to verify the validity of cited academic journals.
Process and Methods
Flawed Peer-Review Process
The peer-review process failed to guarantee high standards and catch errors.
Inadequate Content Review
Publisher content review processes did not catch fake citations before print.
Management
Inadequate Risk Mitigation
Management failed to implement safeguards despite previous book withdrawal.
Regulatory Environment
Lack of Academic AI Standards
Absence of clear industry regulations governing generative AI use in research.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
