This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
India's National Company Law Tribunal (NCLT) relied on six AI-hallucinated legal precedents to rule against Essel Infraprojects in an insolvency case. The Supreme Court of India later invalidated the decision, noting that the tribunal had used fabricated case law that did not exist or contained false quotes. The Supreme Court emphasized that such reliance on AI-generated material contaminates the judicial process and constitutes a significant institutional concern.
In Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd., India's National Company Law Tribunal (NCLT) reportedly admitted insolvency proceedings against Essel Infraprojects after relying on six purported precedents later found to be fabricated or materially inaccurate. The appellate tribunal upheld the ruling, but the Supreme Court later invalidated both decisions and sent the insolvency petition back to the NCLT for a new ruling.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The NCLT judges and NCLAT appellate authority relied on AI-generated legal research without verifying the authenticity of the cited precedents.
The underlying AI system failed to perform reliably, producing severe hallucinations and fabricating non-existent case law.
The AI system generated fabricated legal precedents and false quotes, leading the tribunal to make a judicial decision based on false beliefs, which caused material legal harm to the affected company.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by an AI system generating hallucinated, non-existent legal precedents, which was an unexpected and unintended outcome of its deployment for legal research.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
An Indian judicial tribunal relied on six AI-hallucinated legal precedents in an insolvency ruling, which was subsequently overturned by the Supreme Court. The incident highlights minor risks to government functions and judicial integrity from unverified AI usage, but lacks broader national security implications.
The AI system acted as an Assistant, designed to augment the tribunal's legal research capabilities by providing case law suggestions. It required human oversight and verification, which the tribunal failed to perform, leading to the integration of hallucinated precedents into the judicial order.
High Risk: The AI system was used in the administration of justice to assist in judicial decision-making, which has significant implications for fundamental rights (such as the right to a fair trial) and public interests.
The AI system was used by the tribunal to conduct legal research and find precedents to support its judicial decision-making process.
The report provides clear, detailed, and consistent information about the specific hallucinated judgments, the court's reaction, and the legal consequences. The role of the AI system (generating fabricated precedents) is explicit, and the resulting harm to the judicial process is well-documented.
None. The facts of the hallucination and its impact on the court ruling are undisputed.
Technology
AI Hallucination
AI system generated fake, non-existent, and hallucinated legal precedents.
Lack of Fact-Checking in AI
AI system lacked mechanisms to cross-reference real legal databases.
Data Inputs
Unverified AI Search Outputs
The tribunal used raw, unverified AI outputs as factual judicial research.
Human Factors
Judicial Overreliance on AI
Tribunal relied on AI capabilities, infiltrating intellectual work ethics.
Failure to Verify Citations
The tribunal failed to manually check the existence of the cited judgments.
Process and Methods
Inadequate Citation Verification
No standard procedure existed to verify self-sourced judicial citations.
Deficient Appellate Review
NCLAT upheld the order without independently verifying the cited authorities.
Management
Lack of AI Risk Training
Management failed to train judicial officers on AI hallucination risks.
Inadequate Judicial Oversight
No oversight mechanism existed to monitor AI use in tribunal research.
Regulatory Environment
Absence of AI Guidelines in Law
No regulatory framework governed the use of AI tools in judicial drafting.
Lack of Misconduct Penalties
No clear rules existed classifying unverified AI citations as misconduct.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
