This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Minnesota attorney Ahmed was fined and suspended after submitting a legal brief containing fake case citations generated by an AI writing assistant.
Minnesota attorney Faisal S. Ahmed reportedly filed a 2025 legal memorandum containing AI-generated legal authorities that included invented cases and an inaccurate quotation from an actual decision. The errors reportedly burdened opposing counsel and the Hennepin County District Court, which later fined Ahmed $5,000. He subsequently agreed to a 30-day suspension of his law license and $900 in costs.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The attorney relied on the AI's output with blind faith, failing to verify the citations before submitting them to the court.
The AI system generated fabricated legal and academic citations, which constitutes false or misleading information that misled users and the court.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the AI system hallucinating fake citations, which was an unexpected and unintentional outcome of using the tool to draft a brief.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
An attorney submitted AI-generated fake case citations in a Minnesota court, resulting in a fine and suspension. While part of a growing trend of over 800 similar incidents disrupting judicial efficiency, the national security impact remains minor, as it is contained within standard legal disciplinary frameworks.
The AI tool was used to assist the attorney in drafting a legal brief and the researcher in writing testimony, acting as a writing assistant that required human review.
Limited Risk: The system is a general-purpose chatbot (ChatGPT) used for text generation, which falls under Limited Risk and is subject to transparency obligations.
The AI was used to draft legal briefs and academic testimonies, which are writing assistant and technical text generation tasks.
The report provides clear, factual details about the specific legal cases, the names of the individuals involved, the exact fake citations generated, and the specific disciplinary actions taken. The role of the AI (hallucinating citations) is explicitly stated.
None
Technology
AI Citation Hallucination
AI tools generate realistic but completely fabricated legal cases and quotes.
Lack of Fact Verification
The AI model lacks real-time verification against official legal databases.
Data Inputs
Probabilistic Training Data
The model predicts words based on patterns rather than retrieving true facts.
Human Factors
Blind Faith in AI Outputs
The attorney accepted the AI-generated brief without verifying the citations.
Neglect of Ethical Duties
Failure to maintain competence and candor toward the court during filing.
Process and Methods
No Manual Cross-Checking
Skipping the critical step of searching for cases in official legal indexes.
Substituting AI for Analysis
Using AI tools as a shortcut instead of conducting thorough legal research.
Management
Poor Quality Control
Lack of oversight and verification procedures within the legal practice.
Regulatory Environment
Underenforced AI Guidelines
Ethical rules exist but are often violated before detection by the courts.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
