This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A judge in Esquel, Argentina, had a criminal conviction annulled after it was discovered he used ChatGPT to draft portions of the ruling. The judge accidentally included the AI's prompt response in the final document, revealing a lack of human oversight and potential data privacy violations. The case has been reassigned, and an ethics investigation into the judge's conduct is underway.
The Penal Chamber of Esquel, Argentina, reportedly annulled a June 2025 robbery conviction after determining that Judge Carlos Rogelio Richeri had allegedly used ChatGPT to draft part of the ruling without disclosure or human oversight. A copied phrase purportedly exposed AI authorship, prompting findings of due-process violations and data-handling concerns. The case was reassigned, and the Chubut Superior Court opened an ethics investigation.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.
Also classified as
The judge uploaded sensitive personal data of parties, witnesses, and experts to an external AI platform, violating judicial confidentiality rules.
The judge over-relied on ChatGPT to draft a critical criminal sentencing ruling, failing to exercise mandatory human supervision and control over the output.
Human
Due to a decision or action made by humans
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the judge's human decision to use ChatGPT to draft a judicial sentence without proper oversight, and the resulting risk of annulment was an unexpected outcome of this action.
An Argentine judge had a criminal conviction annulled after using ChatGPT to draft key portions of the ruling without proper oversight, exposing sensitive personal data of parties and witnesses. This incident highlights growing risks of AI overreliance in judicial decision-making and government functions, though its national security impact remains minor and localized.
The report describes the judge using ChatGPT as a generative AI assistant to write, plan, and explore ideas, specifically to draft a portion of the judicial sentence. The court noted that the tool is a 'complementary tool' designed to collaborate with the judge rather than substitute their intellectual activity.
High Risk: The report describes the use of AI in the administration of justice to draft a criminal sentence, which has significant implications for fundamental rights and public interests, specifically violating due process.
The judge used the generative AI system to draft and re-edit a portion of a judicial sentence, treating it as a writing assistant, while also delegating aspects of judicial decision-making.
The reports provide clear, consistent, and detailed accounts of the incident, including the specific phrase that exposed the AI use, the legal consequences (annulment of the sentence), and the ethical/privacy concerns raised by the court. There is no conflicting information among the sources.
None
Technology
Online Assistant Use
Using external web-based AI tools for processing sensitive legal texts.
Conversational Meta-text
AI output included conversational phrases that were copied into the text.
Data Inputs
Confidential Data Leakage
Inputting names of parties, witnesses, and experts into external AI.
Human Factors
Lack of Human Supervision
The judge signed the sentence without checking the AI-generated content.
Overreliance on AI
Directly copying and pasting AI text for central parts of the ruling.
Careless Copy-Pasting
Failing to remove conversational AI text before finalizing the document.
Process and Methods
Delegation of Decision-Making
Delegating core judicial reasoning and resolutions to an automated system.
Lack of Reasoning Traceability
Failing to document prompts or the extent of AI assistance in the ruling.
No Disclosure of AI Use
Omitting the required record of AI collaboration in the final sentence.
Management
Lack of Institutional Control
Absence of monitoring or validation systems for AI use in court rulings.
Unclear Ethical Boundaries
Insufficient guidance on acceptable limits of AI assistance for judges.
Regulatory Environment
Breach of Confidentiality Rules
Violating Agreement N 5435 regarding digital data processing safety.
Violation of Natural Judge Principle
Delegating the constitutional duty of judging to an automated system.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
