Following the release of ChatGPT in late 2022, widespread reports emerged of students using generative AI models to complete homework, essays, and exams. This led to significant disruption in educational institutions, prompting bans by school districts and universities, as well as the development of AI-detection tools like GPTZero. Educators expressed concerns regarding the erosion of academic integrity, the loss of critical thinking development, and the increased difficulty in verifying student work.
Students were reportedly using open-source text generative models such as GPT-3 and ChatGPT to complete school assignments and exams such as writing reports, essays.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
Students rely on AI to do their 'busywork' or critical thinking assignments, bypassing the learning process and risking cognitive enfeeblement.
The AI systems generate plausible-sounding but incorrect information ('well-written wrong'), leading to epistemic errors in student submissions.
The incident involves students using AI systems to gain an unfair academic advantage through plagiarism and cheating, which explicitly falls under AI-facilitated plagiarism in education within this sub-domain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The academic disruption and cheating are caused by the intentional decisions of students to use deployed AI systems to complete their assignments without authorization.
Added categories peak at 2: Minor (Epistemic Harm, Inferred)
The widespread use of ChatGPT by students for academic cheating represents a significant disruption to educational institutions globally, forcing updates to academic integrity policies and teaching methods. However, the incident has negligible direct national security implications, posing no threat to critical infrastructure, intelligence, sovereignty, or economic security.
The reports characterize ChatGPT and other LLMs as writing assistants that augment human capabilities by generating text, outlines, and ideas based on user prompts, but require human oversight to verify and edit. For example, the text notes it 'acts as a robotic study buddy' and 'can also write lengthy essays on almost any subject and generate ideas and outlines'.
Limited Risk: The AI systems described are chatbots (ChatGPT) and generative text models, which fall under Limited Risk due to transparency obligations, requiring users to be aware they are interacting with AI.
The primary function of ChatGPT and Sudowrite in these reports is to assist or fully automate the writing of essays, homework, and articles based on user prompts.
The reports provide consistent, detailed, and multi-perspective accounts of the academic disruption caused by ChatGPT across multiple universities and school districts. The facts regarding student usage, professor reactions, and the development of detection tools are clear and uncontradicted.
Some educators view the AI not as a cheating tool but as an educational aid similar to a calculator, suggesting the incident could be framed as a paradigm shift in teaching rather than purely a safety risk.
Technology
Generative AI Text Generation
AI produces coherent, human-like text indistinguishable from human writing.
Imperfect AI Detection Tools
Current detection tools yield false positives and negatives, lacking certainty.
Lack of Citation Generation
AI tools generate text without providing citations, complicating verification.
Data Inputs
Massive Training Datasets
AI trained on vast web data, enabling it to mimic diverse academic styles.
Plausible but False Information
AI generates statistically probable words that are factually incorrect.
Lack of Academic Fine-Tuning
AI models are not fine-tuned for academic context, leading to factual errors.
Human Factors
Student Desire for Shortcuts
Students use AI to complete busywork quickly and avoid academic struggle.
Educator Unpreparedness
Teachers were blindsided by the sudden public release of capable AI chatbots.
Acceptance of Academic Dishonesty
Some students rationalize AI cheating to gain an unfair grade advantage.
Process and Methods
Vulnerable Assessment Methods
Take-home essays and open-book exams are easily compromised by AI tools.
Inadequate Plagiarism Software
Traditional detectors look for exact matches and fail to flag original AI text.
Lack of Verification Workflows
Schools lack clear workflows to handle suspected but unproven AI cheating.
Management
Inadequate Risk Assessment
School administrations failed to assess the risks of AI before public launch.
Lack of Educator Training
Schools did not provide teachers with training on how to handle AI tools.
Slow Institutional Adaptation
University boards are slow to update policies, leaving teachers to cope alone.
Regulatory Environment
Outdated Academic Honor Codes
Plagiarism definitions in honor codes do not explicitly cover generative AI.
Delayed Policy Response
Education departments delayed in establishing clear guidelines on AI usage.
Absence of Clear AI Regulations
Lack of external regulatory standards to govern generative AI in education.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.