This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Dartmouth's Geisel School of Medicine used an internal data-mining system to monitor student activity on the Canvas learning management platform during remote exams. The system incorrectly flagged automated background processes as evidence of cheating, resulting in false accusations against 17 students. Several students faced severe academic penalties, including expulsion and suspension, before the school acknowledged the flawed methodology in some cases.
Dartmouth's Geisel School of Medicine allegedly falsely accused students of cheating during remote exams using an internally built system which tracked student activity patterns without their knowledge on its learning management platform.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
Also classified as
School administrators overrelied on Canvas data as a forensic tool to prove cheating, despite the software not being designed for that purpose.
The Canvas system failed to perform reliably by automatically generating false user activity data, leading to erroneous accusations of cheating.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by the Canvas system automatically generating false activity data, which was an unexpected outcome of the system's normal operations.
Added categories peak at 2: Minor (Psychological Harm, Indirect)
An internal data-mining system at Dartmouth falsely flagged 17 medical students for cheating due to automated background processes. The incident resulted in localized academic penalties and distress but carries negligible implications for national security.
The Canvas platform and the pattern-recognition scripts functioned as tools, performing specific logging and data-mining functions based on direct inputs without autonomous planning.
High Risk: The system is an educational monitoring tool used to detect cheating, directly affecting students' access to education and vocational training.
The system was used to track student activity logs and detect patterns indicative of cheating during remote exams.
The report provides highly detailed, credible information from a reputable source, including technical analysis of the software code and direct statements from both students and administrators.
None.
Technology
Canvas Not Designed for Forensics
Canvas is an LMS, not a forensic tool for detecting cheating.
Automated Data Generation
Canvas automatically generates activity data even when devices are idle.
Flawed Pattern Detection
The custom audit system misidentified background syncs as human activity.
Data Inputs
Background Page Activity
Open Canvas tabs generated false-positive activity logs during exams.
Incomplete Activity Logs
Students were not provided with full logs to verify the data's context.
Lack of Question Context
Logs lacked the wording of exam questions to verify relevance of pages.
Human Factors
Failure to Log Out of Canvas
Students left Canvas pages open on backup devices during exams.
Overreliance on Tech Evidence
Administrators assumed automated logs were infallible proof of cheating.
Pressure to Plead Guilty
Students were advised to admit guilt despite maintaining their innocence.
Process and Methods
Inadequate Defense Window
Students had less than 48 hours to respond to complex technical charges.
Lack of Algorithmic Validation
The custom pattern-matching algorithm was not properly validated first.
Flawed Disciplinary Hearings
Students were given only two minutes to present their cases online.
Management
Rushing Accusations
Administrators rushed to accuse students without verifying data accuracy.
Lack of Technical Expertise
School lacked the expertise to understand the limitations of Canvas data.
Inadequate Initial Guidelines
School failed to instruct students to log out of Canvas before exams.
Regulatory Environment
Lack of Precedents and Standards
No established standards exist to prevent accusations on flimsy tech evidence.
Inadequate Privacy Regulation
Pandemic accelerated adoption of invasive tech without privacy protections.
Lack of Oversight on EdTech
No external regulatory oversight on the accuracy of exam monitoring tools.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
