This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Researchers from multiple universities were found to have embedded hidden, white-text prompts in 17 academic preprints on arXiv. These prompts were designed to manipulate AI tools used by reviewers into providing exclusively positive feedback, effectively attempting to bypass peer review standards. While some authors claimed this was a protest against 'lazy reviewers' using AI, the incident highlights significant risks to academic integrity and the potential for prompt injection to distort information retrieval and evaluation processes.
Hidden prompts reportedly were discovered in at least 17 academic preprints on arXiv that purportedly instructed AI tools to deliver only positive peer reviews. The lead authors are reportedly affiliated with 14 institutions in eight countries, including Waseda University, KAIST, Peking University, and the University of Washington. The alleged concealed instructions, some of which were reportedly embedded using white text or tiny fonts, were purportedly intended to influence any reviewers who rely on AI tools.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The incident relies on exploiting indirect prompt injection vulnerabilities in AI systems to manipulate their outputs.
The researchers used hidden prompt injections to manipulate AI-based evaluation tools to gain an unfair personal advantage (positive peer reviews) over others, which constitutes cheating.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk was caused by human researchers intentionally embedding hidden prompts in their papers to manipulate AI systems post-deployment.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
Researchers from multiple global universities embedded hidden white-text prompts in academic preprints to manipulate AI peer-review tools. While primarily an academic integrity issue, it highlights the real-world exploitability of indirect prompt injection vulnerabilities in document processing systems, which has minor implications for broader information security.
The report describes reviewers using AI tools to assist them in evaluating and writing reviews for academic papers, acting as an assistant to human decision-making.
Risk Level 3: Limited Risk. The AI systems being manipulated are general-purpose language models and chatbots used for reading, summarizing, and reviewing documents, which fall under limited risk transparency obligations.
The AI systems being manipulated are used by peer reviewers to evaluate, summarize, and verify the quality of academic papers.
The report provides clear, factual details about the discovery of hidden prompts in 17 academic papers across 14 institutions. The mechanism of the exploit (white text, small fonts) and the intent (manipulating AI reviewers) are explicitly documented, with statements from involved researchers and institutions.
Some authors argue the prompts were a protest/check against 'lazy reviewers' using AI, rather than an attempt to cheat, though the operational effect remains the manipulation of the evaluation process.
Technology
Indirect Prompt Injection Vulnerability
AI models read and execute hidden text instructions within documents.
Lack of Technical Defenses
AI providers lack technical measures to filter hidden text prompts.
Data Inputs
Concealed Text in Manuscripts
White text or tiny fonts hide instructions from humans but not AI.
Human Factors
Reviewer Reliance on AI
Overburdened peer reviewers use AI tools despite explicit bans.
Deliberate Manipulation by Authors
Authors insert prompts to force positive evaluations or test AI.
Process and Methods
Inconsistent AI Policies
No unified rules exist among academic conferences and journals.
Absence of Automated Checks
Submission systems fail to scan for white text or hidden prompts.
Management
Lack of Institutional Guidelines
Universities failed to establish rules for appropriate AI usage.
Unmanaged Reviewer Workload
Rising manuscript volume pressures reviewers to outsource to AI.
Regulatory Environment
Lack of Unified AI Standards
No industry-wide regulations govern ethical AI usage in academia.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
