Wikipedia bots, designed for benevolent tasks like vandalism removal and link maintenance, were found to engage in persistent, multi-year 'edit wars' where they repeatedly reverted each other's changes. Researchers identified these feedback loops as a consequence of bots following slightly different rules or cultural interpretations, leading to inefficient resource usage and unpredictable behavior in the wild.
Wikipedia bots meant to remove vandalism clash with each other and form feedback loops of repetitve undoing of the other bot's edits.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Risks from multi-agent interactions, due to incentives (which can lead to conflict or collusion) and/or the structure of multi-agent systems, which can create cascading failures, selection pressures, new security vulnerabilities, and a lack of shared information and trust.
Also classified as
The bots failed to perform robustly when encountering other automated agents, falling into infinite loops of reverting edits.
The incident involves multiple automated bots interacting and clashing in a shared environment, leading to persistent, multi-year edit wars and inefficient resource loops.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The edit wars were caused by the autonomous decisions of deployed Wikipedia bots reverting each other's edits, which was an unexpected and unintentional outcome of their programming.
Wikipedia editing bots engaged in persistent edit wars due to conflicting rule sets. While highlighting the challenges of multi-agent AI coordination, the incident has negligible national security implications and poses no threat to critical infrastructure, sovereignty, or societal stability.
The report describes multiple independent bots (such as Xqbot, Darknessbot, Scepbot, and RussBot) interacting, clashing, and repeatedly reverting each other's edits over thousands of articles.
Minimal or No Risk: The Wikipedia bots are simple automated editing tools used for basic housekeeping tasks like spellchecking and link fixing, which pose low or negligible risks to society.
The bots were designed to perform automated editing tasks on Wikipedia, such as fixing spelling, correcting links, and reverting vandalism.
The assessment is based on a peer-reviewed scientific study published in PLOS ONE, which provides clear quantitative data on bot-on-bot reverts across multiple language editions of Wikipedia.
The interactions could be interpreted as cooperative system maintenance rather than hostile 'edit wars'.
Technology
Slightly Different Rulesets
Bots follow different rules, leading to incompatible edits.
Unpredictable Interaction in Wild
Simple algorithms interact in unexpected, complex ways when deployed.
Lack of Rational Debate Capability
Bots are servants to code and cannot negotiate or resolve conflicts.
Data Inputs
Discrepancies in Naming Conventions
Different naming standards for links and redirects trigger mutual reverts.
Cultural and Language Divergence
Different language editions present differing contexts for bot operations.
Human Factors
Diverse Developer Backgrounds
Bots designed by developers from different countries leads to clashes.
Varying Editor Community Cultures
Different language communities create complex, clashing bot interactions.
Process and Methods
Inadequate Lab Testing
Algorithms working well in labs behave unpredictably when let loose.
Lack of Inter-Bot Coordination
No standardized coordination protocol exists for bots working on same pages.
Management
Inadequate Oversight of Interactions
Management focused on individual bot functions rather than joint interactions.
Lack of Joint Risk Assessment
Failure to assess risks of deploying multiple independent automated agents.
Regulatory Environment
Varying Local Rules and Laws
Different Wikipedia language editions have different local rules and guidelines.
Lack of Centralized Bot Regulations
No global regulatory framework governs how bots must interact with each other.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.