This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
An automated AI curation agent, 'dragon-ai-agent', eagerly picked up a GitHub issue labeled 'good first issue' and created a draft PR, depriving a new human contributor of a learning opportunity.
An automated AI curation agent in the Monarch Initiative's DisMech GitHub repository reportedly began work on a beginner-friendly dyslexia curation task before the new human contributor it was intended for could do so. A maintainer apologized, saying the agent had deprived the contributor of a learning opportunity, and opened a policy issue to prevent automated agents from taking newcomer-oriented GitHub tasks too quickly.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Delegating by humans of key decisions to AI systems, or AI systems that make decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory, or becoming cognitively enfeebled.
Also classified as
The AI agent lacked the capability to recognize 'good first issue' labels or respect human learning boundaries, leading to overeager automated actions.
The AI agent autonomously took over a task that a human contributor intended to perform, overriding human agency and depriving the contributor of a hands-on learning opportunity.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by the autonomous action of the deployed 'dragon-ai-agent' bot, which produced an unexpected and undesirable outcome of preempting a human contributor.
An automated GitHub agent prematurely opened a draft pull request on an open-source repository, temporarily preempting a new human contributor. The incident represents a minor software coordination issue with zero national security implications.
The AI system, 'dragon-ai-agent', operates autonomously as an agent by scanning the unassigned curation queue, selecting tasks, and opening draft PRs without direct human intervention.
Minimal or No Risk: The AI system is an automated software development utility used for curating ontology files on GitHub, which poses negligible risk to society.
The AI system was designed to scan the curation queue and automatically generate draft YAML files and PRs for disease ontologies.
The GitHub issue comments provide a clear, first-hand account of the bot's actions, the maintainers' responses, and the specific impact on the contributor. There is no conflicting information or significant ambiguity regarding the sequence of events.
The event could be interpreted as a minor workflow coordination issue rather than a formal AI safety incident, though it highlights the risk of over-automation depriving humans of agency.
Technology
Overeager Automated Scanner
The agent scanned and picked up the issue automatically without delay.
Lack of Input Filtering
Agent did not recognize the issue was meant for a human newcomer.
Data Inputs
Auto-Generated Trigger Phrase
The dismech summary bot included a direct call-to-action for the agent.
Human Factors
New Contributor Intent
The issue was intended as a learning task for a new human contributor.
Process and Methods
No Agent Pickup Rules
No rules existed to prevent automated pickup of beginner issues.
Lack of Triage Delay
No buffer time was allowed for humans to claim the issue first.
Management
Prioritizing Speed Over Learning
System optimized for fast curation skeleton generation over human training.
Regulatory Environment
Lack of Bot Boundaries
No community guidelines or policies governed automated agent activities.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
