A UN report identified that a Turkish-made Kargu-2 drone, capable of autonomous target identification and engagement, was used in a March 2020 skirmish in Libya. The drone, described as a lethal autonomous weapon system (LAWS), was used to hunt down retreating soldiers. While the report implies the system operated autonomously, it remains unclear if the drone was responsible for specific casualties or if it was under manual control at the time of the engagement.
In Libya, a Turkish-made Kargu-2 aerial drone powered by a computer vision model was allegedly used remotely by forces backed by the Tripoli-based government to track down and attack enemies as they were running from rocket attacks.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to develop cyber weapons (e.g., by coding cheaper, more effective malware), develop new or enhance existing weapons (e.g., Lethal Autonomous Weapons or chemical, biological, radiological, nuclear, and high-yield explosives), or use weapons to cause mass harm.
Also classified as
The deployment of 'fire, forget and find' systems removes human oversight and decision authority from life-and-death targeting decisions.
The incident involves the wartime deployment of a lethal autonomous weapon system (LAWS) designed to hunt and engage human targets, representing the use of AI-enhanced weaponry.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident involved the active deployment of an autonomous weapon system programmed to intentionally target and engage retreating forces during a military conflict.
Added categories peak at 2: Minor (Psychological Harm, Inferred)
First reported case of an AI-powered autonomous weapon system identifying and engaging human targets without human intervention in armed conflict. The deployment of the Kargu-2 drone in Libya establishes a concerning precedent for lethal autonomous weapons in warfare, with substantial international security and human rights implications.
The Kargu-2 drone is described as operating independently without real-time human intervention, using machine learning and image processing to find and engage targets based on its programming.
Unacceptable Risk: The system is described as a lethal autonomous weapon system ('killer robot') capable of targeting and killing humans without human intervention, posing an extreme danger to society and violating fundamental human rights.
The Kargu-2 is an autonomous rotary-wing attack drone designed to identify and engage targets on the battlefield without human intervention.
The reports are based on a UN Panel of Experts report, which is highly credible, but the UN report itself is cautious and does not confirm whether the drone was operating autonomously at the exact time of the attack, nor does it confirm any casualties.
The drone may have been operated manually by a human operator during the engagement, meaning it did not act as an autonomous 'killer robot' in this instance.
Definitive confirmation of whether the drone was in autonomous mode during the attack, and verified data on whether any casualties or injuries were caused by the drone.
Technology
Brittleness of AI Systems
AI systems can easily make mistakes like misidentifying civilian targets.
Fire Forget and Find Programming
Drones were programmed to attack without requiring data connectivity.
Data Inputs
Potential Algorithmic Bias
Algorithmic bias in AI systems can lead to fatal misidentifications.
No Operator Data Connection
The drone relied entirely on local sensor inputs without human override.
Human Factors
Erosion of Human Judgment
No human operator was in the loop to make life-and-death decisions.
Process and Methods
Autonomous Target Selection
Targeting procedures allowed the drone to choose targets autonomously.
Management
Heavy Military Investment
Militaries globally are investing heavily in autonomous weapons systems.
Deployment of Advanced AWS
Decision by military forces to deploy Kargu-2 drones in active combat.
Regulatory Environment
Lack of International Treaty
No international ban exists to prevent the deployment of autonomous weapons.
Failure to Regulate AWS
The race to regulate autonomous weapons is being lost globally.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.