This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A 15-year-old Singaporean girl was self-radicalized online and took a virtual pledge of allegiance to an ISIS chatbot, leading to her arrest and restriction under the Internal Security Act.
Singapore authorities reported that a 17-year-old far-right extremist searched an unidentified AI chatbot for ammunition-making instructions while preparing attacks on Muslims at five mosques. He reportedly aimed to kill at least 100 people but failed to obtain a firearm and was detained before carrying out an attack. The public sources do not establish what the chatbot answered or whether its output aided his preparations.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
Also classified as
The chatbot was utilized by a terrorist organization as an automated tool to conduct influence and recruitment campaigns targeting vulnerable individuals.
The ISIS chatbot exposed the minor to violent extremist ideology and facilitated her taking a pledge of allegiance to a terrorist organization, which constitutes exposure to toxic, extremist, and illegal content.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The radicalization process was facilitated by an active ISIS chatbot deployed online, which intentionally engaged the user and accepted her pledge of allegiance.
Added categories peak at 2: Minor (Psychological Harm, Direct)
A 15-year-old Singaporean girl was radicalized and took a virtual pledge of allegiance to an ISIS-run chatbot, leading to her restriction under the Internal Security Act. This incident highlights a highly novel and concerning precedent where extremist groups leverage autonomous AI to scale, automate, and facilitate recruitment and radicalization of vulnerable individuals.
The AI system operated as an interactive conversational chatbot that responded to user inputs and facilitated a virtual pledge of allegiance.
Unacceptable Risk: The chatbot was used for subliminal manipulation and behavioral influence leading to the severe radicalization of a vulnerable minor.
The AI system is explicitly described as an ISIS chatbot used to interact with the user and accept her virtual pledge of allegiance.
The reports are official government releases from Singapore's Internal Security Department and credible news coverage, providing clear facts about the youth's interaction with the chatbot.
The chatbot could be interpreted as a passive tool rather than an active agent of radicalization, though its interactive nature supports the classification.
Technology
Interactive ISIS Chatbot
Facilitated a virtual pledge of allegiance, solidifying extremist identity.
Recommendation Algorithms
Served extremist propaganda and violent videos, accelerating radicalisation.
Search Engine Surfacing
Allowed easy retrieval of extremist manifestos and potential target mosques.
Data Inputs
Extremist Chatbot Training
Chatbot was fed extremist data, enabling it to accept pledges to ISIS.
Unmoderated Video Feeds
Algorithmic feeds ingested and distributed edited Christchurch attack videos.
Online Terrorist Manifestos
Digitised manifestos served as inputs for youth self-radicalisation.
Human Factors
Youth Susceptibility to AI
Vulnerable youth formed emotional or ideological bonds with an AI chatbot.
Parental Inaction
Parents noticed excessive online activities but did not report to authorities.
Peer Reporting Failure
Schoolmates ignored shared extremist materials and did not alert teachers.
Process and Methods
Flawed Platform Moderation
Online platforms failed to detect and block the interactive ISIS chatbot.
Algorithmic Feed Delivery
Automated distribution processes prioritized engagement with radical content.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
