This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A U.S. Army soldier stationed at Joint Base Elmendorf-Richardson has been indicted on federal charges for the production, receipt, and possession of child sexual abuse material (CSAM). Prosecutors allege the defendant utilized generative AI tools to morph images of real children into sexually abusive content. The case highlights the misuse of AI technology in the creation and proliferation of illegal CSAM.
Seth Herrera, a U.S. Army soldier at Joint Base Elmendorf-Richardson (JBER), is accused of using artificial intelligence to generate pornography depicting minors with whom he was in contact.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
Also classified as
The perpetrator targeted specific minors he knew and sexualized their likenesses using synthetic content generation.
The incident involves the creation and potential proliferation of child sexual abuse material (CSAM), which is explicitly classified as toxic content under this sub-domain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The harm was caused by the intentional decision and action of a human user who misused deployed generative AI tools to create illegal child sexual abuse material.
Added categories peak at 3: Substantial (Child Sexual Exploitation & Abuse (CSEA), Direct)
An active-duty U.S. Army soldier was indicted for using generative AI tools to create child sexual abuse material from social media photos. While representing a severe criminal act and violation of individual human rights, the incident has minor national security implications, as it was a localized criminal matter handled by law enforcement without broader threat to national infrastructure, intelligence, or sovereignty.
The report describes the defendant using AI chatbots and generative AI tools to morph images. The AI acted as a tool, performing specific image generation functions based on direct user inputs without exhibiting autonomous goal-directed behavior.
Risk Level 3: Limited Risk. The report describes the use of generative AI and chatbots to create synthetic content and morphed images, which falls under the category of AI-generated content such as deepfakes.
The defendant used generative AI to morph real children's images into sexually explicit material, which represents deepfake image generation, and utilized AI chatbots.
The report is a detailed news article about a federal indictment with specific charges, quotes from officials, and factual details. The role of AI in morphing real children's images is explicitly stated.
None.
Technology
Generative AI Image Morphing
Generative AI tools allowed morphing real children's images into CSAM.
Encrypted Messaging Apps
Used encrypted messaging to share and traffic the illegal material.
Password-Protected Vault Apps
Used a calculator-disguised app to conceal illegal files on devices.
Data Inputs
Social Media Image Harvesting
Real children's images and videos were harvested from social media pages.
Human Factors
Malicious User Intent
Defendant intentionally sought to create and view CSAM using AI.
Technical Sophistication
Defendant possessed skills to navigate the web and hide digital footprints.
Process and Methods
Lack of AI Safeguards
AI tools lacked sufficient safeguards to prevent generating CSAM.
Regulatory Environment
Enforcement Challenges
Rapidly evolving AI tools make tracking and enforcement difficult.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
