This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Artists and photographers have raised significant ethical and legal concerns regarding AI image generators like Stable Diffusion and Lensa AI. These models were trained on billions of images scraped from the internet, including copyrighted works, without artist consent or compensation. This has led to class-action lawsuits, concerns over the devaluation of human creative labor, and the generation of nonconsensual sexual imagery.
Text-to-image model Stable Diffusion was reportedly using artists' original works without permission for its AI training.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems capable of creating economic or cultural value, including through reproduction of human innovation or creativity (e.g., art, music, writing, coding, invention), destabilizing economic and social systems that rely on human effort. The ubiquity of AI-generated content may lead to reduced appreciation for human skills, disruption of creative and knowledge-based industries, and homogenization of cultural experiences.
Also classified as
Lensa AI was reported to generate highly sexualized and topless images of users and celebrities without their consent.
The LAION-5B dataset used to train the models was found to contain private medical records and personal photos scraped without consent.
The training of AI models on copyrighted artworks without consent and the subsequent generation of style-replicating images directly devalues human creative effort and threatens the livelihoods of artists.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident stems from intentional human decisions by developers to scrape copyrighted images without consent and commercialize models trained on that data, leading to post-deployment harms.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
The viral adoption of generative AI models trained on scraped data sparked widespread legal disputes over copyright and privacy. While the incident highlights significant challenges to intellectual property frameworks, privacy rights, and potential information manipulation, its direct national security implications remain minor and manageable within standard legal and regulatory procedures.
The AI systems function as creative assistants that generate stylized images or avatars based on direct user-uploaded photos and text prompts, requiring human input and selection to produce the final output.
Limited Risk: The report describes AI-generated content and deepfakes (such as Lensa's magic avatars and Stable Diffusion's image generation), which fall under Limited Risk due to transparency obligations to ensure users are aware they are interacting with AI-generated content.
The primary function of Stable Diffusion, Lensa AI, and Midjourney is to generate visual art and stylized images based on user prompts and uploaded photos.
The reports provide comprehensive coverage of the incident from multiple perspectives, including first-hand accounts from affected artists, legal analyses of the lawsuits, technical explanations of diffusion models, and statements from the AI companies. The facts regarding data scraping, the class-action lawsuit, and the specific harms are well-documented and consistent across sources.
Some proponents view the technology as a transformative tool similar to the invention of photography, rather than a parasitic or infringing system.
Technology
Diffusion Model Lossy Compression
Denoising reconstructs and interpolates latent images of training data.
NSFW Filter Vulnerabilities
Users bypassed safety filters to generate non-consensual sexual imagery.
Style Mimicry Capabilities
Algorithms mimic specific artists' styles using their names as prompts.
Data Inputs
Non-Consensual Data Scraping
LAION-5B dataset scraped billions of internet images without artist consent.
Inclusion of Sensitive Data
Dataset included copyrighted works, watermarks, and private medical records.
Lack of Input Verification
No verification of ownership or rights for images used in AI training.
Human Factors
User Prompt Exploitation
Users intentionally input prompts to bypass safety filters or copy styles.
Disregard for Artist Rights
AI developers prioritized technical capabilities over ethical data sourcing.
Consumer Demand for Cheap Art
Public viral adoption of cheap AI portraits ignored ethical implications.
Process and Methods
Opt-Out Instead of Opt-In
Artists were default opted-in to training datasets with no initial control.
Inadequate Content Moderation
Platforms failed to filter out infringing or harmful generated outputs.
Lack of Source Attribution
No system to credit or compensate artists whose work trained the models.
Management
Prioritizing Profit Over Ethics
Companies monetized open-source models trained on non-consensual data.
Inadequate Risk Assessment
Management failed to assess copyright and safety risks before launch.
Lack of Corporate Accountability
DeviantArt adopted Stable Diffusion despite violating community trust.
Regulatory Environment
Ambiguous Copyright Laws
Current laws fail to address AI training on scraped data.
Lack of AI Safety Standards
No regulatory framework governing generative AI deployment and data sourcing.
Delayed Legal Enforcement
Lawsuits are reactive, leaving artists without immediate legal recourse.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
