This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Adobe Stock and other platforms faced scrutiny for hosting photorealistic, AI-generated images that depicted fictionalized versions of real-world news events, such as the Israel-Gaza war and Maui wildfires. These images, often mislabeled or unlabeled, were found to be used in ways that blur the lines between reality and fiction, raising concerns about the erosion of trust in journalism and the potential for creating false narratives. In response, Adobe Stock implemented stricter policies, though experts warn that the ease of generating such content poses a persistent challenge to media integrity.
AI-generated images available through Adobe Stock, depicting realistic but fictional scenes of real-world events like wars and protests, have raised significant ethical concerns. These images blurred the lines between reality and fiction in journalistic contexts, prompting Adobe Stock to "crack down on AI-generated images that seem to depict real, newsworthy events and take new steps to prevent its images from being used in misleading ways."
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Highly personalized AI-generated misinformation creating “filter bubbles” where individuals only see what matches their existing beliefs, undermining shared reality, weakening social cohesion and political processes.
Also classified as
The potential replacement of professional photojournalists with cheap, synthetic AI-generated stock images devalues human journalistic effort and threatens the profession's economic viability.
The proliferation of thousands of unlabeled, photorealistic fake images of real wars and disasters across stock sites and social media threatens to pollute the information ecosystem and blur the lines between fiction and reality.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk of widespread misinformation and erosion of public trust is an unexpected and unintentional outcome resulting from the post-deployment use of photorealistic image generation models.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
The hosting of unlabeled, photorealistic AI-generated images of real-world conflicts on stock platforms like Adobe Stock led to their dissemination on news sites and social media. While it does not represent a direct physical or state-level threat, it highlights an evolving capability in information pollution that erodes public trust in media and consensus reality.
The AI systems (DALL-E, Stable Diffusion) operate as tools that perform the specific, well-defined function of generating images based on direct text prompts provided by human users, without autonomous planning or independent decision-making.
Limited Risk: The incident involves AI-generated content and deepfakes, which under the EU AI Act are subject to specific transparency and labeling obligations to ensure users are aware they are interacting with synthetic media.
The AI models were utilized to generate photorealistic, synthetic images of real-world events (wars and disasters) that could easily be mistaken for genuine photojournalism.
The report from The Washington Post provides clear, detailed, and well-sourced information about the presence of AI-generated images on stock sites, platform policies, and specific real-world examples of users being misled.
None, the facts clearly point to a systemic issue of synthetic media polluting stock image databases.
Technology
Hyper-realistic Image Generation
Rapid advances in AI make fake images indistinguishable from real photos.
Lack of Indelible Watermarks
Current AI tools lack robust, unremovable markers to identify fake content.
Easy Metadata Removal
Downstream users can easily strip metadata labels from AI-generated images.
Data Inputs
Mislabeled AI Submissions
Users uploaded AI-generated images without the required generative AI labels.
Lack of Training Verification
AI models trained on stock libraries generate highly realistic fake events.
Human Factors
User Sharing of Unverified Media
Social media users share AI fakes believing they are real photojournalism.
Financial Temptation for Media
Budget cuts tempt cash-strapped media outlets to use cheap AI stock images.
Cognitive Bias and Trust
People assume stock platforms only host authentic photojournalism.
Process and Methods
Reliance on User Self-Labeling
Platforms relied on uploaders to honestly tag images as AI-generated.
Inadequate Verification Filters
Stock sites lacked automated tools to detect and flag unlabeled AI images.
Permissive Initial Content Policy
Policies allowed AI depictions of real-world sensitive, newsworthy events.
Management
Prioritizing Growth Over Safety
Embraced AI submissions for market growth before establishing safeguards.
Reactive Risk Management
Policies were updated only after public backlash and media inquiries.
Regulatory Environment
Fragmented Platform Policies
Inconsistent rules across platforms create gaps in AI content regulation.
Absence of Industry Standards
No unified legal framework exists to mandate AI watermarking or labeling.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
