An AI-generated image, created using Creative Fabrica's platform, was incorrectly displayed in Google's knowledge panel as an authentic work by the artist Edward Hopper. The incident highlights the vulnerability of search engine algorithms to synthetic content, raising concerns about the potential for AI to distort historical and educational information. Google subsequently replaced the image and acknowledged the difficulty of filtering AI-generated content at scale.
Google's knowledge panel for the American artist Edward Hopper featured an AI-generated image which was purportedly created in the artist's style but was not one of his works, the image of which was removed soon after.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The AI-generated knockoff mimicked Hopper's style and displaced authentic works from major museums like the Met in search results.
Google's automated search systems lacked the capability to robustly distinguish between authentic historical art and synthetic AI-generated images.
The Google Search algorithm inadvertently promoted an AI-generated fake painting to the top of search results for Edward Hopper, spreading misleading information about the artist's actual body of work.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by Google's post-deployment search algorithm unintentionally selecting and promoting an AI-generated image as an authentic historical artwork.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
An AI-generated image mimicking artist Edward Hopper was mistakenly featured as authentic in Google Search results. While highlighting vulnerabilities in automated search algorithms to synthetic content, the incident has negligible national security implications, representing a localized epistemic error in cultural information rather than a threat to state security.
The AI systems involved (Creative Fabrica's image generator and Google's search algorithm) operate as tools. Creative Fabrica's generator produces images based on direct text prompts, while Google's search algorithm indexes and ranks web content to return search results based on user queries.
Risk Level 3: Limited Risk. The incident involves an AI-integrated platform (Creative Fabrica) used to generate synthetic art, which falls under the category of AI-generated content. Such systems are subject to transparency obligations under the EU AI Act to ensure users are aware the content is AI-generated.
The primary AI system (Creative Fabrica) was used for Visual Art Generation to create an image in the style of Edward Hopper, which was subsequently indexed and displayed by Google's Image Search algorithm.
The reports provide clear, consistent, and detailed accounts of the incident, including the specific AI tool used (Creative Fabrica), the prompt, the search engine affected (Google), and the response from Google. There is no conflicting information, and the causal chain is straightforward.
None
Technology
Flawed Search Algorithm
Google's search algorithm failed to distinguish AI fakes from real art.
AI Image Generation
Creative Fabrica's AI tool allowed easy creation of realistic Hopper fakes.
Data Inputs
Misleading Metadata
AI image was indexed with artist name prompts, confusing search algorithms.
Lack of Provenance Data
No robust metadata standards existed to flag the image as AI-generated.
Human Factors
User Intent to Replicate
A user generated a style-mimicking image using explicit artist prompts.
Process and Methods
Inadequate Content Filtering
Google lacked automated filters to prevent AI art in historical overviews.
Indexation of AI Platforms
Search engines crawled and indexed AI-generation platforms without filtering.
Management
Scale Prioritization
Google prioritized indexing the open web over verifying image authenticity.
Regulatory Environment
Lack of AI Labeling Standards
No regulatory mandates exist requiring clear watermarks on AI-generated art.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.