This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
OpenAI's prototype search tool, SearchGPT, displayed incorrect dates for a music festival in Boone, North Carolina, during a promotional demonstration video. The tool incorrectly stated the festival's box office dates, which could have misled potential attendees. This incident highlights the ongoing challenge of 'hallucinations' in generative AI search tools.
OpenAI’s prototype AI tool, SearchGPT, provided incorrect dates for An Appalachian Summer Festival in Boone, North Carolina during a demonstration video. The AI listed dates that were incorrect, potentially misleading users planning to attend the event, but also harming the reputation of OpenAI as the incident occurred during a high-profile event.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The hallucinations stem from the fundamental technical limitations of prediction-based large language models failing to perform reliably.
The SearchGPT prototype generated discrete false facts, specifically incorrect dates for a music festival and an incorrect speaker list, which represents the inadvertent generation of misleading information.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The hallucination occurred in a publicly released promotional demonstration video and was experienced by early testers who had been granted access to the deployed prototype.
OpenAI's SearchGPT prototype hallucinated incorrect dates for a local music festival and speaker details during a promotional demonstration. This incident represents a minor, unintentional technical error in a pre-release consumer product with negligible national security implications.
The report characterizes SearchGPT as an AI tool that can search the web and answer questions, providing concise answers with subheadings, bullet points, and links to sources. It acts as an information assistant to help users find and synthesize online content, requiring human verification to catch errors.
Limited Risk: SearchGPT is a conversational search chatbot, which falls under Risk Level 3 (Limited Risk) as a chatbot requiring transparency about its AI nature.
The system's primary purpose is to search the web and retrieve/summarize information in response to user queries.
The reports provide clear, consistent, and detailed accounts of the specific errors made by SearchGPT, including the exact dates hallucinated and the actual dates verified with the festival box office. The technical nature of the system as a prototype search chatbot is explicitly stated.
The incident could be viewed purely as a minor product development bug rather than a safety risk, though the systemic nature of LLM hallucinations makes it relevant to epistemic safety.
Technology
Next-Word Prediction Flaws
Models predict words instead of understanding facts, causing hallucinations.
Inherent Hallucination Tendency
Generative AI models are fundamentally prone to making up false information.
Data Inputs
Lack of Specialized Data Access
Lacks Google's expensive, specialized data like flight or local business info.
Poor Web Scraping and Synthesis
Tool struggles to accurately copy-paste or synthesize data from web sources.
Human Factors
Unwarranted User Trust
Users expect breakthrough results but face confusing or unhelpful interfaces.
Process and Methods
Hasty Prototype Release
Releasing a highly anticipated prototype with known factual inaccuracies.
Iterative Error-Prone Cycle
Releasing flawed products to get feedback instead of robust internal testing.
Management
Rushed Market Entry
Rushing to compete with Google and Perplexity despite technical limitations.
Lack of Clear Business Model
Rushing to search because AI companies lack proven business models.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
