This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Google's AI chatbot, Bard, generated factually incorrect information in a promotional video regarding the James Webb Space Telescope's role in imaging exoplanets. The error was widely noted by experts and reported by media, resulting in a significant drop in Alphabet's stock price. The incident highlighted the risks associated with the rapid deployment of generative AI models in search products.
Google's conversational AI "Bard" was shown in the company's promotional video providing false information about which satellite first took pictures of a planet outside the Earth's solar system, reportedly causing shares to temporarily plummet.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
Google rushed the deployment of Bard and bypassed internal safety reviews due to intense market competition with OpenAI and Microsoft.
The underlying AI model failed to perform reliably, hallucinating false facts under standard query conditions.
The chatbot generated a specific, discrete factual error regarding the history of exoplanet imaging, which was then widely distributed in promotional materials.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The financial loss and misinformation were directly triggered by the AI system generating an incorrect factual claim during a public promotional demonstration.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
Google's Bard chatbot generated a factual error about the James Webb Space Telescope during a promotional demonstration, leading to a temporary 7-9% drop in Alphabet's stock price (wiping out 100 billion dollars in market value). While the economic impact on a major US technology firm was notable, the incident carries negligible direct national security implications and represents an unintentional product failure.
The reports describe Bard as an AI chatbot designed to answer user queries, simplify complex topics, and provide conversational search results, acting as an assistant to augment human information retrieval.
Limited Risk: The system is explicitly described as an 'AI chatbot' and 'experimental conversational AI service', which falls under the category of chatbots and AI-generated content requiring transparency under the EU AI Act.
The reports explicitly describe Bard as an experimental conversational AI chatbot designed to answer user queries and provide information.
The reports provide highly consistent and detailed accounts of the specific factual error made by Bard, the public reaction, the astronomical facts, and the financial impact on Alphabet's stock. Multiple reputable news sources confirm the exact prompt, the incorrect response, and the market cap loss of $100 billion.
The financial loss could be interpreted as a general market reaction to Google's rushed presentation rather than solely due to the chatbot's factual error, though the error was a primary catalyst.
Technology
Inherent LLM Hallucinations
Probabilistic nature of LLMs leads to confidently stating incorrect facts.
Lack of Fact-Checking Mechanisms
The system lacks a deterministic database query to verify generated facts.
Data Inputs
Unverified Training Data
Training on vast internet text absorbs and repeats existing errors.
Human Factors
Rushed Marketing Review
Promoters failed to fact-check the chatbot's output in the demo video.
Demoralized Safety Staff
Ethics employees felt unsupported and discouraged from voicing safety concerns.
Process and Methods
Overruled Safety Evaluations
Leadership bypassed risk evaluations to accelerate the product launch.
Voluntary Ethics Reviews
AI ethics reviews were largely voluntary, except for specific sensitive topics.
Siloed Development Teams
Siloed teams prevented employees from seeing the full picture of development.
Management
Competitive Code Red
Urgent pressure to compete with Microsoft/OpenAI compromised safety priority.
Prioritizing Growth Over Ethics
Leadership lowered readiness thresholds to speed up the experimental launch.
Disempowered Ethics Teams
Ethics teams were downsized and told not to block generative AI tools.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
