This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
A tourism website, Tasmania Tours, published AI-generated content that invented a nonexistent attraction called 'Weldborough Hot Springs'. This led to tourists traveling to the remote town of Weldborough, causing significant confusion and disruption for local businesses. The company owner admitted the AI content was used to compete for search engine prominence and was published without proper review.
A purportedly AI-generated travel article on the Tasmania Tours website reportedly invented "Weldborough Hot Springs" and promoted them as a real attraction. Tourists allegedly traveled to the remote town of Weldborough in search of the site, while local businesses reportedly received repeated calls and visits from confused travelers asking how to find the nonexistent springs.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
Also classified as
The AI system exhibited a clear lack of capability by hallucinating non-existent landmarks and generating physically impossible images of animals.
The AI system generated false information about a non-existent hot spring, leading tourists to travel to the location based on inaccurate beliefs.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by an AI system generating hallucinated content post-deployment, which was unintentionally published without human review.
A local Australian tourism website published unreviewed AI-generated articles fabricating a non-existent tourist attraction. While causing minor local confusion and travel detours, the incident represents a standard commercial AI hallucination with negligible national security implications.
The AI system acted as an Assistant to generate marketing content and blog posts, which were intended to be reviewed and edited by humans before publication.
Limited Risk: The system generated text and images ('AI-generated blog posts') that were published online, which falls under the category of AI-generated content requiring transparency so users know they are interacting with synthetic media.
The AI was primarily used to write travel articles and blog posts to keep the website content refreshed, acting as a writing assistant, while also generating accompanying images.
The report provides clear, direct accounts from the business owner, local publican, and tourism experts. The role of the AI in generating the false content is explicitly confirmed by the business owner, leaving little ambiguity about the cause and effects of the incident.
None. The owner explicitly blamed the AI for completely messing up and generating the fake content.
The specific name of the AI model or platform used would be helpful but is not strictly necessary for classification.
Technology
AI Hallucination
AI model generated non-existent destinations like Weldborough Hot Springs.
Flawed Image Generation
AI created unrealistic images of animals like three-legged wombats.
Human Factors
User Trust in AI Itineraries
Travellers relied on AI-generated travel plans without verification.
Accidental Public Release
Content was published by mistake while the owner was out of the country.
Process and Methods
Inadequate Review Process
Outsourced AI content was published without passing the standard review.
Lack of Quality Control
No robust mechanism to verify accuracy of AI-generated travel details.
Management
Outsourcing Marketing Content
Company outsourced content creation to third parties using AI.
Pressure to Compete
Need to keep content refreshed to compete with larger booking sites.
Regulatory Environment
Lack of AI Content Regulation
Absence of regulatory standards for verifying AI-generated tourism info.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
