This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Multiple Facebook pages, purportedly using AI-generated content, have been targeting the Geelong Football Club with fabricated stories. These posts include false criminal allegations, fake medical diagnoses, and misleading news about player trades and club redevelopments. The club has reported these pages to Meta, noting that the misinformation is concerning and potentially harmful to its players and staff.
Purportedly AI-generated Facebook pages reportedly published false stories about the Geelong Football Club, including fabricated criminal allegations, illnesses, deaths, and a nonexistent bushfire evacuation warning. The club reported the pages to Meta, which later removed at least one page after complaints, while other misleading content reportedly remained online.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
Some posts contained darker, exploitative content targeting players' personal lives and alleging criminal activity.
The AI-generated posts spread fabricated news stories, fake arrests, and medical diagnoses, creating epistemic harm for fans.
The incident involves malicious actors using AI-generated content and fake pages to impersonate club figures and spread false stories, aiming to drive traffic to suspicious links for personal or financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human actors who intentionally created fake Facebook pages and used AI tools to generate and spread false stories for engagement.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A localized social media disinformation campaign targeted an Australian football club using AI-generated text and images. The incident has negligible national security implications, as it does not affect critical infrastructure, government functions, or national stability.
The report describes the AI being used to generate images and text content ('AI-generated images with captions', 'AI-generated content') which were then posted by human-operated fake pages. The AI functioned as a tool to produce specific outputs based on direct human prompts, without exhibiting independent agency or autonomous decision-making.
Risk Level 3: Limited Risk. The incident involves 'AI-generated content such as deepfakes' and synthetic media, which under the EU AI Act are subject to transparency obligations to ensure users are aware they are interacting with AI-generated content.
The AI systems were used to generate fake news posts, captions, and synthetic images to populate malicious Facebook pages targeting the football club.
The report clearly details the nature of the AI-generated content, the platform used (Facebook), the targets (Geelong Football Club and players), and the specific types of misinformation spread. While the exact AI models used to generate the text and images are not specified, the description of the incident's dynamics and harms is highly detailed and consistent.
None
Technology
Sophisticated AI Generation
AI tools enable creation of highly realistic fake images and news.
Algorithmic Recommendations
Social media algorithms amplify fake pages to thousands of followers.
Lack of Automated Detection
Platforms lack effective AI tools to automatically flag deepfakes.
Data Inputs
Misappropriated Personal Data
Real player names, images, and contact details used to seed fake pages.
Exploitation of Real Events
Using actual news events to make AI-generated stories appear credible.
Human Factors
Susceptibility to Clickbait
Users are lured by sensational AI headlines to click dangerous links.
Malicious Intent of Creators
Bad actors deliberately use AI to damage reputations and spread lies.
Process and Methods
Inadequate Content Moderation
Meta's processes fail to quickly remove reported AI misinformation.
Flawed Page Verification
Lack of robust identity checks allows fake news pages to grow unchecked.
Management
Platform Unresponsiveness
Meta failed to respond to requests for comment or take immediate action.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
