Researchers and leaked documents reveal that the Chinese firm GoLaxy utilized its 'GoPro' AI system and DeepSeek models to conduct sophisticated influence operations. These campaigns targeted political discourse in Hong Kong and Taiwan, including tracking thousands of accounts to suppress dissent and weaken political parties. The company also collected data on U.S. political figures, raising concerns about the use of AI in state-sponsored information warfare.
Reportedly leaked documents reviewed by researchers and media allege that Chinese firm GoLaxy used its "GoPro" AI system in multiple influence campaigns. In 2020, it reportedly tracked 180,000 Twitter accounts to counter opposition to Hong Kong's National Security Law; in 2022–2023, it amplified praise for China's Zero Covid policy using purportedly fake Facebook accounts; and in late 2023, allegedly it advised on messaging to weaken Taiwan's Democratic Progressive Party.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Also classified as
The GoPro system aims to mass-produce propaganda to drown out organic debate, polluting the information ecosystem.
The incident involves the coordinated, state-sponsored use of AI systems to conduct large-scale disinformation, surveillance, and influence campaigns targeting political processes and public opinion in Hong Kong, Taiwan, and the US.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The risk is caused by the deliberate decisions and actions of human actors (the Chinese government and GoLaxy) deploying AI systems to conduct state-sponsored influence operations.
Added categories peak at 4: Severe (Epistemic Harm, Inferred)
Leaked documents reveal Chinese firm GoLaxy utilized its GoPro AI system and DeepSeek models for sophisticated state-sponsored influence operations. These operations targeted political discourse in Taiwan and Hong Kong, and compiled virtual profiles on US political figures, representing a significant evolution in AI-enabled information warfare and foreign political interference.
The report describes the GoPro system as possessing the ability to be aware of political situations, target in real-time, and autonomously perform rapid counterattacks by generating and distributing content to achieve political goals.
Unacceptable Risk: The report describes an AI system used for subliminal manipulation or behavioral influence leading to harm, specifically to monitor and manipulate public opinion and conduct information warfare.
The system's primary function is to automatically generate social media posts and propaganda to influence public opinion, while also conducting surveillance by tracking and profiling social media users.
The assessment is based on detailed internal company documents leaked from GoLaxy and analyzed by academic researchers, with key findings corroborated by current and former US intelligence officials. While GoLaxy denies the claims, the documentary evidence provides a clear picture of the system's capabilities and deployment.
The company claims its products are commercial sentiment analysis tools using open-source data, rather than state-directed propaganda engines.
Technology
GoPro Smart Propaganda System
AI system enables real-time, automated mass-production of propaganda.
Integration of DeepSeek AI Model
Advanced LLM allows rapid crafting of responses to counter opposing views.
Automated Sentiment Tracking
AI tracks broad swings in public opinion and specific influential targets.
Data Inputs
Massive Social Media Harvesting
Collects millions of posts from Weibo, WeChat, X, and Facebook daily.
Virtual Profiling of Key Figures
Assembled profiles on US Congress members and thousands of influencers.
Human Factors
Employee Leak of Internal Documents
Disgruntled employee leaked documents due to poor wages and conditions.
Cognitive Vulnerability to AI Content
Targeted individuals are easily influenced by authentic-seeming AI content.
Process and Methods
Real-time Detection Avoidance
AI-generated content is designed to adapt dynamically and avoid detection.
Targeted Messaging Recommendation
System recommends specific messages to exploit differences in public opinion.
Management
Alignment with National Strategy
GoLaxy prioritizes national security missions and state influence over ethics.
Deceptive Public Positioning
Company hides national security ties and denies state-sponsored operations.
Regulatory Environment
Dismantled US Counter-Influence Teams
US government pulled back teams at State Dept, FBI, and CISA.
State-Backed AI Support
Sugon and Chinese Academy of Sciences provide state backing and funding.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.