This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Meta identified a coordinated inauthentic behavior network operating from Russia and Ukraine that used AI-generated profile pictures to create fictitious personas. These personas were used to manage fake news outlets and social media accounts to spread disinformation targeting Ukrainians during the Russian invasion. The campaign was linked to previous influence operations and coincided with intensified hacking attempts by the group 'Ghostwriter' against Ukrainian military and public figures.
According to security reports by Meta, fictitious personas with GAN-generated profile pictures were used by people operating in Russia and Ukraine to push a disinformation campaign targeting Ukrainian social media users, and were taken down.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
The incident involved the coordinated use of AI-generated profile pictures to run a state-aligned disinformation and influence campaign targeting the Ukrainian public during a military invasion.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The campaign was intentionally orchestrated by human threat actors who utilized deployed GAN technology to generate realistic profile pictures for fake personas.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
Pro-Russian actors utilized GAN-generated profile pictures to create highly realistic fake personas for a coordinated disinformation campaign targeting Ukraine during the 2022 invasion. While the campaign's direct reach was limited, it represents a substantial information warfare effort to undermine state sovereignty during active kinetic conflict.
The AI system (GAN) was used to perform a specific, well-defined function of generating realistic profile pictures. It operated on direct input without autonomous planning or context retention, acting strictly as a tool for the human operators of the influence campaign.
Limited Risk: The report describes the use of AI-generated profile pictures to create fake personas, which falls under 'AI-generated content such as deepfakes' requiring transparency under the EU AI Act.
The GAN was specifically used to generate realistic, synthetic profile pictures of non-existent people to create fake social media personas.
The reports from Meta and major news outlets clearly outline the role of GANs in generating profile pictures for the coordinated inauthentic behavior network. The scale of the network and its followers are explicitly quantified, and the distinction between the AI-assisted persona creation and the separate Ghostwriter hacking campaign is well-defined.
The hacking attempts by Ghostwriter could be conflated with the AI-driven influence campaign, but the reports treat them as separate, parallel operations.
Technology
GAN-Generated Profile Pictures
GAN technology allowed threat actors to create realistic, fake profile photos.
Inadequate AI Detection Tools
Platforms struggled to automatically flag GAN-generated profile images.
Data Inputs
Lack of Image Provenance Data
Missing metadata made it hard to verify if profile images were AI-generated.
Unlabeled Synthetic Media
No indicators existed to distinguish GAN photos from real human portraits.
Human Factors
User Susceptibility to Fake Profiles
Users trusted realistic GAN-generated avatars, aiding social engineering.
Cognitive Bias Toward Realism
People assume high-quality profile photos belong to real individuals.
Process and Methods
Weak Identity Verification
Account creation processes did not verify the real identity behind GAN photos.
Delayed Detection of Fake Networks
Manual investigation was required to link GAN accounts to influence networks.
Management
Underinvestment in AI Safety
Inadequate resources allocated to proactively detect synthetic media accounts.
Regulatory Environment
Lack of Deepfake Regulations
No legal frameworks mandated disclosure or labeling of GAN-generated media.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
