This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Researchers at the Stanford Internet Observatory identified over 1,000 inauthentic LinkedIn profiles utilizing AI-generated headshots created via Generative Adversarial Networks (GANs). These profiles were used by third-party lead-generation vendors to conduct automated sales outreach on behalf of various companies, including RingCentral, without the companies' explicit knowledge or authorization. LinkedIn subsequently removed the identified profiles for violating policies against fake accounts and falsified information.
More than a thousand inauthentic LinkedIn profiles using allegedly GAN-generated photos were notified by researchers at Stanford to LinkedIn’s staff, and many of which were removed for violating rules against creating fake profiles and falsifying information.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involved using AI-generated synthetic faces to create fake professional personas on LinkedIn to manipulate and deceive users into engaging with automated sales pitches for commercial advantage.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The deployment of AI-generated profile pictures to create fake accounts was an intentional decision by human actors (marketing vendors) to conduct automated sales outreach.
Added categories peak at 3: Substantial (Epistemic Harm, Inferred)
The incident involves the deployment of over 1,000 fake LinkedIn profiles using GAN-generated headshots for automated commercial sales outreach. While representing an evolved capability in scaling synthetic identities, the incident was purely commercial, lacked state-actor involvement, and was successfully resolved through standard platform moderation, posing minimal threat to national security.
The GAN model was used as a tool to generate static synthetic images of human faces, which were then manually or programmatically uploaded by human operators to create fake profiles.
Limited Risk: The report describes the use of AI-generated content (deepfakes/synthetic profile pictures), which under the EU AI Act falls under limited risk and requires transparency obligations to inform users they are interacting with AI-generated content.
The primary function of the AI system (GAN) in this incident was to generate realistic, synthetic images of human faces to be used as profile pictures.
The reports provide consistent, detailed accounts of the Stanford Internet Observatory's investigation and NPR's follow-up verification. The facts regarding the scale (over 1,000 profiles), the technology used (GANs), and the commercial motivation (lead generation) are clearly documented across multiple sources.
None, the commercial lead-generation context is clearly established as the primary driver of the incident.
Technology
High-Fidelity GAN Generation
GANs generate highly realistic faces that are difficult to distinguish.
Easy Access to AI Tools
Websites allow anyone to download computer-generated faces for free.
Data Inputs
Large Training Datasets
GANs trained on huge photo datasets to produce lifelike human features.
Human Factors
Limited Human Detection Ability
Humans have only a 50 percent chance of identifying AI-generated faces.
Perceived Trustworthiness of AI
AI-synthesized faces are rated as more trustworthy than real human faces.
Expectation of Authenticity
Users assume profiles represent real humans on professional networks.
Process and Methods
Bypassing Platform Limits
Fake profiles used to circumvent LinkedIn's messaging limits.
Inadequate Vendor Auditing
Clients failed to audit lead-generation methods used by outside vendors.
Automated Detection Gaps
LinkedIn's automated defenses failed to catch all GAN-generated profiles.
Management
Outsourcing Lead Generation
Companies outsourced sales outreach to third parties without oversight.
Prioritizing Low-Cost Outreach
Using AI avatars is cheaper than hiring real sales staff to scale operations.
Regulatory Environment
Ambiguous Avatar Rules
Some vendor CEOs believed there were no specific rules against AI avatars.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
