This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In March 2024, perpetrators established fake law firms, such as 'Commonwealth Legal,' using AI-generated attorney portraits and fabricated biographies to send fraudulent DMCA takedown notices. The goal of these deceptive communications was to coerce website owners into providing backlinks to improve the search engine optimization (SEO) of a gadget review site. The scheme exploited AI-generated imagery to lend false credibility to the fraudulent legal threats.
In March 2024, fake law firms using AI-generated identities sent fraudulent DMCA takedown notices to website owners, demanding backlinks for SEO gains. These AI-generated law firms, like "Commonwealth Legal," used GAN models for realistic attorney images and fabricated bios. The scam involved fake legal threats to coerce site owners into adding backlinks, exploiting AI technology for deceptive practices.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The perpetrators used AI-generated imagery to construct fake professional personas to execute a fraudulent legal threat scam for personal SEO advantage.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was orchestrated by human actors who intentionally deployed pre-existing GAN models to generate fake attorney portraits for a fraudulent SEO scheme.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
A commercial SEO fraud scheme utilizing GAN-generated attorney portraits to fabricate a fake law firm and send deceptive DMCA notices. The incident has negligible national security implications, representing localized commercial fraud rather than a threat to national infrastructure, sovereignty, or security.
The GAN model functioned as a Tool, performing the specific, well-defined function of generating realistic human faces based on direct inputs, without maintaining an internal state, planning, or interacting autonomously with the victims.
Risk Level 3: The incident involves the use of AI-generated content (synthetic attorney portraits), which falls under Limited Risk due to transparency concerns regarding users interacting with or being exposed to AI-generated synthetic media.
The GAN was used specifically to generate realistic, synthetic portraits of non-existent attorneys to populate a fake law firm website.
The report clearly outlines the mechanics of the scam, the role of the AI-generated images, and the parties involved. The identification of GAN-generated images was verified by an external AI detection firm (Reality Defender), leaving little ambiguity about the technology used.
None
Technology
GAN Face Generation
GANs allowed creation of realistic, fake attorney photos to build credibility.
AI Text Generation
Generative AI drafted professional-sounding but bizarre attorney biographies.
Human Factors
Susceptibility to Legal Threats
Fear of copyright lawsuits makes victims vulnerable to fake DMCA notices.
Deceptive Intent by SEO Actors
Malicious actors weaponized AI to scale a fraudulent backlink scheme.
Process and Methods
Flawed SEO Backlink Metrics
Search engines rely heavily on backlinks, incentivizing manipulative schemes.
Weak Domain and Identity Check
NameCheap and web hosts did not verify the legitimacy of the law firm site.
Management
Unmonitored SEO Outsourcing
Tech4Gods hired sketchy contractors to build backlinks without oversight.
Regulatory Environment
Lax Enforcement of DMCA Abuse
Lack of penalties for fraudulent DMCA notices allows scammers to abuse them.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
