This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
In October 2024, a defendant in Nanjing was convicted for using AI face-swap software to bypass facial recognition security on a financial platform. By combining stolen personal data with AI-generated dynamic videos, the perpetrator successfully accessed 23 victim accounts, changed security credentials, and committed financial fraud. The incident prompted the financial platform to implement security upgrades, and the case highlights ongoing vulnerabilities in biometric authentication systems.
In Nanjing, Jiangsu Province, a defendant (Fu Mou) was convicted in October 2024 for allegedly using AI‑powered face‑swap software to bypass an unnamed financial platform's facial recognition system. Authorities reported that he obtained over 1.95 million pieces of personal data, accessed 23 victims' payment accounts, changed passwords for several, and used one linked bank card to make purchases. Prosecutors said only one platform was successfully breached.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Also classified as
The financial platform's facial recognition system failed to robustly distinguish between a real human face and an AI-generated dynamic video.
The perpetrator used AI face-swap software to impersonate victims and bypass facial recognition to steal funds, which represents targeted exploitation for personal financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by a human actor who intentionally used AI face-swap software post-deployment to bypass biometric security and commit financial fraud.
An individual in China used AI face-swap software and stolen personal data to bypass biometric security on a financial platform, committing minor fraud. The incident highlights evolving vulnerabilities in biometric authentication systems to AI-generated synthetic media, posing minor long-term technological security concerns but negligible immediate national security impact.
The AI face-swap software was used as a tool by the human perpetrator to generate dynamic videos based on direct inputs to bypass facial recognition, performing a specific, well-defined function without autonomous planning.
Limited Risk: The report describes the use of AI-generated content such as deepfakes ('AI换脸软件') to bypass security, which falls under the category of deepfakes/synthetic media requiring transparency, though its malicious use here constitutes fraud.
The perpetrator specifically used AI face-swap software to generate dynamic videos to bypass facial recognition systems.
The reports from official Chinese media (CCTV) provide clear, consistent, and detailed factual accounts of the crime, the court sentencing, the specific technical methods used (dynamic video generation to bypass liveness checks), and the exact number of victims and financial losses.
None. The facts of the criminal case and the role of the AI tool are clearly established by the court ruling.
Technology
AI Face-Swapping Software
AI generated dynamic videos mimicking user actions to bypass recognition.
Vulnerable Liveness Detection
The platform's facial recognition failed to identify fake dynamic videos.
Data Inputs
Leaked Personal Data
Over 1.95 million personal records were bought online by the criminal.
Human Factors
Low Personal Security Awareness
Victims allowed their personal information to be leaked and sold online.
Process and Methods
Single-Factor Authentication
The platform allowed password changes using only biometric facial scans.
Weak Risk Control Systems
Unlike other platforms, this platform had security vulnerabilities.
Management
Inadequate Security Auditing
The platform management failed to patch known facial recognition flaws.
Regulatory Environment
Illegal Online Data Trading
Black markets allowed easy purchase of massive personal information.
