This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Entertainment agencies in South Korea, including Fantagio, have issued warnings regarding the misuse of their artists' likenesses in deepfake videos and impersonation scams. These scams involve perpetrators soliciting money and personal information from fans under the guise of the celebrities. The report highlights a persistent trend of deepfake exploitation across the entertainment industry, affecting multiple high-profile figures.
Fantagio Entertainment, the agency of actor Kim Seon-ho, reportedly warned of recent impersonation scams and purported deepfake videos allegedly misusing his likeness and demanding money. The agency stated that neither Kim nor his staff would solicit funds or personal information, and pledged legal action.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
The incident involves malicious actors using deepfake technology to impersonate celebrities and scam fans for financial gain.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human malicious actors intentionally using deployed deepfake generation tools to scam fans.
Added categories peak at 2: Minor (Psychological Harm, Direct)
The incident involves malicious actors using AI-generated deepfakes of South Korean celebrities to conduct financial impersonation scams. While causing distress and financial harm to individuals, it represents a standard cybercrime threat with negligible direct impact on national security, critical infrastructure, or state sovereignty.
The AI system is used as a tool to generate deepfake videos and advertisements based on direct inputs (celebrity likenesses) without autonomous decision-making or planning.
Limited Risk: The report describes the creation and distribution of deepfakes, which are subject to transparency obligations under the EU AI Act to ensure users are aware they are interacting with AI-generated content.
The AI was used to generate synthetic videos of celebrities to impersonate them for fraudulent purposes.
The report clearly identifies the nature of the threat (deepfake impersonation scams) and the affected parties (several South Korean celebrities and their agencies). However, it lacks specific technical details about the AI tools used, the exact number of victims, and the total financial losses incurred.
None. The events are clearly described as malicious deepfake impersonation scams.
Specific names of the AI generation tools or platforms used, the number of fans who fell victim to the scams, and the total monetary value of the financial losses.
Technology
Generative AI Deepfake Tools
Advanced AI tools allow realistic replication of actor likenesses.
Lack of Deepfake Detection
Platforms lack automated systems to detect and block deepfakes.
Data Inputs
Publicly Available Media
Abundant online photos and videos of stars used to train deepfakes.
Human Factors
Credulous Social Media Users
Fans easily fall for financial scams believing they are talking to stars.
Malicious Intent of Scammers
Scammers exploit trust in celebrities for financial gain.
Process and Methods
Reactive Monitoring Systems
Agencies rely on manual monitoring after the deepfakes are spread.
Ineffective Takedown Methods
Slow removal processes allow deepfakes to remain online longer.
Management
Reactive Agency Protection
Agencies lack proactive defense mechanisms to protect stars' likenesses.
Regulatory Environment
Inadequate Legal Deterrents
Current laws fail to prevent illegal deepfake production and distribution.
AI system involved
An AI system was involved, but the reports do not identify it.
Identified by automated extraction; can differ from the alleged developers above.
