This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
The artist [name withheld] has publicly condemned the circulation of unauthorized, AI-generated music that falsely uses her voice and likeness. Her management team confirmed these recordings are fake and not part of her official discography. This incident highlights broader industry concerns regarding the use of AI to infringe upon the rights of human artists.
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems capable of creating economic or cultural value, including through reproduction of human innovation or creativity (e.g., art, music, writing, coding, invention), destabilizing economic and social systems that rely on human effort. The ubiquity of AI-generated content may lead to reduced appreciation for human skills, disruption of creative and knowledge-based industries, and homogenization of cultural experiences.
Also classified as
The AI-generated music purports to be authentic performances by the artist, representing a form of impersonation and targeted manipulation of listeners.
The incident involves the unauthorized reproduction and imitation of an artist's voice and likeness, which devalues human creative effort and threatens the economic rights of musicians.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human actors intentionally using deployed AI voice cloning technologies to generate and distribute unauthorized music mimicking the artist's voice.
Added categories peak at 2: Minor (Epistemic Harm, Direct)
The unauthorized use of AI voice cloning to replicate singer Celine Dion's voice represents a commercial intellectual property dispute within the creative industry. It highlights ongoing challenges in copyright and artist rights but carries negligible national security implications.
The report does not identify the specific AI system or characterize its operational mode, focusing only on the output generated.
Limited Risk: The incident involves AI-generated deepfakes (cloned voice and likeness), which are subject to transparency obligations under the Act.
The AI system was used to clone and generate the singing voice of the artist to create fake musical performances.
The report clearly details the artist's response to the unauthorized AI music and the broader industry context, allowing for straightforward classification under the devaluation of human effort.
The incident could be viewed primarily as an intellectual property dispute rather than an AI safety issue, but the use of synthetic voice cloning firmly places it in the AI risk domain.
Technology
Advanced Voice Cloning Tech
AI models can accurately mimic specific artist voices without permission.
Generative AI Accessibility
Easy access to AI music tools allows anyone to generate deepfake songs.
Data Inputs
Unsanctioned Training Data
AI models are trained on copyrighted artist recordings without consent.
Lack of Voice Data Protection
Publicly available audio files are harvested to train voice clones.
Human Factors
Intentional Misrepresentation
Creators intentionally pass off AI music as official performances.
Lack of Respect for Artist Rights
Users prioritize novelty and content creation over artist consent.
Process and Methods
Inadequate Platform Filtering
DSPs lack robust systems to detect and block unauthorized AI voice clones.
Flawed Distribution Verification
Music distribution processes fail to verify the authenticity of vocals.
Management
Prioritizing Growth Over Rights
Platforms focus on hosting vast content libraries over enforcing safety.
Inadequate Risk Management
AI developers fail to assess the legal and ethical risks of voice cloning.
Regulatory Environment
Weak Copyright Protections
Current copyright laws fail to adequately protect artist voice and likeness.
Lack of AI Music Regulations
Governments have not outlawed unauthorized commercial AI voice generation.
