No Encore: Unlearning as Opt-Out in Music Generation

Jinju Kim Taehan Kim Abdul Waheed Jong Hwan Ko Rita Singh · 2025

Read No Encore: Unlearning as Opt-Out in Music Generation by Jinju Kim Taehan Kim Abdul Waheed Jong Hwan Ko Rita Singh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06277.txt.

Introduction

Teaching a music generator to forget specific training material is explored in a 2025 paper led by Jinju Kim with four co-authors. Text-to-music systems can absorb copyrighted creations, raising legal and ethical exposure. Machine unlearning promises an opt-out: remove a dataset's influence without retraining and without wrecking performance.

The authors apply existing unlearning methods to a pretrained text-to-music baseline and measure how well the material is forgotten while quality survives. Their early results, from ongoing research, map the challenges specific to music, where style and melody entangle across works. The analysis is offered as a foundation for unlearning in generative music systems.

Catalog record

CREATORJinju Kim Taehan Kim Abdul Waheed Jong Hwan Ko Rita Singh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06277

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

No Encore: Unlearning as Opt-Out in Music Generation Jinju Kim Taehan Kim Abdul Waheed Jong Hwan Ko Rita Singh Abstract AI music generation is rapidly emerging in the creative industries, enabling intuitive music generation from textual descriptions. However, these systems pose risks in exploitation of copyrighted creations, raising ethical and legal concerns. In this paper, we present preliminary results on the first application of machine unlearning techniques from an ongoing research to prevent inadvertent usage of creative content. Particularly, we explore existing methods in machine unlearning to a pre-trained Text-to-Music (TTM) baseline and analyze their efficacy in unlearning pre-trained datasets without harming model performance. Through our experiments, we provide insights into the challenges of applying unlearning in music generation, offering a foundational analysis for future works on the application of unlearning for music generative models. \workshoptitle AI for Music 1 Introduction With remarkable breakthroughs in generative AI, high-quality content creation has become widely available in domains with only a precise design of text input prompt dall_e ; chatgpt ; valle2 ; sora ; kim2025ossl ; lee2025dittotts . While advances enable music creation donahue2024hookpad , protection of creators’ rights has become an urgent industry concern Quintais2025GenerativeAI ; copyright_article12 . Problems range from unauthorized use of copyrighted material, fairness in compensation, and infringement. With European Union’s AI Act and General Data Protection Regulation (GDPR), these problems are further amplified EU_GDPR_2016 . Hence, major AI music generation systems and open data platforms are beginning to establish safeguards against unauthorized use of copyrighted material for AI training harmonycloak ; Sony2024 ; WMG2024AIStatement ; WSJ2025AILicensing . Musicians have also voiced strong opposition to the use of copyrighted works for AI without permission Reuters2025SilentAlbum ; FT2025HelpIsComing . This reflects a growing trend: while the industry acknowledges AI’s potential as a creative tool, it emphasizes that innovation must not come at the expense of artists’ ownership and copyright protection. As music generation service provider, it is crucial to ensure that artists who opt-out of are not exploited during pre-training and after model deployment. To address these challenges, machine unlearning (MU), a method designed to selectively remove the knowledge of certain datasets from a model’s parameters can serve as a solution towards@cao . Instead of having to retrain a large model, MU ensures that information derived from specific datasets no longer affects the model’s outputs with fine-tuning. MU has been explored in various domains of generative AI for its potential of removing unwanted dataset, concept, and output without harming generative performance gandikota2023erasing ; thudi2022unrolling ; gu2024second ; liu2024machine ; fan2024salun ; kim2025do . By integrating MU techniques into music AI, a solution for ethical and compliant music generation can be offered. This study is the first to explore machine unlearning in Text-to-Music, establishing a foundation for future research on applying unlearning to musical content generation. Our experimental results reveal the limitations of existing unlearning methods and analysis that point toward directions for safe music generation. 2 Related Works Text-to-Music Generation Text-to-Music (TTM) models musicgen ; li2024qamdtqualityawaremaskeddiffusion ; fei2024fluxplaysmusic ; chowdhury2024melfusion ; agostinelli2023musiclmgeneratingmusictext ; Novack2025Presto aim to generate music that aligns with provided textual descriptions, allowing users to specify musical characteristics such as genre, mood, instrumentation, and style. A common practice in developing these models involves training on large-scale corpora that often contain copyrighted material, frequently sourced from platforms like YouTube or other web repositories. This reliance on potentially sensitive and proprietary audio data raises ethical and legal questions. Generative Unlearning Generative unlearning applies the principles of MU to generative AI to remove the influence of particular data or concepts from the generated distribution while preserving the model’s ability to produce high-quality, diverse outputs golatkar2020eternal . Approaches often involve modifying or fine-tuning a pre-trained parameters to “forget” certain patterns without significantly degrading performance on the rest of the data distribution. These techniques have been explored in vision, language, and speech domains seo2024generative ; kim2025do . Music, however, remains underexplored in machine unlearning. Our work represents a preliminary step toward extending generative unlearning frameworks to the complex and underexplored terrain of music generation. Please see Appendix B for extended related works. 3 Machine Unlearning for Music Generation Figure 1: An overview of unlearning and its role in music generation: when a request is made to remove a specific piece of music from the pre-training dataset (the forget set), unlearning provides a potential solution. The goal is not only to erase the model’s reliance on that data, but also to ensure that future generations diverge from the copyrighted material to ensure safe music generation. We investigate machine unlearning in the context of music generation with the goal of removing the influence of specific training subsets while preserving model performance. Our study is guided by the following question: Can existing machine unlearning methods be directly applied to erase pre-trained musical knowledge in music generation models? 3.1 Problem Formulation In Figure 1 , we consider a pre-trained TTM model parameterized by \theta , which maps a natural language prompt x to a corresponding musical output y . Given a forget set \mathcal{F}={(x^{f},y^{f})} consisting of text-music pairs that should no longer influence the model’s behavior, our goal is to modify the parameters of \theta such that the model effectively "forgets" this data. Concretely, we require that: • For a forget prompt x^{f} that targets y^{f} in the forget set, the updated model \theta^{-} should no longer generate the corresponding music. • For all other prompts x\notin\mathcal{F} , the updated model \theta^{-} should preserve the original generation performance of \theta . We refer to these as remain set denoted by x^{r}\in\mathcal{R} . 3.2 Unlearning Methods In this paper, we explore two representative machine unlearning approaches for TTM on MusicGen musicgen . See Appendix A.1 for details on the model. Following prior work thudi2022unrolling , we implement Gradient Ascent (GA) , or Negative Gradient (NG) thudi2022unrolling ; feng-etal-2024-fine ; gu2024second , which maximizes the training loss for (x^{f},y^{f})\in\mathcal{F} . By pushing \theta in the direction opposite to standard training, GA attempts to revert learned influence from \mathcal{F} . We also implement Random Labeling (RL) which aims to break the learned associations of text prompts x^{f} and corresponding target y^{f} . RL reassigns new random targets \tilde{y} to x^{f} and thus destroys the original correspondence of (x^{f},y^{f}) . This forces the model to disregard the pre-trained alignment between text prompts and their associated musical outputs golatkar2020eternal . 4 Experiments 4.1 Experimental Setups Backbone Experiments are performed on MusicGen on the standard hyperparameter settings from the original paper musicgen . MusicGen is pre-trained with 20k hours of licensed music comprised of internal dataset, ShutterStock 1 1 1 https://www.shutterstock.com/ , and Pond5 2 2 2 www.pond5.com music data. Please refer to Appenndix A for details. Datasets To remove pre-trained knowledge, we utilize approximately 500 samples from Pond5 dataset as the forget set. MusicCaps dataset agostinelli2023musiclmgeneratingmusictext is employed as the remain set. Both datasets consist of extensive music-text pairs spanning a wide range of genres and styles. In our study, MusicCaps serves as \mathcal{R} while Pond5 serves as \mathcal{F} . Specifically, we assess the preservation of performance on \mathcal{R} to evaluate how unlearning with \mathcal{F} affects the model’s ability to generate text-coherent and diverse music. Please refer to Appendix A.2

Read the complete text