Sleeping-DISCO 9M: A large-scale pre-training dataset for Generative Music modeling

Tawsif Ahmed, Andrej Radonjic*, Gollam Rabby · 2025

Read Sleeping-DISCO 9M: A large-scale pre-training dataset for Generative Music modeling by Tawsif Ahmed, Andrej Radonjic*, Gollam Rabby (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14293.txt.

Introduction

Generative music models need training data built from real, well-known songs. Open data sets have mostly offered synthetic or re-recorded material. Huge audio scrapes are the other option, but they miss the flavor of real music. Tawsif Ahmed, Andrej Radonjic, and Gollam Rabby present Sleeping-DISCO 9M, a large-scale pre-training data set for music and song. It is built from actual popular music by world-renowned artists.

The authors aim the data set at tasks such as text-to-music generation, music captioning, and singing voice synthesis. It also suits melody reconstruction and cross-modal retrieval. They argue that earlier sets saw weak adoption in the generative music community because they did not reflect real-world music. Their set, they say, changes that story by grounding training in the popular songs listeners actually know.

Catalog record

CREATORTawsif Ahmed, Andrej Radonjic*, Gollam Rabby
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-14293

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sleeping-DISCO 9M: A large-scale pre-training dataset for Generative Music modeling Tawsif Ahmed, Andrej Radonjic*, Gollam Rabby Abstract We present Sleeping-DISCO 9M, a large-scale pre-training dataset for music and song. To the best of our knowledge, there is no open-source, high-quality dataset representing popular and well-known songs for generative music modeling tasks such as text-to-music, music captioning, singing voice synthesis, melody reconstruction, and cross-modal retrieval. Previous contributions have focused on isolated and constrained factors, aiming to create synthetic or re-recorded music corpora (e.g., GTSinger, M4Singer). Alternatively, efforts like DISCO-10M and LAION-DISCO-12M provided arbitrarily large-scale audio datasets. However, adoption of these datasets has been limited within the generative music community, as they fail to reflect real-world music and its unique flavor. Sleeping-DISCO 9M changes this narrative by offering a dataset built from actual popular music and world-renowned artists. Dataset 1 Introduction Generative Music modeling is a subfield of Generative AI, where music modeling through user inputs and concepts such as melody reconstruction, music continuation, text-music, and lyric-to-song are explored. None of these research directions have a unified dataset structure or requirement, which means it depends on the researchers what datasets to choose and how to construct them. Most often, as we have seen for Jukebox from OAI, Neural Melody Reconstruction from Microsoft, and other well-known players, datasets are constructed from scratch through scraping online lyric finders and YouTube videos. While the trained models, their codebases, and model weights are made public, the datasets are sealed off due to competitive and legal reasons. We can also see its Chinese counterparts such as DiffSinger [ 12 ] , Prompt-Singer [ 13 ] , SongCreator [ 2 ] , and SongComposer [ 15 ] , which have either constructed their own open-source datasets or have used third-party datasets available on Kaggle to construct an artificial training corpus. Apart from these, some research labs like Meta AI use proprietary stock music datasets by paying the respective rights holders. Parallel to all these debacles, there’s a growing community—mainly Chinese—who are constantly publishing open-source, high-quality pre-training datasets for the Generative Music Modeling community. Prominent examples are GTSinger [ 6 ] and M4Singer [ 5 ] , which have created professionally recorded mono and multilingual training datasets, while their size itself is a concern since most models require a couple of hundred thousand audio samples for training—but it depends on the specific paper, architecture, and objective. These datasets have seen adoption by the research community, but their practical use remains limited. Due to their limited nature, serious contender models want to use popular and real-world music that people are constantly listening to and vibing with. To tackle this, efforts have been made to address the lack of datasets representative of real-world, loved songs and popular tracks. The DISCO team released DISCO-10M [ 1 ] , and LAION later released LAION-DISCO-12M [ 3 ] . These datasets, similar to the previously mentioned efforts, were poorly adopted by the community, and most serious papers that introduce large-scale pre-trained models for Generative Music Modeling overlook these datasets and use their own scraped datasets or privately owned corpora. The blame can be placed on the fact that these large-scale, arbitrary datasets are practically just YouTube music video links and limited metadata scraped from Spotify or YouTube Music, making them undesirable for most practical applications in the research community. Dataset Lyrics Artists Year Audio Languages Open Source Sleeping-DISCO 9M 8,956,887 648,118 2025 yes English, Japanese and EU languages yes Jukebox 1,200,000 - 2020 yes English and others no SongCreator 270,000 - 2024 yes English, Chinese yes M4Singer - 20 2022 yes Chinese yes GTSinger - 20 2024 yes English, Chinese, Italian and total nine yes Table 1: Comparative Analysis between Sleeping-DISCO and Competition In Table 1, we present a comparison between Sleeping-DISCO and other well-known quality contributions in the subfield of generative music modeling, specifically singing datasets. In this area, researchers either focus on training a foundation model from scratch to generate songs, continuation of parts of a song, or writing lyrics. Jukebox [ 4 ] is the most well-known example in this category, followed by SongCreator, and specialized datasets such as M4Singer for the Chinese language and GTSinger for English, Chinese, and a few European languages. Among them, Jukebox scraped the Lyricwiki (now defunct) [ 10 ] website to create a private dataset, while the rest of the examples used professionally recorded popular songs and scratch-written songs performed by paid vocalists and artists. Unlike these datasets, where either the quality corpus is private or not very interesting, our contribution, Sleeping-DISCO, provides massive amounts of songs and artists, covering 169 languages including English, Chinese, Japanese, and European languages. Dataset Artists Audio Clips Year Hours Metadata Sleeping-DISCO 9M 648,118 8,768,103 2025 444,450 Individual song, artist, album, yearly details DISCO-10M 400,047 15,296,232 2023 764,811.6 Unknown LAION-DISCO 12M 250,516 12,648,485 2024 632,424.25 Video metadata M4Singer 20 700 2022 29.77 Alignment and Music score GTSinger 20 1,200 2024 80.59 Class labels Table 2: Breakdown of scale and metadata between past contributions and our dataset In Table 2, we present a side-by-side comparison between our dataset and other contributions to contrast the balance between scale and quality that we have provided. DISCO-10M leads in providing the most hours of audio, followed by the LAION-DISCO dataset, and Sleeping-DISCO comes in third. While it positions itself third, it outcompetes both DISCO and LAION-DISCO in terms of available artists and metadata. Both DISCO and LAION-DISCO were created to provide an arbitrary number of audio clips for pre-training without factoring in metadata components for individual songs or enabling search based on artists and genre. Our contribution provides in-depth and exhaustive metadata for each individual song and album, as well as the ability to search based on artists and genre. Sleeping-DISCO also makes it possible to search for songs based on a particular year, which is unavailable in all the other contributions. If we explore some of the recent high-quality contributions such as M4Singer and GTSinger, which provide audio-wise metadata, our contribution beats them by a large margin as well. Our contributions are as follows: 1. We have provided a balanced large-scale pre-training dataset for the generative music modeling field. 2. We also include in-depth metadata in the form of individual song and album metadata, lyric embeddings, nearly a thousand genres, and all widely spoken languages. Additionally, YouTube links to download audio clips, YouTube video metadata, embeddings for lyrics, and captions for songs. 2 Related Work Quality private corpus: Big labs construct private in-house lyrics and song metadata datasets by scraping online lyric finders, lyric translation, and song metadata websites. Afterwards, based on that database, they collect audio from YouTube and third-party sources. Jukebox and Neural Melody Reconstruction [ 11 ] are well-known examples in this category. Sleeping-DISCO is the first public training corpus in this category, matching both the quality and scale of big labs’ private datasets through scraping popular online lyric and song metadata websites such as Genius. Scattered singing dataset contributions: These are isolated contributions where datasets are not created for training generative music modeling models and research; rather, they aim toward exploratory analysis, song and metadata analysis, and studying music and signal components. In the past, the Million Song Dataset

Read the complete text