Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South

Atharva Mehta, Shivam Chauhan, Monojit Choudhury · 2024

Read Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South by Atharva Mehta, Shivam Chauhan, Monojit Choudhury (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04100.txt.

Introduction

Atharva Mehta, Shivam Chauhan, and Monojit Choudhury audited music data behind AI generation systems in two thousand twenty-four. Generative models can now compose music, but their range depends on training data. The authors asked how well the music of the Global South is represented.

They analyzed over a million hours of audio datasets and reviewed more than two hundred papers from major venues. About eighty-six percent of dataset hours and over ninety-three percent of researchers centered on music from the Global North. Music from the Global South made up under fifteen percent of the data. Half the papers used symbolic generation, which can miss cultural nuance. The authors propose steps toward a more inclusive field.

Catalog record

CREATORAtharva Mehta, Shivam Chauhan, Monojit Choudhury
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-04100

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Missing Melodies: AI Music Generation and its "Nearly" Complete Omission of the Global South Atharva Mehta, Shivam Chauhan, Monojit Choudhury Abstract . Recent advances in generative AI have sparked renewed interest and expanded possibilities for music generation. However, the performance and versatility of these systems across musical genres are heavily influenced by the availability of training data. We conducted an extensive analysis of over one million hours of audio datasets used in AI music generation research, and manually reviewed more than 200 papers from eleven prominent AI and music conferences and organizations to identify a critical gap in the fair representation and inclusion of the musical genres of the Global South in AI research. Our findings reveal a stark imbalance: approximately 86% of the total dataset hours and over 93% of researchers focus primarily on music from the Global North . However, around 40% of these datasets include some form of non-Western music, and genres from the Global South account for only 14.6% of the data. Furthermore, approximately 51% of the papers surveyed concentrate on symbolic music generation, a method that often fails to capture the cultural nuances inherent in music from regions such as South Asia, the Middle East, and Africa. As AI increasingly shapes the creation and dissemination of music, the significant underrepresentation of music genres in datasets and research presents a serious threat to global musical diversity, including evaluating music generation models, economic disparities, and reinforcing biases in generative music models. We also propose some important steps to mitigate these risks and foster a more inclusive future for AI-driven music generation. DOI: XXXXXXX.XXXXXXX CCS: Applied computing Sound and music computing CCS: Information systems Multimedia content creation CCS: Computing methodologies Artificial intelligence CCS: General and reference Surveys and overviews 1. Introduction Music has always been a crucial element in representing the traditions of different communities worldwide ( Savage, 2019 ) . With recent developments in AI, particularly through the use of deep learning models ( Copet et al., 2024 ; Schneider et al., 2024 ; Melechovsky et al., 2024 ; Agostinelli et al., 2023 ) , there has been a dramatic improvement in generating music automatically. These advancements have led to the creation of various AI-driven music platforms, such as Jukebox ( Dhariwal et al., 2020 ) , Suno , Udio , Boomy , Soundraw , etc, giving users the ability to create music based on their preferences using text prompts. In terms of generation quality and performance, AI systems have significantly improved on automatic evaluation metrics as well as human evaluations, enabling more human-like and controlled music generation, indicating a significant improvement in their capabilities ( Melechovsky et al., 2024 ; Agostinelli et al., 2023 ; Schneider et al., 2024 ; Copet et al., 2024 ) . Due to the ease of use, people can now "vibe compose" musical pieces with minimal musical knowledge. Dysart (2018) noted, "AI-generated music could easily surpass the amount of music that has ever been recorded, due to how quickly it can be produced." In terms of its consumption, Mubert, an online AI music composition website, reported that by mid-2023 its users had streamed more than 100 million AI-generated tracks 1 1 1 https://mubert.com/blog/an-in-depth-study-into-ai-music-its-creators-composers-and-adopters . With growing compute and efficient models, systems like Mousai can generate 43-second music clips in 49.2 seconds using just 5.04 GB GPU memory, enabling round-the-clock production far beyond human efficiency. Figure 1. Global Divide in AI Music Datasets: The heatmap shows the stark imbalance in regional musical styles (on the map) and genre (pie chart) representation in popular music datasets. As noted in past studies ( Tao et al., 2024 ; Ungruh et al., 2024 ) , despite impressive technological progress, biases remain prevalent in AI music generation systems. These include popularity, training data bias, and limited research interest, which leads to under-representation of musical genres from the Global South regions of the world. For instance, the model described in Melechovsky et al. (2024) ; Copet et al. (2024) ; Schneider et al. (2024) often defaults to Western tonal and rhythmic structures when tasked with generating non-Western music such as Indian classical or traditional Middle Eastern genres, let alone lesser-known styles and genres such as the Baul (See A.1 ) and instruments such as the Gonje (definition in A.1 ). As a result, a generated piece intended to mimic an Indian raga may sound like a Western pop melody played on a sitar. Similarly, SunoAI, when attempting to generate Maqamat (see A.1 ) music of the Middle East, may round off the microtones to the nearest Western equivalent, resulting in a piece that lacks the distinctive sound of Arabic music. As generative models continue to gain traction in the field of music generation, the misrepresentation and under-representation of the musical genres of the ‘‘global majority" poses a significant threat to the inclusion of musical genres from around the world. The skewed distribution in datasets, reflected in model outputs, can lead to several issues, including cultural homogenization, reinforcement of Western culture dominance 2 2 2 https://www.nytimes.com/2016/06/26/opinion/sunday/artificial-intelligences-white-guy-problem.html , misrepresentation of musical styles, and most importantly, gradual decline leading to the endangerment and disappearance of many musical genres ( Tan, 2021 ; Lund, 2019 ; Team, 2023 ) . Drawing inspiration from studies such as Joshi et al. (2020) and Bender and Friedman (2018) , which systematically analyze the under-representation of languages of the global majority in the field of natural language processing, we attempt to analyze the under-representation of musical genres in the field of AI music generation. In this paper, we examine the distribution of musical genres and regional music from around the world in the datasets that are used to train models and conduct research in AI-music. We also study and contrast the distribution of participation of researchers from different parts of the world to the latter. This allows us to examine whether regions underrepresented in datasets are also underrepresented in authorship, further reinforcing existing imbalances. To this end, we analyze many popular datasets and papers from eleven AI conferences and organizations and contrast these findings with the digital (online) of consumption & availability and ideal (offline) proxies of population. Our study reveals almost a complete omission of the musical styles of the Global South in the AI world (Figure 1 and Table 1 ). Approximately 86% of the total hours in available datasets and 93% of papers focus majorly on the music of the Global North . In contrast, only 14.6% of the total hours of music data and 6.1% of papers are first-authored by researchers from South Asian, Middle Eastern, Oceania, Central Asian, Latin American, and African countries. This distributional skew in the training data is reflected in the quality of generated samples from several popular systems, Jukebox, Suno, and Udio (some examples are available for listening on our GitHub page 3 3 3 https://atharva20038.github.io/aimusicexamples.github.io/ . ). We discuss several implications of this representational skew on the resulting quality of the generated music, research, and society, including concerns ranging from improper evaluations of generative models and limited creativity and diversity in generative AI-assisted music composition for the underrepresented genres to cultural erosion. The article is organized as follows: In Section 2 , we formally define

Read the complete text