Comparison of spectrogram scaling in multi-label Music Genre Recognition

Bartosz Karpiński, Cyryl Leszczyński · 2025

Read Comparison of spectrogram scaling in multi-label Music Genre Recognition by Bartosz Karpiński, Cyryl Leszczyński (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02091.txt.

Introduction

Tagging a song's genre sounds easy until albums blend styles freely, as modern records do. Bartosz Karpiński and Cyryl Leszczyński tackle multi-label genre recognition: one track may earn several tags at once. Their study compares how the sound should be pictured for the machine, testing different ways of scaling the spectrogram, the standard map of pitch against time, and different training approaches.

Experiments ran on a custom, hand-labelled dataset of more than eighteen thousand entries, built to reflect today's eclectic albums. The authors weigh which picture scaling and training recipe handles mixed-genre reality best. Their comparisons speak to streaming services and archives that must organise vast catalogues where tidy single labels fail.

Catalog record

CREATORBartosz Karpiński, Cyryl Leszczyński
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02091

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Comparison of spectrogram scaling in multi-label Music Genre Recognition Bartosz Karpiński, Cyryl Leszczyński Abstract 1 Wrocław University of Science and Technology, student at time of writing [email protected] 2 Poznań University of Economics and Business, assistant [email protected] Keywords: Multi-Label Classification, Acoustic Data Classification, Imbalanced Data Classification, Music Information Retrieval ( MIR ) Abstract Classifying music into separate genres is an important task, which helps listeners discover new tracks, allows streaming services to better adjust to user preferences, and allows labels and music stores to advertise new albums more effectively. As the accessibility and ease-of-use of digital audio workstations increases, so does the quantity of music available to the public; additionally, differences between genres are not always well defined and can be abstract, with numerous records representing widely varying combinations of genres. In this article, multiple preprocessing methods and approaches to model training are described and compared, accounting for the eclectic nature of today’s music. A custom and manually labeled dataset of more than 18000 entries has been used to perform the experiments. 1 Introduction Music genres are a very useful tool to categorize music, which is valuable both for the end user e.g. listener, as they know what other records may be similar to the one they love, as well as for the stores and record labels, as they can try to promote less known records that have similarities to the more popular ones. Thus, the task known as Music Genre Recognition ( MGR ), in addition to being simply a subset of Audio Classification, has its own important niche of application. Tzanetakis and Cook [ 33 ] was one of the first works to show classification of music genres as a pattern recognition task. The authors proposed three sets of characteristics: timbral texture, rhythmic, and pitch content. The classification itself was performed using Statistical Pattern Recognition, Gaussian, Gaussian Mixture Models, and k-Nearest Neighbors. However, the greatest impact was the provided dataset, later named GTZAN , which is a staple of Music Genre Recognition tasks to this day, being often used as a benchmark dataset when performing MGR [ 21 ] . However, GTZAN had many problems, such as simplicity, small number of examples, missing and wrong metadata, and many others [ 32 ] . This is not to say that the different commonly used data sets did not have a fair share of problems. One Million Songs Dataset [ 3 ] , despite a huge number of examples, only provided tabular data and not raw files, making it unsuitable for use with many of the state-of-the-art approaches. MagnaTagATune Dataset lacks proper tagging. Additionally, almost all of them contain only license-free music, generally not as diverse and adequate as popular licensed music, and are far behind the current trends and should be considered outdated and unrepresentative of the current music landscape. Today, with the advancement of technology, there is an abundance of tools and programs - which are also much easier to use than before - as well as opportunities, and nearly anyone can be an artist. This leads to a massive surge of music released every day. According to the website Discogs [ 39 ] , the number of newly published music increased nearly tenfold from around 400 thousands in the 1950s to more than 4 millions in the 2010s. As the quantity of music available to the public rises, so does the diversity of the records: the genres evolve and blend with others, the differences between them get less well defined and more abstract, with numerous records taking inspiration from several widely varying genres at the same time, or simply mixing them on the record directly. This problem is not addressed in most of the popular datasets, which provide only a single tag per example, greatly simplifying the reality. Thus, a multi-label dataset would be much more beneficial to base the training on, as it is much more fit to handle the multi-style music of today. In this regard, Lukashevich et al. [ 15 ] describe different approaches to multilabeling: for the whole song, by dividing it into separate segments and by dividing into segments while simultaneously dividing into domains, such as Timbre, Rhythm, Melody, and Harmony, with the work being explored and improved further in future papers [ 20 ] . Another vital aspect of representing the real-world music landscape would include the inherent imbalance: despite the aforementioned mixes, some genres like Rock, Pop, or Hip-Hop are still overrepresented both in the mainstream and niche compared to others, and those huge disproportions are reflected in the featured or trending lists. Thus, that aspect should also be taken into consideration and adequately reflected in the data used, as with the greater numbers within a genre also comes greater diversity among the examples. Additionally, taking care of adequately handling such imbalance during training should prove useful when finally taking and applying a resulting model in business, as it would face the same - if not even greater - disparities there. In this aspect many of datasets used for research are also seriously lacking - some have a very narrow spectrum of genres, e.g. only classical music, or sometimes containing examples only from a specific country. That is why this work is based on the self-aggregated dataset, which consists of music from the 1950s up to the year 2024. Additionally, while it covers a very broad spectrum of genres and styles, there are still many disproportions, resembling the real-world representation and current trends. This allows us to avoid the pitfalls of using other data sets in the research. The main object of interest of this research is the impact of using different scales of spectrograms during preprocessing on the classification results. Spectrograms are ”pictorial representations of the spectrum of frequencies of a signal that varies with time” [ 10 ] . Nowadays, they are a basis for most audio processing techniques, utilized not only with Convolutional Neural Networks [ 26 ] [ 7 ] [ 6 ] , but also with transformers [ 11 ] [ 12 ] [ 38 ] , and most recently with state space models [ 14 ] [ 9 ] [ 35 ] [ 29 ] . This work focuses on comparing default spectrograms with ones transformed using the Mel scale, brought forward by Stevens et al. [ 31 ] in 1937. This empirically discovered scale defines the range of human-hearable frequencies. It would be only natural that music, intended in purpose for us humans to hear, would benefit from representing it using the Mel scale. 2 Related works Bahuleyan [ 2 ] presents the usage of CNN models in spectrograms, machine learning models in time domain features, and the combination of both in the task of music genre classification. Here also the VGG16 was used, and for the Machine Learning Algorithms the Linear Regression, Gradient Boosting, Random Forest, and Support Vector Machines. The combination of VGG16 and Gradient Boosting was also used as an ensemble, which proved successful as it achieved the best result of all the other compared methods. In Ali and Siddiqui [ 1 ] the authors used k-NN and SVM techniques on the Mel Frequency Cepstral Coefficients extracted again from the GTZAN

Read the complete text