Musical Source Separation of Brazilian Percussion
2025
Read Musical Source Separation of Brazilian Percussion (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04995.txt.
Introduction
Richa Namballa, Giovana Morais, and Magdalena Fuentes teach a model to unmix Brazilian percussion recordings in this 2025 demo paper. Software that separates instruments from a mixed recording has leapt ahead for Western music, but non-Western instruments lack the data such systems usually train on.
The team built artificial mixtures from an existing dataset of Brazilian samba percussion. They trained a U-Net model to pull out the surdo, a large drum with a deep tone and repeating patterns at the heart of samba. Despite little training data, the model isolated the drum well. The authors argue that separation systems can serve more musical cultures without huge new data collection efforts.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 8 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04995
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Musical Source Separation of Brazilian Percussion Abstract Musical source separation (MSS) has recently seen a big breakthrough in separating instruments from a mixture in the context of Western music, but research on non-Western instruments is still limited due to a lack of data. In this demo, we use an existing dataset of Brazilian samba percussion to create artificial mixtures for training a U-Net model to separate the surdo drum, a traditional instrument in samba. Despite limited training data, the model effectively isolates the surdo, given the drum’s repetitive patterns and its characteristic low-pitched timbre. These results suggest that MSS systems can be successfully harnessed to work in more culturally-inclusive scenarios without the need of collecting extensive amounts of data. 1 Introduction Musical source separation (MSS) is a central task of music information retrieval (MIR) which aims to “de-mix” audio into its corresponding instrument stems. It has applications in both the research and production of music by allowing the analysis and reuse of the stems. Most source separation systems are trained to process Western instruments only, precluding their application to more culturally-diverse music and limiting global engagement with the tools [ 1 ] . The primary reason for the restricted usability of MSS models is the lack of diverse training data. The most commonly utilized dataset, MUSDB18, contains only four instrument categories, all of which are Western [ 2 ] . Even those datasets which advertise a larger number of stem types are mostly focused on expanding the variety of Eurocentric instruments [ 3 , 4 ] . Creating new MSS datasets is challenging due to the time and monetary cost required to record and mix high-quality stems, thus the lack of diversity in instrumentation is expected. Prior to investing significant resources into constructing new datasets, we investigate the feasibility of building an MSS system by artificially creating mixtures featuring an existing non-Western dataset typically used in the context of beat tracking, the Brazilian Rhythmic Instruments Dataset (BRID) [ 5 , 6 ] . Historically, there has been limited literature concerning the MSS task in the domain of non-Western music. Recent progress has been made in [ 7 ] , where the authors separated Carnatic vocals using training data which contained bleed in the stems by leveraging cold diffusion models. Since the audio from the BRID is very clean, we opted to utilize a simpler approach by using the standard U-Net architecture employed by both [ 8 ] and [ 9 ] to separate the surdo , a type of drum, from a mixture of other Brazilian percussion instruments. 2 Data BRID includes two types of tracks. The first set consists of rhythmic instruments recorded as solos, with the musicians performing in various Brazilian styles using a click track. The second one contains group performances, with the musicians playing a musical style together without referencing a metronome. For this demo, we elected to set the surdo as our target source to separate from the mixture. The surdo is a large tom-like drum which plays a distinctive pattern repeated throughout the piece. This trait, plus its distinctive low-pitched timbre, makes it an easier target compared to the other percussion instruments and is thus considered a suitable starting point for this work. 2.1 Mixture Generation Figure 1 : Overview of the training pipeline for the surdo separation model. Solo tracks are randomly selected from BRID and combined with a surdo stem to generate mixtures for training. Since the group performances do not include stems, we chose to generate our own mixtures by combining the solo tracks. In total, BRID has 274 solo tracks across 10 different instruments and 5 different rhythmic styles. Of these recordings, 26 of them are surdo solos. First, we randomly allocated the surdo stems to have 22 for training, 1 for validation, and 3 for testing. Next, we split the remaining instruments into the subsets (85/5/10%). We ensured that each instrument-style combination (e.g., tamborim-samba ) was represented in every split. To generate a mixture within a subset, we first randomly selected a musical style. Then, we chose a surdo stem and mixed a random number of stems with it. Solos within a musical style had the same tempo and were recorded with a metronome. Therefore, the selected stems could be mixed as-is using addition, without time-alignment. The mixtures did not have any transformations applied to them (e.g., pitch-shifting or time-stretching) and there was no repetition of an instrument type within a single mixture. In total, we generated 100 mixtures for training, 10 for validation, and 30 for testing with Scaper [ 10 ] . We did not allow duplicate mixtures; each mixture has a unique combination of solo recordings. However, due to data limitations, there were instances of mixtures that differed only with the addition of a single stem. 3 Methodology For this system, we used the standard 2D convolutional U-Net encoder-decoder architecture by [ 11 ] , adapted for operating on the frequency domain. We mimic the exact single-task implementations used in [ 8 ] and [ 9 ] including the network architecture, hyperparameters, and spectrogram processing. We trained the surdo-separation model on the training and validation mixtures for 1000 epochs using single-GPU acceleration on an Nvidia RTX8000. The model applies a soft mask to the input mixture’s spectrogram to estimate the spectrogram of the target source. The separated audio is then reconstructed using the phase component of the original mixture and the inverse Short-Time Fourier Transform (STFT). Finally, to evaluate the performance of the model, we compute the Source-to-Distortion Ratio (SDR) [ 12 ] for each of the test set’s full mixtures, and listen to the separated audio. An overview of the pipeline is shown in Figure 1 . 4 Results The SDR results for each data split are available in Table 1 . The impressive SDR values indicate that the model is able to separate the surdo stem clearly. We noticed that the SDR is slightly worse on the validation set, which could be due to its small size. In future work, we plan to repeatedly sample these train / validation / test splits to account for possible biases due to the small data size. Qualitatively, when we listen to the separated stem generated by the model, the surdo is coherent with minimal distortion. The only artifacts which occur in the stem are bleed from the other instruments in the mixture. To verify that our model is not over-fitting to the BRID solo tracks, we apply our model to the BRID group performances and even a video of a percussion ensemble from YouTube 1 1 1 https://youtu.be/mmlK94QvwiA . Perceptually, our model generalizes well to these mixtures. A demo of example results is available online 2 2 2 https://richa-namballa.github.io/mss-demo/ . We attribute the high SDR values and clean separation to the homogeneity of BRID and, in general, the surdo pattern rhythmic pattern. The percussion mixtures contain similar instrumentation and utilize repetitive patterns, characteristics typical of Brazilian samba. Furthermore, the surdo has a distinct timbre and frequency range which likely make it easier to isolate from the mix. Although preliminary, the fact that a simple MSS model performs a decent separation in this context is promising, as it