Classical Guitar Duet Separation using GuitarDuets - a Dataset of Real and Synthesized Guitar Recordings
2025
Read Classical Guitar Duet Separation using GuitarDuets - a Dataset of Real and Synthesized Guitar Recordings (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01172.txt.
Introduction
Separating two classical guitars playing together is hard, because both instruments share nearly the same tone. Marios Glytsos and three co-authors take on that puzzle in a 2025 paper. Most music separation tools are built to split unlike instruments, such as voice from drums, so same-tone pairs get little attention.
The team built GuitarDuets, a dataset of about three hours of real and synthesized guitar duets, with note-level labels for the made-up half. They adapted Demucs, a leading separation model, to the same-tone task and tested across datasets. Training on both halves beat training on either half alone when judged on fresh recordings. True note labels helped the separator a lot, while predicted notes helped only a little. The authors also question how standard separation scores behave in this setting.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-01172
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Classical Guitar Duet Separation using GuitarDuets - a Dataset of Real and Synthesized Guitar Recordings Abstract Recent advancements in music source separation (MSS) have focused in the multi-timbral case, with existing architectures tailored for the separation of distinct instruments, overlooking thus the challenge of separating instruments with similar timbral characteristics. Addressing this gap, our work focuses on monotimbral MSS, specifically within the context of classical guitar duets. To this end, we introduce the GuitarDuets dataset, featuring a combined total of approximately three hours of real and synthesized classical guitar duet recordings, as well as note-level annotations of the synthesized duets. We perform an extensive cross-dataset evaluation by adapting Demucs, a state-of-the-art MSS architecture, to monotimbral source separation. Furthermore, we develop a joint permutation-invariant transcription and separation framework, to exploit note event predictions as auxiliary information. Our results indicate that utilizing both the real and synthesized subsets of GuitarDuets leads to improved separation performance in an independently recorded test set compared to utilizing solely one subset. We also find that while the availability of ground-truth note labels greatly helps the performance of the separation network, the predicted note estimates result only in marginal improvement. Finally, we discuss the behavior of commonly utilized metrics, such as SDR and SI-SDR, in the context of monotimbral MSS. 1 Introduction The task of music source separation (MSS) involves dissecting a musical composition into its constituent sources, typically segregating individual instruments or vocal tracks from a composite audio mixture [ 1 , 2 , 3 ] . Due to the multitude of the co-playing sources, as well as its utility in a variety of applications [ 1 ] , MSS stands as a significant challenge in the field of Music Information Retrieval (MIR) [ 4 ] . The majority of research efforts have focused on multi-timbral music source separation [ 5 , 6 , 7 ] . In this case, the goal is the separation of distinct instrumental sources from a mixture, where the sources belong to different instrument families or types such as vocals, bass, drums and others, and as such can be framed as an extension of the task of speech denoising into the music domain [ 8 ] . Through the advancement of digital signal processing [ 9 ] and deep learning [ 5 , 10 ] , considerable progress has been made in extracting distinct instrumental tracks from complex musical compositions. Most recent, deep-learning based approaches for MSS are divided into spectrogram-domain approaches [ 11 ] , waveform-domain methodologies [ 10 , 12 , 13 , 14 , 15 ] and hybrid ones, working simultaneously in both domains [ 5 ] . Spectrogram-domain methods typically isolate sources via mask prediction [ 16 ] , waveform-domain approaches enhance source separation by applying spectrogram techniques in a learned latent space [ 14 , 17 ] , or directly predicting the isolated waveforms [ 12 ] , with the additional advantage of incorporating phase information, while hybrid architectures [ 5 ] leverage the strengths of both. Moreover, recent findings have highlighted the benefits of using static or dynamic activity labels [ 18 , 19 , 20 , 21 , 22 ] , as well as jointly training transcription and source separation modules [ 23 , 24 ] , which enhances task performance, paralleling efforts in simultaneous speech recognition and separation training [ 25 ] . Datasets Real Data Incl. Monotimbral Polyphonic Note Annotations Duration musdb18 [ 7 ] ✓ ✗ ✓ ✗ ca. 10h MoisesDB [ 26 ] ✓ ✗ ✓ ✗ ca. 14.5h URMP [ 27 ] ✓ ✗ ✓ ✓ 1h 6min SLAKH [ 28 ] ✗ ✗ ✓ ✓ ca. 145h EnsembleSet [ 29 ] ✗ ✓ ✗ ✓ 6h 9min GuitarSet [ 30 ] ✓ ✓ ✓ ✓ 3h 3min GuitarDuets ✓ ✓ ✓ Partial 2h 44min Table 1 : Comparison of the GuitarDuets dataset with existing datasets in the literature for music source separation; we note that GuitarSet is strictly monotimbral, since it was entirely recorded using one guitar. GuitarDuets(R) GuitarDuets(S) # Tracks 34 35 Dur./Track (mins) 1.72 \pm 1.35 3.03 \pm 2.86 Total Dur. (mins) 58 106 Notes/sec. - 7 Table 2 : Detailed statistics of the real and synthesized subsets of the GuitarDuets dataset; note statistics are included for the synthetic subset only. However, an area that remains relatively underexplored is monotimbral music source separation. This subfield of MSS focuses on extracting audio components that belong to the same instrument family, or different builds of the same instrument. It can be viewed as the counterpart of the speaker separation problem [ 31 ] in the music domain. While this similarity has led to the development of similar methodologies for network training [ 32 ] , speaker separation, especially within the context of, rarely available in MSS datasets, multi-microphone recordings [ 33 ] , can also rely on spatial cues. The limited exploration in this area can largely be attributed to the historical focus on isolating the most prominent instruments in popular music, while the demand for separation of instruments with close timbral characteristics is less pronounced. Indeed, there are very few datasets suitable for training algorithms on the task of separating instrumental tracks from the same instrument family in a polyphonic context [ 30 ] , with the majority of publicly avalaible datasets covering the case of separating mixtures of multiple singing voices [ 34 , 35 , 36 ] . In this paper, we attempt to bridge this gap by introducing GuitarDuets 1 1 1 The dataset is available at: https://zenodo.org/records/12802440 , a dataset consisting of a total of ca. 3 hours of real and synthesized guitar duet recordings, along with partial note-level annotations, which can be leveraged as auxiliary score information. We benchmark GuitarDuets in the tasks of i) unconditional guitar duet separation and ii) score-informed duet separation, using the hybrid Demucs [ 5 ] as our separation model. We also examine the possibility of integrating note-level predictions into a joint transcription and separation framework. In more detail, the main contributions of this work are: • Introduction of GuitarDuets, a dataset for monotimbral music source separation, featuring both real classical guitar duet recordings and synthetic recordings generated from online transcriptions and virtual instruments. The synthetic portion includes MIDI representations for each guitar part, enriching the dataset for algorithm training and detailed analysis. • Extensive cross-dataset evaluation across various conditions, including real and generated synthetic data, as well as the existence or absence of auxiliary score information in specific Demucs branches. • Development of a joint transcription and separation framework, which incorporates transcription predictions, by adapting existing architectures [ 5 , 37 ] to the task of monotimbral source separation with the introduction of a permutation-invariant [ 32 ] loss. We show that incorporation of these note-level predictions can improve the separation of real guitar duets. • Finally, we analyze the behavior of commonly-utilized source separation metrics in the context of classical guitar duets to understand their effectiveness when applied in sources with similar timbres. 2 Datasets 2.1 Existing Datasets Datasets available for music source separation or transcription are primarily divided into multitimbral and monotimbral ones, each offering instrument-specific tracks or stems, often accompanied by transcriptions. Multitimbral