DOSE: Drum One-Shot Extraction from Music Mixture

Suntae Hwang 1 Seonghyeon Kang 1 Kyungsu Kim 1 Semin Ahn 2 Kyogu Lee 1,3 · 2025

Read DOSE: Drum One-Shot Extraction from Music Mixture by Suntae Hwang 1 Seonghyeon Kang 1 Kyungsu Kim 1 Semin Ahn 2 Kyogu Lee 1,3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18157.txt.

Introduction

Suntae Hwang, Seonghyeon Kang, Kyungsu Kim, Semin Ahn, and Kyogu Lee extract drum one shots in two thousand twenty-five. Drum one shot samples anchor sound design and electronic music. Pulling clean ones out of full mixes is the new task here. They name it Drum One-Shot Extraction.

A dataset, RMOD, pairs random mixes with their source one shots. The DOSE model uses neural codec language models end to end. It skips the classic source separation stage entirely. A new onset loss sharpens the first transient of each hit. Scores beat a separation based baseline on quality gauges.

Catalog record

CREATORSuntae Hwang 1 Seonghyeon Kang 1 Kyungsu Kim 1 Semin Ahn 2 Kyogu Lee 1,3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-18157

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DOSE: Drum One-Shot Extraction from Music Mixture Thanks: This work was partly supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) [No. RS-2023-00219429, 50%], Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government(MSIT) [No. RS-2022-II220320, 2022-0-00320, Artificial intelligence research about cross-modal dialogue modeling for one-on-one multi-modal interactions, 40%], [No. RS-2021-II212068, Artificial Intelligence Innovation Hub (Artificial Intelligence Institute, Seoul National University), 5%], and [NO.RS-2021-II211343, Artificial Intelligence Graduate School Program (Seoul National University), 5%] Suntae Hwang 1 Seonghyeon Kang 1 Kyungsu Kim 1 Semin Ahn 2 Kyogu Lee 1,3 Abstract Drum one-shot samples are crucial for music production, particularly in sound design and electronic music. This paper introduces Drum One-Shot Extraction, a task in which the goal is to extract drum one-shots that are present in the music mixture. To facilitate this, we propose the Random Mixture One-shot Dataset (RMOD), comprising large-scale, randomly arranged music mixtures paired with corresponding drum one-shot samples. Our proposed model, Drum One-Shot Extractor (DOSE), leverages neural audio codec language models for end-to-end extraction, bypassing traditional source separation steps. Additionally, we introduce a novel onset loss, designed to encourage accurate prediction of the initial transient of drum one-shots, which is essential for capturing timbral characteristics. We compare this approach against a source separation-based extraction method as a baseline. The results, evaluated using Fréchet Audio Distance (FAD) and Multi-Scale Spectral loss (MSS), demonstrate that DOSE, enhanced with onset loss, outperforms the baseline, providing more accurate and higher-quality drum one-shots from music mixtures. The code, model checkpoint, and audio examples are available at https://github.com/HSUNEH/DOSE I Introduction Drum sounds are fundamental components of contemporary music production, playing a crucial role across various genres such as electronic music, hip-hop, and pop. In these genres, music producers often construct rhythmic patterns by sequencing individual drum one-shot samples, allowing for precise control over the timbral and temporal characteristics of the rhythm. Given the significance of drum sounds in music production, there has been substantial research interest in synthesizing drum one-shot samples using advanced technologies, including recent developments in deep learning [ 1 , 2 , 3 , 4 , 5 ] . These novel approaches utilize conditional inputs such as drum type or acoustic features, aiming to facilitate intuitive sample creation for music producers without requiring extensive knowledge of signal processing techniques. In many practical scenarios, music producers work with existing recordings to create remixes, cover versions, or other productions, necessitating the extraction of high-quality drum samples directly from music mixtures. We define this task as Drum One-Shot Extraction . A conventional approach to this task involves applying music source separation techniques to isolate the drum track, followed by the identification and extraction of segments containing isolated one-shot samples. We refer to this type of method as the “separation-based approach”. However, this approach cannot guarantee the identification of isolated one-shot segments and is dependent on separation algorithms, potentially introducing artifacts and compromising sample quality. Fig. 1: Illustration of our approach. Given an audio mixture as input, each Drum One-Shot Extractor(DOSE) model extract one-shot audio samples for kick, snare, and hi-hat drums. To address these limitations, we propose a novel generation-based one-shot extraction approach that circumvents the intermediate separation step and directly generates drum one-shot samples from the input music mixture. Our method, DOSE , leverages recent advancements in neural audio codec language modeling to perform end-to-end generation of drum one-shots. DOSE employs separate decoder-only Transformers for each drum type (kick, snare, and hi-hat) to achieve better extraction performance compared to using a single model for all drum types. The architecture of DOSE closely follows that of MusicGen [ 6 ] , utilizing the same core components of neural audio codec and decoder-only transformer. The DAC [ 7 ] encoder encodes both the music mixture and the one-shot audio into discrete acoustic tokens. The transformer is then trained to autoregressively generate the acoustic tokens of the one-shot samples conditioned on the acoustic tokens of the music mixture. The generated tokens are decoded into waveform audio via the DAC decoder. For training and evaluation of DOSE, we introduce the Random Mixture One-shot Dataset (RMOD), a novel paired dataset comprising synthetically generated music mixtures and their corresponding drum one-shot samples. RMOD consists of 360,000 pairs of mixture audio and corresponding drum one-shot samples, created by randomly mixing drum tracks, which are synthesized using one-shot samples, with instrument tracks. We conducted a comprehensive quantitative evaluation of DOSE and baseline methods on the one-shot drum sample extraction task. In addition to RMOD, we utilized the Groove MIDI Dataset [ 8 ] in our evaluation, which offers more realistic drum performances.Our experimental results demonstrate that DOSE outperforms the baseline method, which is a separation-based approach implemented using LarsNet[citation], across various objective metrics, including Fréchet Audio Distance (FAD) [ 9 ] and Multi-Scale Spectral Similarity (MSS)) [ 10 ] . II Related Work Drum One-Shot Generation. Generating drum one-shot samples has received considerable attention with the development of neural audio synthesis methods. Early approaches leveraged models such as Variational Autoencoders (VAE) [ 11 ] and Generative Adversarial Networks (GAN) [ 12 ] , which introduced latent-space exploration and controllable synthesis for drum sounds. Subsequent works like NeuroDrum [ 2 ] , DrumGAN [ 4 ] , and StyleWaveGAN [ 5 ] further improved controllability and timbral diversity by conditioning on various audio features (e.g., brightness, boominess, depth). Score-based diffusion models [ 13 ] have recently emerged as a powerful paradigm for audio synthesis, offering flexible sampling strategies. CRASH [ 14 ] , for instance, leverages stochastic differential equations (SDEs) to generate high-resolution percussive sounds (44.1 kHz) in a controllable manner, matching the fidelity of GAN-based methods while enabling techniques such as class mixing to create “hybrid” sounds. These advancements illustrate the growing breadth of approaches for drum/percussive sound generation, providing more interactive and fine-grained creative possibilities for music producers. Drum Source Separation. In traditional music source separation, the goal is to split a mixture into individual instrument stems, including drums, bass, vocals, and others [ 15 , 16 , 17 , 18 ] . More specific to drum-oriented tasks, Mezza et al. [ 19 ] introduced a new challenge called Drum Source Separation, aiming to decompose a drum track into separate stems (kick, snare, hi-hat, etc). Their proposed method, LarsNet, accomplishes drum-component separation, allowing for individual extraction of each drum type. Neural Audio Codec Language Modeling. Neural audio codecs such as SoundStream [ 20 ] , EnCodec [ 21 ] , and DAC [ 7 ] have received notable attention for their ability to compress audio into discrete tokens with minimal perceptual loss. When combined with transformer models, these tokenizers can be leveraged for autoregressive audio generation tasks. MusicGen [ 6 ] and MusicLM [ 22 ] are prime examples, demonstrating high-quality music generation via codec-based language models. III Method We propose DOSE, a deep learning model designed to extract drum one-shot sounds (kick, snare, and hi-hat) from complex audio mixtures. Inspired by MusicGen [ 6 ] , DOSE employs a decoder-only transformer to process discrete audio representations. To emphasize accurate transient predictions, we introduce a novel onset loss during training. Fig. 2: Proposed Method. The input

Read the complete text