Not that Groove: Zero-Shot Symbolic Music Editing

Li Zhang · 2025

Read Not that Groove: Zero-Shot Symbolic Music Editing by Li Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08203.txt.

Introduction

Li Zhang teaches language models to edit drum patterns from written instructions, with no training examples, in a 2025 paper. Producers work in symbolic music, note-by-note data like MIDI, because it stays editable. Instruction-driven editing of such data barely exists, starved of paired examples. Zhang sidesteps the shortage by recasting grooves as text.

A drumroll notation lays the groove out as a grid that a language model can reason over spatially. Off-the-shelf models then deduce and apply edits from plain prompts. A benchmark of thousands of grooves with instructions grades the approach. Grading itself is automated through domain-informed unit tests, avoiding costly human judging. The paradigm treats editing as structured reasoning, not generation from scratch.

Catalog record

CREATORLi Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-08203

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Not that Groove: Zero-Shot Symbolic Music Editing Li Zhang Abstract Most work in AI music generation focused on audio, which has seen limited use in the music production industry due to its rigidity. To maximize flexibility while assuming only textual instructions from producers, we are among the first to tackle symbolic music editing. We circumvent the known challenge of lack of labeled data by proving that LLMs with zero-shot prompting can effectively edit drum grooves. The recipe of success is a creatively designed format that interfaces LLMs and music, while we facilitate evaluation by providing an evaluation dataset with annotated unit tests that highly aligns with musicians’ judgment. 1 1 1 github.com/zharry29/drums-with-llm-2 contains resources. You are encouraged to listen to demos (at /demos ) matching the speaker icon throughout the paper. 1 Introduction Music generation has seen much development along transformers and large language models (LLMs). Most existing systems tackled music audio generation Dhariwal et al. 2020 ; Agostinelli et al. 2023 ; Copet et al. 2024 given textual queries. While made publicly popular by commercial products such as Suno 2 2 2 https://suno.com/ , these tools have seen little use for music producers beyond a novelty Tencer 2024 . Apart from concerns of quality, one major reason is the lack of creative control, as generated audio can hardly be edited, fine-tuned, or adapted (analogous to presenting a made meal to a chef). Despite ongoing efforts of music audio editing based on textual instructions Zhang et al. 2024 ; Tsai et al. 2024 ; Hou et al. 2025 ; Lan et al. 2024 , a line of research that may be much more appealing to music producers is symbolic music generation Hadjeres et al. 2017 ; OpenAI 2019 ; Zeng et al. 2021 ; Zhang and Callison-Burch 2023 ; Bhandari et al. 2024 ; Huang et al. 2024 . These system output sheet music or Musical Instrument Digital Interface (MIDI), which can be readily used in performance or production (analogous to presenting ingredients to a chef). Even so, if a producer is dissatisfied with the generated MIDI, it would be ideal for them to be able to verbally describe desired changes to be automatically implemented (e.g., make this sound more jazzy). Unfortunately, efforts on symbolic music editing are missing in literature, likely due to the lack of data that pairs instructions and symbolic music edits, contrary to more ample data for music audio. Figure 1: A pictorial illustration of gpt-4.1’s edit on the Not that Groove dataset. The original groove (left) plays the hi-hat on all 4 beats, the snare drum on beat 2 and 4, and the kick drum on beat 1 and 3. The edited groove (right) changes the constant hi-hat hits to dynamic crash cymbal hits, typically increasing excitement of the music; it halves the frequency of the snare drum and the kick drum, resulting in a half-time feel. Figure 2: A given 1-bar drum groove in represented as a MIDI file or some sheet music in converted into a drumroll notation. Given a user instruction, tn LLM generates an edited drum groove also in the drumroll notation, which can be converted back to MIDI or sheet music in a rule-based manner, which can be rendered as audio using samples or by performing on an actual drum set. To address this challenge, we show it is possible to edit symbolic music by textual instructions via creative zero-shot prompting of LLMs (Figure 1 ). We prove this through a case-study of editing drum grooves which underpin most popular music genres. The recipe for success is finding an appropriate representation that works well with LLM inference, and additionally having LLMs generate symbolic rules that guide their own edits. For evaluation, we introduce the Not that Groove dataset with thousands of drum grooves paired with textual instructions annotated by a professional drummer and music producer. The instructions are diverse in nature, including specific ones, stylistic ones, descriptive ones, etc., and clearly labeled. As music is inherently objective, providing ground-truth labels of edits is a lost cause. Hence, a key innovation of the dataset is having a unit test associated with each example, which can symbolically evaluate if an edited drum groove meets minimal requirements. Out of 8 LLMs we experiment with, the best model gpt-4.1 makes 68% passing edits. We next prove that the unit tests highly corresponds with musician’s judgment with a listening test that shows that 72% are in fact correct and musical edits that a drummer would propose. Overall, we provide system that takes a drum groove and an edit instruction as input, and outputs an edited drum groove in terms of sheet music, MIDI, and audio. 2 Representation We study a particular kind of symbolic music, the composition of a drum set, that is core to modern popular music. To interface LLMs for understanding and generation, we use the transposed drumroll representation following Zhang and Callison-Burch 2023 . An example can be seen in the rightmost of Figure 2 . Each line corresponds to an instrument on a drum set. We consider 6 instruments: kick drum, snare drum, toms, hi-hat, crash cymbal, and ride cymbal. Each instrument can be performed differently, resulting in different articulations (see details in Appendix A ). A line represents a bar of 4/4 time signature containing 4 beats, each containing 4 16th note. Each character thus represents a 16th note, grouped by 4 into beats separated by | . A character is - if the instrument is not played on that note. When played, the character denotes the articulation which varies by instruments (See Appendix C ). Altogether, one such representation constitutes a one-bar groove , which is the basis of many genres of music. A representation like can be converted to a MIDI format, which can be rendered as audio. While MIDI and audio are more expressive, we prefer the drumroll notation based on its minimal nature and analogy to natural language, as each note is akin to an alphabet, each beat is akin to a word, and each bar is akin to a sentence. We assert that this representation works best with LLMs especially without specific training. 3 Experimental Setup 3.1 Formulation We consider the task of editing symbolic music based on a natural language request. Concretely, a model is given g_{o} , an original one-bar groove in a drumroll notation (e.g., the example in Figure 2 ), and an instruction i describing a user request (e.g., “I want it to sound heavier”). The model should output a new groove g_{e}:=\text{LLM}(g_{o},i) . The desiderata of a good g_{e} is one that not only implements the change requested(e.g., by changing the hi-hat hits to cymbal hits and halve the frequency of the kick and snare drum) in a musical way. 3.2 Dataset Evaluating an edited art form such music, visual art, or creative text often require human judgment that introduces great cost and subjectivity. To overcome this, we propose the Not that Groove dataset. We start with a manually labeled subset as the development set that contains 31 tuples of g_{o} and i annotated by a professional drummer. The instructions i span many labeled categories, such as specific (e.g., “I’d

Read the complete text