Beat-Based Rhythm Quantization of MIDI Performances
Maximilian Wachter, Sebastian Murgul, Michael Heizmann · 2025
Read Beat-Based Rhythm Quantization of MIDI Performances by Maximilian Wachter, Sebastian Murgul, Michael Heizmann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19262.txt.
Introduction
Maximilian Wachter, Sebastian Murgul, and Michael Heizmann wrote a paper in two thousand twenty-five on turning played music into clean notation. A live performance recorded as MIDI data has notes that drift off the beat. Quantization snaps those notes onto the metric grid so humans can read the score.
Their model is a transformer that hears the beat and downbeat as it works. A preprocessing step converts both scores and performances into one token language. They tuned the model design and trained it on piano and guitar performances. On a standard metric for the task, their model passed the previous state of the art.
Catalog record
| CREATOR | Maximilian Wachter, Sebastian Murgul, Michael Heizmann |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 5 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-19262
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beat-Based Rhythm Quantization of MIDI Performances
Maximilian Wachter, Sebastian Murgul, Michael Heizmann
Abstract
\correspondence
Maximilian [email protected]
\lastnames
Wachter, Murgul, Heizmann
Audio algorithms and results
{onecolabstract}
We propose a transformer-based rhythm quantization model that incorporates beat and downbeat information to quantize MIDI performances into metrically-aligned, human-readable scores. We propose a beat-based pre-processing method that transfers score and performance data into a unified token representation. We optimize our model architecture and data representation and train on piano and guitar performances. Our model exceeds state-of-the-art performance based on the MUSTER metric.
1
Introduction
This paper introduces a novel transformer-based approach for beat-based rhythm quantization of symbolic MIDI performances. Rhythm quantization aims to recover the intended notated rhythm from expressive performances, a fundamental task in music information retrieval and automatic music trancription. Our method uniquely integrates beat information and performance timing into a unified tokenized input representation, enabling the model to learn rhythmic structure by modeling timing deviations relative to an underlying metrical grid. Unlike most quantization models, our model is capable of leveraging metronome information, which entails the possibility of completely eliminating the uncertainty of beat estimations.
2
Methods
To support diverse musical contexts, we designed a flexible preprocessing pipeline that uses beat estimations or ground truth beats as a priori information and adapts to multiple time signatures without requiring explicit time signature tokens. This enables the model to generalize and successfully quantize rhythms in time signatures unseen during training. We propose a confusion-based evaluation metric tailored to beat-aligned quantization, incorporating both onset accuracy and note value correctness, which is better suited to evaluating timing on a score-level than frame-based metrics.
We used the T5 transformer for our model architecture, which we subsequently optimized in terms of efficiency and quality. For training our model we used the ASAP dataset
[
1
]
, a piano dataset containing performance MIDI files with accompanying scores as well as beat and downbeat annotations. We trained our model on
N
measure sequences, assuming a one-to-one correspondence. Due to the sometimes poor alignment between scores and performances we filtered the dataset based on how well input and target sequences matched. We subsequently optimized the model based on input sequence length, note ordering, and data augmentation techniques such as pitch transposition, note deletion, and duration noise in order to maximize musical note onset accuracy.
3
Experiments
Our optimized checkpoint achieves an onset F1 score of 97.3% on the ASAP dataset and a note value accuracy of 83.3%.
Extending beyond piano, we adapted the model to guitar performances using the Leduc dataset, demonstrating that instrument-specific training yields improved quantization results. This highlights the importance of capturing instrument-dependent rhythmic interpretation characteristics for precise quantization.
Finally, we benchmarked our approach against state-of-the-art methods using the test and training splits defined in the ACPAS dataset for computing the MUSTER metric
[
2
]
. In Table
1
we compared the onset and offset error rates
\epsilon_{\textit{onset}}
and
\epsilon_{\textit{offset}}
to other state-of-the-art probabilistic and deep learning-based approaches. We showed that our model is able to surpass state-of-the-art models in
\epsilon_{\textit{onset}}
by using beat annotations, while getting surpassed in
\epsilon_{\textit{offset}}
only by
[
3
]
.
Table 1:
Comparison of onset-time (
\epsilon_{\textit{onset}}
) and offset-time (
\epsilon_{\textit{offset}}
) error rates using the MUSTER metric.
Method
\epsilon_{\textit{onset}}
\epsilon_{\textit{offset}}
Neural Beat Tracking
[
4
]
68.28
54.11
End-to-End PM2S
[
3
]
15.55
23.84
HMMs (J-Pop)
[
5
]
25.02
29.21
HMMs (classical)
[
5
]
22.58
29.84
Our Model
12.30
28.30
4
Discussion
Our results confirm that explicit beat information can yield significant improvements in onset quantization performance. However, offset accuracy remains challenging due to our model’s current inability to detect 32nd notes. Compared to similar models, ours excels in scenarios where explicit beat information is available like in cases where performances are recorded to a metronome. If metronome information is not available the performance is however highly dependent on beat estimation quality.
5
Summary