Summary of The Inaugural Music Source Restoration Challenge

Yongyi Zang 1 Jiarui Hai 2 Wanying Ge 1 Qiuqiang Kong 3 Zheqi Dai 3 Helin Wang 2 Yuki Mitsufuji 4 Mark D. Plumbley 5 · 2026

Read Summary of The Inaugural Music Source Restoration Challenge by Yongyi Zang 1 Jiarui Hai 2 Wanying Ge 1 Qiuqiang Kong 3 Zheqi Dai 3 Helin Wang 2 Yuki Mitsufuji 4 Mark D. Plumbley 5 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04343.txt.

Introduction

Yongyi Zang and seven co-authors cover the first Music Source Restoration Challenge in a 2026 arXiv paper. Restoration is harder than ordinary source separation: the goal is to recover clean, unprocessed instrument stems from professional mixes that also carry real-world damage, undoing both studio effects and degradation. Five teams entered the inaugural contest.

Systems were scored objectively on studio-made mixtures with three automatic metrics, and subjectively on genuinely degraded recordings. The winning system beat the runner-up by wide margins on both objective quality and listener ratings. Breaking results down by instrument shows restoration difficulty varies sharply: bass stems came back fairly well across teams, while percussion resisted almost everyone. The organizers release the dataset, evaluation rules, and baselines so the contest can run again.

Catalog record

CREATORYongyi Zang 1 Jiarui Hai 2 Wanying Ge 1 Qiuqiang Kong 3 Zheqi Dai 3 Helin Wang 2 Yuki Mitsufuji 4 Mark D. Plumbley 5
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE11 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04343

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Summary of The Inaugural Music Source Restoration Challenge Yongyi Zang 1 Jiarui Hai 2 Wanying Ge 1 Qiuqiang Kong 3 Zheqi Dai 3 Helin Wang 2 Yuki Mitsufuji 4 Mark D. Plumbley 5 Abstract Music Source Restoration (MSR) aims to recover original, unprocessed instrument stems from professionally mixed and degraded audio, requiring reversal of both production effects and real-world degradations. We present the inaugural MSR Challenge, featuring objective evaluation using Multi-Mel-SNR, Zimtohrli, and FAD-CLAP on studio-produced mixtures, alongside subjective evaluation on real-world degraded recordings. Five teams participated. The winning system achieved 4.46 dB Multi-Mel-SNR and 3.47 MOS-Overall, representing 91% and 18% relative improvements over the second-place system respectively. Per-stem analysis reveals that restoration difficulty varies substantially by instrument, with bass averaging 4.59 dB across all teams while percussion averages only 0.29 dB. The dataset, evaluation protocols, and baselines are available at https://msrchallenge.com/ . † † address: 1 Independent Researcher 2 Johns Hopkins University 3 The Chinese University of Hong Kong 4 Sony AI 5 King’s College London 1 Introduction Music Source Separation (MSS) has traditionally assumed that mixtures are linear combinations of individual source signals [ 3 , 19 ] . However, real-world recordings violate this assumption. During production, audio engineers apply equalization, dynamic range compression, reverberation, and mastering effects that alter the spectral and temporal characteristics of each instrument. During transmission and storage, recordings undergo further degradation through lossy audio codecs [ 5 , 8 ] and acoustic artifacts such as noise and distortion. Music Source Restoration (MSR) [ 22 ] extends MSS to address these complexities by recovering the original, unprocessed source signals from degraded mixtures. The MSS community has established rigorous evaluation frameworks through competitions such as the Music Demixing Challenge [ 12 ] and the Sound Demixing Challenge [ 18 , 15 ] , using datasets including MUSDB18-HQ [ 14 ] and MoisesDB [ 13 ] . However, these benchmarks cannot evaluate restoration fidelity because their ground-truth stems already contain production effects applied during mixing. The MSR Challenge addresses this gap by providing the first benchmark with truly unprocessed reference stems, enabling evaluation of both separation accuracy and restoration quality. This paper describes the challenge setup in Section 2 , presents results in Section 3 , summarizes participating systems in Section 4 , and discusses key findings in Section 5 . 2 Challenge Setup 2.1 Task and Data The challenge task requires systems to restore eight instrument stems from mixed audio: vocals, guitars, keyboards, bass, synthesizers, drums, percussion, and orchestral elements. Given a degraded mixture as input, systems must output the original, unprocessed version of each stem before any production effects were applied. The validation set, called MSRBench [ 23 ] , contains 2,000 professionally mixed 10-second clips at 48 kHz stereo, with parallel unprocessed and processed stems for each clip. Mixtures are evaluated under 13 conditions: the original mastered audio plus 12 degradation types. These degradations span analog artifacts (radio transmission, cassette tape, vinyl records, live room acoustics), traditional lossy codecs (AAC and MP3 at 64 and 128 kbps) [ 17 ] , and neural audio codecs (DAC [ 8 ] and Encodec [ 5 ] ). The challenge includes two test sets. The non-blind test set contains 1,000 clips with ground-truth stems available, enabling computation of objective metrics. The blind test set contains 500 clips representing real-world degradation scenarios without ground truth: historical cylinder recordings from the early 1900s, live concert recordings, FM radio broadcasts, and low-bitrate streaming audio. This blind set tests generalization to degradations not seen during training. 2.2 Evaluation Metrics For objective evaluation on the non-blind test set, we employ three complementary metrics. Multi-Mel-SNR measures spectro-temporal reconstruction accuracy across multiple time-frequency resolutions, designed to avoid the phase oversensitivity of traditional waveform-domain metrics like SDR [ 19 ] . Zimtohrli [ 1 ] models perceptual similarity using psychoacoustic principles including gammatone filterbank analysis and temporal masking. FAD-CLAP [ 21 ] captures semantic similarity by computing Fréchet distance over CLAP embeddings, measuring whether the restored audio sounds like the correct instrument. For subjective evaluation on the blind test set, professional audio engineers rate each restored sample on three dimensions using 5-point Mean Opinion Scores (MOS). MOS-Separation measures how well the output isolates the target instrument from the mixture. MOS-Restoration assesses how effectively production effects and degradations have been removed. MOS-Overall captures the combined perceptual quality of the restored stem. 3 Results Five teams submitted results: xlancelab, CUPAudioGroup, AC_DC, Hachimi, and cp-jku. Tables 1 and 2 present the overall objective and subjective results, while Table 3 provides per-stem Multi-Mel-SNR scores. Table 1: Objective evaluation results on the non-blind test set. MMSNR: Multi-Mel-SNR in dB ( \uparrow ); Zimtohrli ( \downarrow ); FAD-CLAP ( \downarrow ). Team MMSNR Zimt FAD xlancelab 4.46 0.014 0.199 CUPAudioGroup 2.34 0.016 0.225 AC_DC 1.45 0.018 0.291 Hachimi 2.00 0.018 0.294 cp-jku 0.83 0.019 0.381 Table 2: Subjective evaluation results on the blind test set (MOS on 1–5 scale, \uparrow ). Team Sep Rest Overall xlancelab 4.24 3.39 3.47 CUPAudioGroup 3.84 2.92 2.93 Hachimi 3.58 2.63 2.72 AC_DC 3.54 2.48 2.54 cp-jku 3.55 2.08 2.14 Table 3: Per-stem Multi-Mel-SNR in dB ( \uparrow ). Team Voc Gtr Key Syn Bass Drm Prc Orc xlancelab 1.56 3.95 6.71 2.26 8.22 5.65 1.17 6.17 CUPAudio 1.36 1.95 2.76 0.98 5.29 4.92 0.16 1.32 AC_DC 1.05 1.14 1.82 0.95 2.86 2.73 0.02 1.05 Hachimi 1.05 1.03 3.34 1.24 5.05 2.85 0.00 1.45 cp-jku 0.84 1.29 0.78 0.64 1.55 0.96 0.10 0.51 Average 1.17 1.87 3.08 1.21 4.59 3.42 0.29 2.10 The xlancelab team ranked first across all metrics, achieving 91% relative improvement in Multi-Mel-SNR and 18% in MOS-Overall compared to the second-place CUPAudioGroup. The objective and subjective rankings show strong agreement (Spearman \rho=0.9 ), with only AC_DC and Hachimi swapping positions between the two evaluation paths. The per-stem results in Table 3 reveal that restoration difficulty varies substantially across instrument types. Averaging across all teams, bass achieves the highest scores at 4.59 dB, followed by drums (3.42 dB) and keyboards (3.08 dB). Percussion proves consistently challenging, with an average of only 0.29 dB and four of five teams scoring below 0.2 dB. Notably, vocals average only 1.17 dB despite being a primary focus in traditional MSS research [ 16 , 7 ] . The xlancelab system shows its largest advantages on polyphonic sources, gaining 4.72 dB on orchestral elements and 3.37 dB on keyboards over the second-place team, while the advantage narrows to just 0.20 dB on vocals. 4 Participating Systems All participating teams built upon transformer-based architectures that have proven effective for music source separation. We briefly describe each system below. The xlancelab team employed sequential BSRoformers [ 10 , 20 ] , a band-split transformer architecture, with three pretrained modules applied in sequence: separation, dereverberation, and denoising. Their training used L1 loss combined with multi-resolution STFT loss on MoisesDB [ 13 ] and a manually cleaned version of the RawStems dataset [ 22 ] . CUPAudioGroup built an ensemble combining three complementary architectures: BSRNN [ 11 ] (band-split recurrent neural network), BSRoformer [ 10 ] , and MDX23. All models were initialized from pretrained weights and trained on RawStems, MUSDB18-HQ [ 14 ] , and MoisesDB. The AC_DC team proposed DTT-BSR,

Read the complete text