SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering
Jan Melechovsky, Ambuj Mehrish, Dorien Herremans · 2025
Read SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering by Jan Melechovsky, Ambuj Mehrish, Dorien Herremans (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03448.txt.
Introduction
Jan Melechovsky and co-authors published a 2025 paper on a single AI model that restores and masters music recordings. Home recordings suffer a familiar list of flaws: echo, distortion, clipping, dull tone, cramped stereo. Fixing them usually takes separate tools and skilled hands. SonicMaster accepts plain-language instructions, such as a request to reduce echo, and applies the fix; or it can clean a track on its own judgment.
To teach it, the team built a large library of paired tracks: clean recordings and versions degraded by simulated damage. The model learns the mapping from damaged to polished across many flaw types at once. Text control lets a producer ask for targeted changes rather than a blanket polish. The authors call it the first unified generative model for this job. For amateur musicians, it promises studio-style rescue without the studio; for researchers, a testbed for controllable audio generation.
Catalog record
| CREATOR | Jan Melechovsky, Ambuj Mehrish, Dorien Herremans |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering Jan Melechovsky, Ambuj Mehrish, Dorien Herremans Abstract Music recordings often suffer from audio quality issues such as excessive reverberation, distortion, clipping, tonal imbalances, and a narrowed stereo image, especially when created in non-professional settings without specialized equipment or expertise. These problems are typically corrected using separate specialized tools and manual adjustments. In this paper, we introduce SonicMaster , the first unified generative model for music restoration and mastering that addresses a broad spectrum of audio artifacts with text-based control. SonicMaster is conditioned on natural language instructions to apply targeted enhancements, or can operate in an automatic mode for general restoration. To train this model, we construct the SonicMaster dataset, a large dataset of paired degraded and high-quality tracks by simulating common degradation types with nineteen degradation functions belonging to five enhancements groups: equalization, dynamics, reverb, amplitude, and stereo. Our approach leverages a flow-matching generative training paradigm to learn an audio transformation that maps degraded inputs to their cleaned, mastered versions guided by text prompts. Objective audio quality metrics demonstrate that SonicMaster significantly improves sound quality across all artifact categories. Furthermore, subjective listening tests confirm that listeners prefer SonicMaster ’s enhanced outputs over the original degraded audio, highlighting the effectiveness of our unified approach. Samples, code, model, dataset, and demo are all available through https://amaai-lab.github.io/SonicMaster/ Introduction Music tracks produced in amateur settings often suffer from a variety of audio quality issues that distinguish them from professionally mastered recordings ( Wilson and Fazenda 2016 ; Mourgela et al. 2024 ; Deruty and Tardieu 2014 ) . For instance, an enthusiast recording vocals in a garage may introduce excessive reverberation, making the voice sound distant and “echoey.” Similarly, using inexpensive microphones or misconfigured interfaces can lead to distortion and clipping when loud peaks exceed the recording range, resulting in harsh crackles or flattened dynamics ( Zang et al. 2025 ) . Tonal imbalances are also common: a home recording might sound overly “muddy” or “tinny” if certain frequency bands dominate or vanish due to poor room acoustics or improper microphone placement. Even the stereo image can be narrowed or skewed, reducing the sense of space in the mix. In practice, engineers address these problems with separate specialized tools: e.g., dereverberation plugins to remove room echo, declipping algorithms to reconstruct saturated peaks, equalizers to rebalance frequencies, and stereo enhancers to widen the image. Mastering a flawed track thus becomes a labor-intensive process requiring expert skill and multiple stages of manual adjustment. The need for an automated all-in-one solution is evident. Creators with limited resources often lack the expertise to apply the right combination of restoration tools, and a piecemeal approach may fail to fully recover a track’s fidelity. This motivates SonicMaster , a unified approach to music restoration and mastering that can correct a broad spectrum of audio degradations within a single model. Figure 1: SonicMaster pipeline: a flow-matching model trained on the SonicMaster dataset (19 simulated enhancements across EQ, dynamics, reverb, amplitude, stereo) takes an input music waveform and text prompts to produce a high-fidelity enhanced output. Figure 2: SonicMaster dataset creation pipeline and overview. We introduce a single flow-based generative framework that simultaneously performs dereverberation, equalization, declipping, dynamic-range expansion, and stereo enhancement. The backbone is trained on a curated corpus of polyphonic music rendered through a combinatorial grid of simulated degradations, enabling the network to learn the joint statistics and cross-couplings of common artifacts rather than treating them in isolation. This joint training eliminates the need for error-prone cascades of task-specific modules and reduces inference to a single forward pass. SonicMaster is conditioned on free-form text prompts that encode high-level production intent. A prompt such as reduce the hollow room sound attenuates late reflections without suppressing desirable early reverberation, whereas increase the brightness selectively enhances the treble frequencies while while preserving spectral balance elsewhere.When the prompt is omitted, an automatic mode leverages learned perceptual heuristics to produce a balanced master suited to non-expert users. Existing models (e.g. VoiceFixer ( Liu et al. 2021 ) ) fail on music-focused pipelines typically address artifacts sequentially, ignoring their mutual influence. By unifying restoration and mastering tasks under a single, prompt-driven generative model, SonicMaster delivers professional-grade improvements while affording fine-grained creative control. In the absence of text-conditioned music-restoration data, we build a new large-scale corpus for controllable restoration. From \approx 580 k Jamendo recordings we retain \approx 25 k high-quality 30-s segments, balanced across 10 genre groups by production quality score. Each clean clip is corrupted with one to three of 19 common effects drawn from five categories—EQ, dynamics, reverb, amplitude, and stereo—producing paired degraded versions. Every degraded sample is accompanied by a natural-language prompt describing the artifact or required fix, and all random effect parameters are stored as metadata. This genre-diverse collection of tens of thousands of prompt–audio pairs underpins SonicMaster training and offers a rigorous benchmark for controllable music-restoration research. Our main contributions are as follows: • We present SonicMaster , a flow-matching model that corrects 19 common degradations—including reverb, EQ imbalance, clipping, dynamic-range errors, and stereo artifacts in a single generative pass, while allowing free-form textual prompts for fine-grained creative control. • To train and evaluate such a system, we curate and release the first text-conditioned music-restoration corpus: 25k high-fidelity Jamendo segments spanning 10 genres, each paired with 7 degraded versions of itself, detailed parameter metadata, and a natural-language instruction describing the required fix, resulting in 175 k audio pairs. Related Work Restoring and mastering audio spans speech + music enhancement, audio inpainting, and source separation—areas that have mostly been handled separately ( Záviška et al. 2020 ) . Diffusion-based generative models and text-guided audio editing ( Hou et al. 2025 ; Jiang et al. 2025 ) now let us tackle these problems together. We review these advances, their uses, and the gaps that SonicMaster aims to fill. Audio Inpainting and Declipping: Early signal-model and interpolation methods could patch only very short gaps ( <10 ms), leaving longer dropouts unresolved. Deep generative models now bridge that gap: diffusion-based systems convincingly regenerate missing music sections and clipped peaks ( Moliner and Välimäki 2023 ) . The authors in ( Wang et al. 2023 ; Liu et al. 2023 ) extend this with instruction-guided diffusion for audio inpainting, while VoiceFixer ( Liu et al. 2021 ) jointly denoises, dereverbs, and declipse speech, though it is restricted to voice and does not offer user control. In music, ( Imort et al. 2022 ) removed heavy guitar distortion (including clipping) with neural networks, surpassing sparse-optimization baselines in quality and speed. Equalization and Tonal Restoration: Research on learning-based equalization is still emerging. In recently proposed work ( Mockenhaupt, Rieber, and Nercessian 2024 ) , the authors introduce CNN based approach to automatically equalize instrument stems by predicting parametric EQ settings, showing improvements over earlier heuristic methods. Notably, the VoiceFixer ( Liu et al. 2021 ) addressed bandwidth extension essentially restoring high-frequency content as part of its speech restoration, which can be seen as a form of equalization correction. Similarly, diffusion-based restorers like MaskSR ( Li, Wang, and Liu 2024 ) treat low-frequency muffling as a distortion to fix, using discrete token prediction to restore a balanced spectrum. In Text2FX (