Single-Step Controllable Music Bandwidth extension with Flow Matching
Carlos Hernandez-Olivan \sthanks Work was conducted during an internship at Universal Music Group, Hendrik Vincent Koops, Hao Hao Tan, Elio Quinton · 2026
Read Single-Step Controllable Music Bandwidth extension with Flow Matching by Carlos Hernandez-Olivan \sthanks Work was conducted during an internship at Universal Music Group, Hendrik Vincent Koops, Hao Hao Tan, Elio Quinton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14356.txt.
Introduction
Carlos Hernandez-Olivan, Hendrik Vincent Koops, Hao Hao Tan, and Elio Quinton work on music repair in this 2026 paper, set for ICASSP 2026. Audio restoration means undoing damage to a digital signal. The goal is to recover the pristine sound from before the damage. The task matters most for archives of old recordings.
Some archived music has high historical value. For those works, a clean version may be lost or may never have existed. The team's task is bandwidth extension, filling in sound detail that old recordings lack. They do it in a single step with flow matching, a generative method. Their method is also controllable, so users can steer the result.
Catalog record
| CREATOR | Carlos Hernandez-Olivan \sthanks Work was conducted during an internship at Universal Music Group, Hendrik Vincent Koops, Hao Hao Tan, Elio Quinton |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-14356
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Single-Step Controllable Music Bandwidth extension with Flow Matching Thanks: Copyright 2026 IEEE. Published in ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), scheduled for 3-8 May 2026 in Barcelona, Spain. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE. Contact: Manager, Copyrights and Permissions / IEEE Service Center / 445 Hoes Lane / P.O. Box 1331 / Piscataway, NJ 08855-1331, USA. Telephone: + Intl. 908-562-3966. Carlos Hernandez-Olivan \sthanks Work was conducted during an internship at Universal Music Group, Hendrik Vincent Koops, Hao Hao Tan, Elio Quinton Abstract Audio restoration consists in inverting degradations of a digital audio signal to recover what would have been the pristine quality signal before the degradation occurred. This is valuable in contexts such as archives of music recordings, particularly those of precious historical value, for which a clean version may have been lost or simply does not exist. Recent work applied generative models to audio restoration, showing promising improvement over previous methods, and opening the door to the ability to perform restoration operations that were not possible before. However, making these models finely controllable remains a challenge. In this paper, we propose an extension of FLowHigh and introduce the Dynamic Spectral Contour ( dsc ) as a control signal for bandwidth extension via classifier-free guidance. Our experiments show competitive model performance, and indicate that dsc is a promising feature to support fine-grained conditioning. † † address: Music and Audio Machine Learning Lab, Universal Music Group Figure 1: Proposed Flow Matching method with audio controls for music restoration. 1 Introduction Degradations in music recording may be introduced in countless ways such as poor recording conditions, legacy recording devices, lossy data compression, or degradation of the storage media like vinyl or magnetic tape. The presence of such degradations can make music recordings unusable, and can be an obstacle to the preservation of assets of particular historical value. Music restoration systems aim to improve audio quality of a degraded or low quality recording by reconstructing the missing audio information and/or removing artifacts. They hold the promise of allowing the salvage of recordings that otherwise could not be. For example, Moliner et al. use generative adversarial networks ( gan s) for historical music bandwidth extension [ 13 ] . Recently, generative models have shown promising results in the broad context of audio restoration. For example, diffusion models trained with clean data were used for piano and vocal restoration [ 12 , 5 ] . However, diffusion models require many sampling steps to produce high-quality samples, impeding efficient and fast inference [ 7 ] . Flow-matching [ 8 , 1 , 9 ] is poised to allow single-step generation, which may yield faster generation. FLowHigh is one such method proposed for speech super-resolution [ 20 ] . As with most generative tasks, controllability of audio restoration models is an important property for their practical use. Although most audio restoration methods cited above do not allow for user control, recent work proposed using text prompts to guide the reconstruction [ 11 ] . To this day, the range of control signals explored in the audio and music generation space is comparatively larger. Recent work in music or foley sound generation introduces time-varying attributes to change audio features such as loudness, pitch and spectral centroid [ 17 , 18 , 4 ] , or leverages multimodal controls [ 2 ] . In this work we focus our attention on the task of generative bandwidth extension, which aims at reconstructing high frequency content that is missing from the original recording. With the view of designing tools for advanced and professional users, our objective is to investigate fine-grained controllability. Our hope is that such tool would empower producers and engineers alike to make the minute adjustments required for each recording, and perhaps even use the restoration creatively. Language, and by proxy text prompts, has proven to be a valuable control signal for generative models, but it is limited by what is possible with a language description. As an alternative that is more directly connected to the task of bandwidth extension and significantly less computationally intensive, we investigate using audio features as a fine-grained control signal. Contributions. Our contributions are the following: (1) We transpose the FLowHigh framework to the music domain, to allow single-step generative restoration. (2) We extend FLowHigh with audio feature conditioning using cfg-zero \star . (3) We introduce a novel audio feature, Dynamic Spectral Contour ( dsc ), specifically designed to guide bandwidth extension. 2 Method 2.1 Model Setup Our approach extends FLowHigh [ 20 ] , a conditional flow matching ( cfm ) model, in two ways: (i) we apply the model, originally proposed for audio speech super-resolution, to the music domain; (ii) we extend the model with classifier-free guidance and audio feature controls to have fine-grained control over the restoration output. FLowHigh offers efficient audio bandwidth extension with a key advantage of single-step inference, leading to comparatively faster inference than diffusion models. FLowHigh utilizes a transformer-based vector field estimator (35.4M parameters: 2 layers, 16-head self-attention, 1024 embedding dim, 4096 dimension for feed-forward networks). Given a mel-spectrogram of the narrow band (i.e. degraded) signal, the model predicts a full band mel-spectrogram from which the audio waveform is reconstructed using a pre-trained and frozen BigVGAN vocoder [ 6 ] . Following the original FLowHigh method, and in order to minimise artefacts, a post-processing step copies the input signal up to a cutoff frequency into the output. As a result, only the frequencies that were not already present in the input are used from the model prediction. In this work, we consider both cfm strategies proposed by FLowHigh : (i) Adaptive CFM, which uses a linear interpolation path from \mathbf{x}_{0} to \mathbf{x}_{1} , coupled with an adaptive noise schedule; (ii) Mixed CFM, which employs a similar path from \mathbf{x}_{0} to \mathbf{x}_{1} for the lower frequencies, and another path from Gaussian noise to \mathbf{x}_{1} for the higher frequencies. We refer the readers to Section III of the original FLowHigh paper and code 1 1 1 https://github.com/jjunak-yun/FLowHigh_code for more details. 2.2 Controllability We modify the baseline FlowHigh model by allowing fine-grained controllable audio restoration based on audio features, such as spectral centroid and rolloff [ 10 ] . We achieve this by leveraging cfg-zero \star [ 3 ] , an improved guidance strategy for flow matching on top of the usual Classifier-Free Guidance ( cfg ), based on the following equation: \hat{\mathbf{v}}(\mathbf{x}_{t},t,\mathbf{c})=(1-w)\cdot s\cdot\mathbf{v}_{\theta}(\mathbf{x}_{t},t,\emptyset)+w\cdot\mathbf{v}_{\theta}(\mathbf{x_{t}},t,\mathbf{c}) . An adaptive scale, s , is introduced to dynamically adjust the magnitude of the unconditional velocity field, ensuring that it aligns more accurately with its conditional counterpart. The optimal scale s^{\star} can be obtained by the following closed-form solution, where s^{\star} is the projection of the conditional velocity onto the unconditional one: s^{\star}=\frac{\langle\mathbf{v}_{\theta}(\mathbf{x}_{t},t,\mathbf{c}),\mathbf{v}_{\theta}(\mathbf{x}_{t},t,\emptyset)\rangle}{|\mathbf{v}_{\theta}(\mathbf{x}_{t},t,\emptyset)|^{2}_{2}} (1) In our implementation, the conditioning vector \mathbf{c}\in\mathbb{R}^{m\times F} consists of m distinct audio features extracted over F frames. These features (e.g. spectral rolloff) provide fine-grained control over the restoration