FastWave: Optimized Diffusion Model for Audio Super-Resolution
Nikita Kuznetsov, Maksim Kaledin · 2026
Read FastWave: Optimized Diffusion Model for Audio Super-Resolution by Nikita Kuznetsov, Maksim Kaledin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04122.txt.
Introduction
Kuznetsov and Kaledin propose FastWave, an optimized diffusion model for audio super-resolution. Audio super-resolution estimates a signal as if sampled at a higher rate, and diffusion models are slower while adversarial networks are faster, yet both use costly high-parameter networks. Their approach reconsiders recent diffusion training advances for super-resolution up to 48 kHz. Results beat NU-Wave 2 and match state-of-the-art models. FastWave uses around 50 GFLOPs and just over one million parameters, training faster than most recent diffusion and flow models.
Catalog record
| CREATOR | Nikita Kuznetsov, Maksim Kaledin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20183 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04122
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FastWave: Optimized Diffusion Model for Audio Super-Resolution Nikita Kuznetsov, Maksim Kaledin Abstract Audio Super-Resolution is a set of techniques aimed at high-quality estimation of the given signal as if it would be sampled with higher sample rate. Among suggested methods there are diffusion and flow models (which are considered slower), generative adversarial networks (which are considered faster), however both approaches are currently presented by high-parametric networks, requiring high computational costs both for training and inference. We propose a solution to both these problems by re-considering the recent advances in the training of diffusion models and applying them to super-resolution from any to 48 kHz sample rate. Our approach shows better results than NU-Wave 2 and is comparable to state-of-the-art models. Our model called FastWave has around 50 GFLOPs of computational complexity and 1.3 M parameters and can be trained with less resources and significantly faster than the majority of recently proposed diffusion- and flow-based solutions. The code has been made publicly available 1 1 1 https://github.com/Nikait/FastWave Audio super-resolution problem consists in estimating missing high-frequency components of an audio signal to improve its perceptual quality. Roughly speaking, one would like to resample low-resolution audio (e.g. 8 kHz) recorded in limited setting into a high-resolution one (e.g. 48 kHz). Despite the fact that there are computationally very cheap interpolation approaches, they still cannot deliver sufficient perceptual quality in high-frequency band (above the original signal’s Nyquist frequency) [ 17 ] . Deep Learning (DL) approaches entered the field just in recent years, resulting in well-developed solutions. The majority of suggested approaches focus on the quality of the signal and rarely address the algorithmic complexity of the model, especially this is true for diffusion models still suffering from slow inference. This becomes critical in low-resource setting of consumer devices, where the ability to do edge computing (i.e. on device) is very valuable [ 8 ] . Our main contributions are the following. 1. We develop one of the smallest available diffusion model for audio super-resolution in the literature by optimizing NU-Wave 2 model using new-generation convolution blocks [ 15 ] . Our final model has only 1.3 M parameters, showing 30% decrease in parametric complexity. 2. We optimized the training methodology of NU-Wave 2 via changing the paradigm to denoising and introducing various methodologies from EDM [ 4 ] . This allowed us to reach the same or better results in more constrained setting and less training iterations. 3. Our model is capable of transforming audio from any sample rate to 48 kHz. The results are demonstrated on benchmark super-resolution problem on VCTK dataset and our methods are compared to the modern state-of-the-art solutions. I Related Work DL approaches achieved a significant success in audio super-resolution, showing impressive performance in improving the perceptual quality of the speech and low-resolution media content. Discriminative approaches [ 13 ] typically involve 10 M parameters and several times more to address the problem of super-resolution with varying input [ 9 ] . Switching the paradigm to generative adversarial training (GAN) introduced new possibilities of reaching good performance [ 5 ] and in the same time demonstrated that the computational complexity of the model can be significantly decreased [ 1 ] . GAN approaches addressed not only the quality [ 11 ] , but also the computational complexity and inference speed [ 2 ] . Apart from GANs diffusion models also entered the field just recently with NU-Wave [ 7 ] , having moderate complexity (around 3 M parameters) and close-to-SOTA results. The solution was developed into NU-Wave 2 [ 3 ] with changed architecture, any-to-48 kHz flexible-input regime and two-times smaller model. Despite these findings, large part of diffusion-based [ 10 , 16 ] solutions were focused mainly on achieving better reconstruction error or perceptual evaluation metrics. Flow-based models mainly follow the same path in terms of complexity, but they got a considerable advantage due to its one-step nature [ 17 ] . As was demonstrated in [ 3 ] , sufficient computational resource is required to train the model to its peak results. Since NU-Wave models the question of constructing a smaller (in terms of parameters), faster (in terms of number of function evaluation (NFE) and computational complexity) diffusion-based model and with less training efforts remains open. On the other hand, in the field of image processing there was developed the new methodology for training diffusion-based models, called EDM [ 4 , 6 ] which promised new optimized training methodology aimed at the reduction of training iterations. Our paper addresses all these challenges: low-parametric model, NFE reduction and optimized training time using the EDM methodologies. II Methodology Let X\in\mathbb{R}^{T} be a monaural audio signal. The goal of super-resolution is to reconstruct X from its low-resolution counterpart obtained via p -times downsampling: Y=\mathrm{Down}(X,p)\in\mathbb{R}^{\lceil T/p\rceil}. (1) We estimate the high-resolution signal by learning a parametric mapping given by a diffusion model pipeline f_{\theta} : \hat{X}=f_{\theta}(Y)\approx X. (2) As a foundation, we build upon NU-Wave 2 [ 3 ] , which is among the most parameter-efficient diffusion models for audio super-resolution. We consider three successive model variants: 1. NU-Wave 2 (baseline) — the original model without modifications; 2. NU-Wave 2 + EDM — the baseline architecture trained and sampled using the EDM framework; 3. FastWave — the final model that combines NU-Wave 2 + EDM diffusion modeling [ 4 ] with architectural improvements given by ConvNeXtV2 [ 14 ] . II-A FastWave II-A 1 Overview FastWave has a similar architecture to NU-Wave 2, replacing the original diffusion formulation with a denoising structure with \sigma -parameterization, as in EDM. The architecture of the main STFC and BSFT blocks has also been modified; an illustration can be seen in Figure 1 , and a detailed description is provided in Subsection II-A6 . II-A 2 Diffusion Parameterization Instead of predicting noise \epsilon as in NU-Wave 2, FastWave is trained as a denoiser D_{\theta}(x+n;\sigma)\approx x,\quad n\sim\mathcal{N}(0,\sigma^{2}I), (3) where \sigma directly controls the noise level. The corresponding score function is \nabla_{x}\log p(x;\sigma)=\frac{D_{\theta}(x;\sigma)-x}{\sigma^{2}}. (4) II-A 3 Network Preconditioning Following EDM, we apply explicit input–output preconditioning: \displaystyle x_{\text{in}} \displaystyle=c_{\text{in}}(\sigma)\,x,\quad c_{\text{in}}(\sigma)=\frac{1}{\sqrt{\sigma^{2}+\sigma_{\text{data}}^{2}}}, (5) \displaystyle D_{\theta}(x;\sigma) \displaystyle=c_{\text{skip}}(\sigma)\,x+c_{\text{out}}(\sigma)\,F_{\theta}(x_{\text{in}},\sigma), (6) with c_{\text{skip}}(\sigma)=\frac{\sigma_{\text{data}}^{2}}{\sigma^{2}+\sigma_{\text{data}}^{2}},\quad c_{\text{out}}(\sigma)=\frac{\sigma\,\sigma_{\text{data}}}{\sqrt{\sigma^{2}+\sigma_{\text{data}}^{2}}}. (7) The parameter \sigma_{\text{data}} is estimated directly from the training dataset by computing the empirical standard deviation of the data. II-A 4 Training Objective FastWave is trained using a weighted L2 denoising loss: \mathcal{L}=\mathbb{E}_{x,n,\sigma}\left[\lambda(\sigma)\,\|D_{\theta}(x+n;\sigma)-x\|_{2}^{2}\right], (8) where \lambda(\sigma)=\frac{\sigma^{2}+\sigma_{\text{data}}^{2}}{(\sigma\,\sigma_{\text{data}})^{2}}. (9) The noise level is sampled from a log-normal distribution: \ln\sigma\sim\mathcal{N}(P_{\text{mean}},P_{\text{std}}^{2}). (10) Choice of P_{\text{mean}} and P_{\text{std}} The hyperparameters P_{\text{mean}} and P_{\text{std}} are chosen in a data-driven manner by approximating the mean and variance of \ln\sigma over the entire training dataset. This allows the log-normal noise distribution to concentrate sampling on intermediate noise levels, where the denoising loss is most informative, following [ 4 ] . II-A 5 Sampling During inference, FastWave follows the probability flow ODE formulation and employs a first-order Euler solver, similarly to prior diffusion-based audio models. In contrast to NU-Wave 2, which relies on a fixed log-SNR schedule, we adopt the continuous noise schedule proposed in EDM, where the noise levels are defined as \sigma_{i}=\left(\sigma_{\max}^{1/\rho}+\frac{i}{N-1}\left(\sigma_{\min}^{1/\rho}-\sigma_{\max}^{1/\rho}\right)\right)^{\rho},\quad i=0,\dots,N-1, (11) where \sigma_{\max} and \sigma_{\min} denote the maximum and minimum noise levels, and \rho controls the concentration of steps at low noise