Anti-aliasing of neural distortion effects via model fine tuning
2025
Read Anti-aliasing of neural distortion effects via model fine tuning (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11375.txt.
Introduction
Alistair Carson, Alec Wright, and Stefan Bilbao present a 2025 paper on cleaning up a flaw in neural models of guitar distortion. Such models copy the crunch of real amps well, until high notes and heavy gain expose aliasing: stray tones that fold back into the sound. The flaw comes from the model's own nonlinear steps stretching the signal past the sampling limit.
Their fix fine tunes a copy of the model, the student, against a cleaned target built from the frozen original, the teacher. Pure tones pass through the original; the non harmonic junk is stripped; the student learns to match the cleaned output. Tests on two network types show the aliasing drops sharply.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11375
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Anti-aliasing of neural distortion effects via model fine tuning Abstract Neural networks have become ubiquitous with guitar distortion effects modelling in recent years. Despite their ability to yield perceptually convincing models, they are susceptible to frequency aliasing when driven by high frequency and high gain inputs. Nonlinear activation functions create both the desired harmonic distortion and unwanted aliasing distortion as the bandwidth of the signal is expanded beyond the Nyquist frequency. Here, we present a method for reducing aliasing in neural models via a teacher-student fine tuning approach, where the teacher is a pre-trained model with its weights frozen, and the student is a copy of this with learnable parameters. The student is fine-tuned against an aliasing-free dataset generated by passing sinusoids through the original model and removing non-harmonic components from the output spectra. Our results show that this method significantly suppresses aliasing for both long-short-term-memory networks (LSTM) and temporal convolutional networks (TCN). In the majority of our case studies, the reduction in aliasing was greater than that achieved by two times oversampling. One side-effect of the proposed method is that harmonic distortion components are also affected. This adverse effect was found to be model-dependent, with the LSTM models giving the best balance between anti-aliasing and preserving the perceived similarity to an analog reference device. 1 Introduction Systems for nonlinear waveshaping, filtering and amplification are essential tools in music production and performance, in particular electric guitar playing. Devices such as vacuum tube amplifiers and transistor-based fuzz pedals have been used since the 1960s to shape the sound of the electric guitar through the introduction of harmonic distortion to the spectrum. In the digital domain, the simplest distortion effects can be implemented with clipping or saturating non-linear functions. Most digital distortion effects, however, seek to model or emulate analog devices [ 1 ] . Methods for virtual analog modelling of distortion effects include circuit-based white-box methods [ 2 , 3 ] , and black-box modelling including neural network approaches [ 4 , 5 , 6 , 7 ] . An inherent problem with non-linear digital audio processing is aliasing distortion, which is often perceived as unpleasant artefacts, beating or noise [ 8 ] . The harmonics generated by deliberate clipping of a signal often exceed the Nyquist frequency, therefore causing aliasing within the audio band. The canonical method for reducing aliasing is oversampling – processing at rates of two or more times the audio rate (see e.g. [ 9 ] ). Alternative methods have also been explored, but are often limited to a certain class or subset of functions, e.g. bandlimited interpolation applied to soft-clipping functions [ 10 ] . Parker et al. [ 11 ] proposed a method based on continuous-time convolution of the distorted signal with an anti-aliasing low-pass filter, known as antiderivative anti-aliasing (ADAA). This method and variants thereof work well for memoryless nonlinear functions [ 11 , 12 , 13 , 14 ] and virtual analog models with one or two states [ 15 , 16 , 17 ] . However, the application of ADAA to larger state-space systems or neural networks is an open research question. In general, anti-aliasing in the context of neural distortion effects constitutes an interesting research problem. Vanhatalo et al. [ 18 ] considered various methods: using (synthetic) oversampled training data; low-pass filter placement between layers; incorporating spectral loss functions into training; and using sparse networks through model pruning. Out of these, forced sparsity was found to be a viable option for a temporal convolutional network (TCN), but was less effective for the long-short-term-memory network (LSTM) example. Furthermore, it came at the cost of reduced model accuracy [ 18 ] . Köper and Holters [ 19 ] proposed an anti-aliased state-trajectory network model, and whilst in some cases a reduction in aliasing was shown, the main limitation was that the model could only be trained on synthetic data, not audio from an analog device. Our previous work [ 20 , 21 ] showed that M times oversampling can be implemented in LSTMs by adjusting the feedback delay length to M samples. With an appropriate design of interpolation and decimation filters [ 22 ] , this can be employed to reduce aliasing, but of course comes at the expense of M times more operations per input sample. Here, we investigate a data-driven approach to reducing the aliasing caused by neural network models of distortion effects without any modifications to the model architecture itself or oversampling. This paper is structured as follows: Sec. 2 outlines the proposed methodology; Sec. 3 describes the models used as case studies; Sec. 4 presents objective results and spectral analysis; Sec. 5 contains a perceptual evaluation; and Sec. 6 provides concluding remarks. Open source code and audio examples are available 1 1 1 https://a-carson.github.io/dafx25_antialiasing_neural/ . 2 Methodology Figure 1: Fine-tuning procedure for anti-aliasing of the Student model. The dashed line indicates the flow of gradients to the Student parameters. Spectral plots are included for illustration only – training operates in the time domain (except for the NMR calculation). Consider an audio processing neural network of the form: y=f(x,\theta) (1) where x is the input signal, y is the output signal and \theta are the model parameters or weights. Our methodology is not model-specific, so we allow f to be any neural network including but not limited to recurrent neural networks (RNNs) and TCNs. Despite the fact that RNNs and TCNs can both yield perceptually convincing models of distortion effects [ 6 , 23 ] , it has been shown that the non-linear activation functions, while responsible for creating the desired harmonic distortion effect, also generate aliasing [ 18 , 24 ] . We assume that f has been pre-trained against some ground truth audio output from an analog device, y_{\rm ref} , but that we no longer necessarily have access to the original device or the training data collected from it. For example, the model may have been obtained as open-weight from elsewhere (e.g. [ 25 ] ). The first step in our method is to duplicate the pre-trained model, with the original version designated as the teacher model and the other the student model . Formally these are defined: \displaystyle y_{\rm teach} \displaystyle=f(x,\theta_{\rm teach}) (2a) \displaystyle y_{\rm stud} \displaystyle=f(x,\theta_{\rm stud}), (2b) where initially \theta_{\rm stud}=\theta_{\rm teach}=\theta . The weights of the teacher model are then frozen and randomised sine tones are passed through the model to produce a synthetic dataset of signals which can be decomposed into harmonics plus noise (including but not limited to aliasing noise). We assume that the “perfect” output signal in virtual analog modelling is purely harmonic, so remove all non-harmonic components from the teacher model output using spectral analysis and Fourier synthesis. These aliasing-free signals are then used as a target during the training of the student model weights. This “fine-tuning" procedure is illustrated in Fig. 1 and details are covered in the remainder of this section. 2.1 Input sine tones The input to both the teacher and student model during training is a batch of pseudo-randomly generated sine tones, defined as: x[n]=A\sin(2\pi f_{0}n/F_{s}+\phi), (3) where F_{s} is the sampling rate (and set to 44.1\text{\,}\mathrm{kHz} unless otherwise specified). The amplitude A and phase