Slimmable NAM: Neural Amp Models with adjustable runtime computational cost
Steven Atkinson · 2025
Read Slimmable NAM: Neural Amp Models with adjustable runtime computational cost by Steven Atkinson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07470.txt.
Introduction
Steven Atkinson shrinks neural models of guitar amplifiers without retraining them. Neural Amp Models copy the sound of real amps, but accurate versions can demand more computing power than live players have. Atkinson makes model size adjustable at run time.
A musician can dial cost up or down and trade a little accuracy for smoother real-time play. The switching overhead is tiny, so changes can happen during use. Performance is measured against common baselines, and a working audio plug-in demonstrates the idea live. The design suits laptops, pedals, and other modest hardware where fixed heavy models fail.
Catalog record
| CREATOR | Steven Atkinson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 6 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07470
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Slimmable NAM: Neural Amp Models with adjustable runtime computational cost
Steven Atkinson
Abstract
This work demonstrates “slimmable Neural Amp Models”, whose size and computational cost can be changed without additional training and with negligible computational overhead, enabling musicians to easily trade off between the accuracy and compute of the models they are using. The method’s performance is quantified against commonly-used baselines, and a real-time demonstration of the model in an audio effect plug-in is developed.
\workshoptitle
AI for Music
1
Introduction
In recent years, Neural Amp Modeler (NAM)
1
1
1
https://neuralampmodeler.com
has seen widespread adoption for data-driven virtual analog modeling of musical equipment.
With this adoption, it has become the norm that musicians do not train the models they use.
Therefore, they are often unable to tailor the modeling process to suit the computational limitations of their use case.
For users who find that models are too CPU-intensive to be used in practical settings, model distillation
7
is a common workaround.
However, without access to typical ML compute (e.g. a GPU), this is cumbersome and/or time-consuming, and it disrupts creative workflows.
By contrast, finite impulse responses (IRs)—a ubiquitous data-driven model for musicians—can be easily made more computationally-lightweight by truncation to an arbitrary length, allowing musicians to trade off accuracy for compute on the fly.
One might reasonably desire a similar option in the realm of neural modeling.
This work demonstrates introduces “slimmable NAMs”—neural networks whose size (and, therefore, computational cost) can be reduced after training with negligible computational cost.
We focus on NAM’s stacked WaveNet architecture due to its strong performance, though the method can be adapted to NAM’s other open-source architectures in a similar way.
A slider control is introduced to the graphical user interface (GUI) of an audio effect plugin that controls the size of the model in real-time, allowing for its user to easily explore the trade-off between compute and accuracy.
2
Method
A WaveNet
10
is a multi-layer convolutional neural network whose layers operate on a time series of
c
-dimensional vectors.
To slim the network from a width of
c
to
c^{\prime}
, the weights
\mathbf{W}\in\mathbb{R}^{c\times c\times k}
and biases
\boldsymbol{b}\in\mathbb{R}^{c}
of each convolutional layer are truncated, yielding
\mathbf{W}^{\prime}\in\mathbb{R}^{c^{\prime}\times c^{\prime}\times k}
and
\boldsymbol{b}^{\prime}\in\mathbb{R}^{c^{\prime}}
, respectively.
For the affine projections connecting the inputs of dimension
d_{x}
and outputs of dimension
d_{y}
to the network (
d_{x}=d_{y}=1
for mono audio data), only the rows of the input projection and columns of the output projection are truncated so that the input and output dimensionality is preserved.
NAM trains models through supervised learning using a “dry/wet” pair of audio files.
During training, in each mini-batch, the network is slimmed to a randomly-chosen
1\leq c^{\prime}\leq c
, and the slimmed network’s predictions are supervised against the targets.
The resulting neural network can be used with any number of channels when making predictions.
Open-source code is available for training and real-time prediction
3
;
2
, and installers are available for a plugin that integrates the latter
1
.
3
Results
Models were trained on recordings of guitar amplifiers spanning a range of tones: a “clean” tone recorded from a Fender Deluxe Reverb, a “crunch” tone recorded from a Morgan MVP23, and hi-gain “rhythm” and “lead” tones recorded from an Omega Ampworks Obsidian.
Figure
1(a)
shows the trade-off between compute and accuracy for the slimmable NAM alongside other commonly-used models.
For audio examples as well as links to model files, see the video demonstration.
2
2
2
https://youtu.be/93WAQsFu694
Instead of using NAM’s ‘‘standard’’ architecture, which
3
3
3
As of
https://github.com/sdatkinson/neural-amp-modeler/releases/tag/v0.12.0
stacks two WaveNet models with different widths in series, this demonstration uses a new architecture with a single WaveNet module for simplicity.
Fig.
1(b)
shows the settings page of the plugin, adapted from NeuralAmpModelerPlugin
4
4
4
https://github.com/sdatkinson/NeuralAmpModelerPlugin
.
Moving the slider adjusts
c^{\prime}
, allowing the user to audition models of different sizes in real time.
(a)
(b)
Figure 1
:
1(a)
: Real-time factor (higher is better) and accuracy (error-signal ratio
11
; lower is better) for different models of the four tones considered.
The Pareto front is drawn for the slimmable NAM.
“New (full)” refers to the a model using the slimmable architecture trained only for use at full size as normal.
1(b)
: Plugin settings page, showing the ability to slim the loaded network on the fly.
4
Conclusions
This work demonstrates Slimmable NAMs and demonstrates their performance and practical use as musical tools.
Decreasing the computational cost of a neural network without additional training is not new; examples include slimmable neural networks
12
which limit the width of the network as in our work; as well as dynamic gating and conditional computation
5
; multi-exit and early-exit networks
8
; and supernets
4
.
In audio, Slimmable neural networks have already been applied in speech applications
6
.
In virtual analog modeling, pruning has been explored for reducing the computational cost of neural models
9
, though this requires additional training.
Slimmable models have value in NAM due to their ability to simultaneously remove the compute barrier to real-time prediction while simultaneously placing no additional restrictions or complications to the model-fitting process, making them an attractive solution for both model-makers and the musicians who play them.