Are Inherently Interpretable Models More Robust? A Study in Music Emotion Recognition
Katharina Hoedt ( [email protected] ), Arthur Flexer ( [email protected] ), Gerhard Widmer ( [email protected] ) · 2025
Read Are Inherently Interpretable Models More Robust? A Study in Music Emotion Recognition by Katharina Hoedt ( [email protected] ), Arthur Flexer ( [email protected] ), Gerhard Widmer ( [email protected] ) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03780.txt.
Introduction
Katharina Hoedt, Arthur Flexer, and Gerhard Widmer ask in a 2025 paper whether music emotion models that stay easy to read are also harder to fool. Models that guess mood from songs can flip their answer after tiny input changes that people would not notice. The team compared a readable model with a black box model when both faced crafted tricky inputs. They also added a model trained to resist such tricks.
The readable model held up better than the black box one under attack. Its strength was close to that of the attack trained model, but at lower computing cost. Readers learn that building a model around clear, meaningful features may buy safety as well as clarity, at least in this music task.
Catalog record
| CREATOR | Katharina Hoedt ( [email protected] ), Arthur Flexer ( [email protected] ), Gerhard Widmer ( [email protected] ) |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03780
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Are Inherently Interpretable Models More Robust? A Study in Music Emotion Recognition Katharina Hoedt ( [email protected] ), Arthur Flexer ( [email protected] ), Gerhard Widmer ( [email protected] ) Abstract One of the desired key properties of deep learning models is the ability to generalise to unseen samples. When provided with new samples that are (perceptually) similar to one or more training samples, deep learning models are expected to produce correspondingly similar outputs. Models that succeed in predicting similar outputs for similar inputs are often called robust. Deep learning models, on the other hand, have been shown to be highly vulnerable to minor (adversarial) perturbations of the input, which manage to drastically change a model’s output and simultaneously expose its reliance on spurious correlations. In this work, we investigate whether inherently interpretable deep models , i.e., deep models that were designed to focus more on meaningful and interpretable features, are more robust to irrelevant perturbations in the data, compared to their black-box counterparts. We test our hypothesis by comparing the robustness of an interpretable and a black-box music emotion recognition model when challenged with adversarial examples. Furthermore, we include an adversarially trained model, which is optimised to be more robust, in the comparison. Our results indicate that inherently more interpretable emotion recognition models can indeed be more robust than their black-box counterparts, and achieve similar levels of robustness as adversarially trained models, at lower computational cost. 1 Introduction In Music Information Retrieval (MIR) , as in any other application domain of machine learning, a central desideratum is that learned models should generalise, that is, make correct predictions on new observations outside of the training data. A special aspect of this is robustness : the ability of a model to make similar predictions when presented with similar inputs. In particular, we expect a good model to be robust against irrelevant changes in its input. However, it has previously been shown that most traditional, black-box deep learning models are not robust in this sense. Instead, they are vulnerable to imperceptible perturbations of the inputs [ 1 ] , which can drastically change the predictions and hence the performance. While this issue was first discussed in the image domain [ 1 ] , it has similarly been found to be a relevant problem in other domains in which deep learning became dominant, such as speech [ 2 ] and MIR [ 3 ] . Generally, the relationship between (adversarial) robustness and the ability to generalise has been shown to be a complex one [ 4 ] . In this work, we hypothesise that deep learning models that are inherently interpretable , i.e., models that by design focus more on interpretable features, may also be inherently more robust against minor alterations of the input. Specifically, we look into a variant of a concept bottleneck model [ 5 ] . Here, predictions are not obtained directly from an input via complex computations, but instead are based on human-understandable concepts (here: so-called mid-level features), which are extracted with the help of a bottleneck layer. Based on these concepts, the final class predictions are obtained via a linear layer, resulting in more transparent model decisions as we can track which concept contributed to which extent towards a prediction. We test the robustness of an inherently interpretable model subsequently by focusing on a specific task – music emotion recognition from audio – and using an adversarial attack as a probing tool. We compare the robustness of traditional, black-box models, of their adversarially trained versions, and of an inherently interpretable model from the recent MIR literature. As the model treats emotion recognition as a regression task, we also need to adapt an existing attack method to fit a regression setting. We use this adversarial attack to investigate to what extent it manages to distort the performance of the different types of models. Our results indicate that the inherently interpretable model is substantially more robust than a black-box model, and even exhibits similar robustness as models that have been deliberately adversarially trained. This documents – beyond the usefulness of interpretability per se – another advantage of inherently interpretable models in MIR , calling for more research in this direction. 2 Related Work Linking Interpretability and Robustness . In what follows, we hypothesise about a connection between interpretability and adversarial robustness. Previously, it was shown that robust models lead to explanations (here: saliency maps) that are easier to comprehend than non-robust models (e.g., [ 6 ] ). An idea similar to ours, yet with a focus on post-hoc interpretability, is an adversarial defence based on the promotion of model interpretations that are robust to adversarial perturbations [ 7 ] . Also, different studies observed that models trained to present interpretable gradients (e.g., via some type of regularisation [ 8 ] or saliency-guided training [ 9 ] ) result in more robust models. Here, the main difference from our hypothesis is that we do not require interpretable gradients, but look at models that were designed to focus on human-interpretable features during training. Somewhat related, input modifications have been used to gain insights about the learned embedding space of deep MIR models [ 10 ] . The work most similar to ours investigates the same hypothesis as we argue for, and look into the robustness of an inherently interpretable deep image classifier [ 11 ] . The setup is similar to ours, as the robustness of a standard (black-box) Convolutional Neural Network (CNN) , an inherently interpretable model, and adversarially trained variants are compared, but in the image domain. Our work can therefore be seen as an extension of these tests to a different domain. Inherently Interpretable Deep Learning Models . The topic of inherently interpretable deep models is still mostly in early stages of development in various domains. In the image domain, prototype-based models (e.g., [ 12 ] ) were introduced as systems that learn to represent prototypes (i.e., (parts of) representative inputs of a class), and base their predictions on these representations. Related, concept bottleneck models [ 13 ] try to extract (human-interpretable) concepts from input data, on which the final predictions are based. Concepts can here be predefined and learned, e.g., by using corresponding annotations if available [ 13 ] , or extracted automatically, e.g., by learning concepts in a self-supervised way during training [ 14 ] . The original idea of concept bottleneck models [ 13 ] is very similar to the model we will look at in our experiments [ 5 ] . The work we build upon in this paper was one of the first approaches in MIR where a model was designed so that its predictions relied on human-understandable concepts [ 5 ] . Next to this, systems have been proposed that base their predictions on automatically learned prototypes, or meaningful transformations thereof [ 15 , 16 ] . A different approach previously proposed is the idea to train a classifier and an interpreter simultaneously to develop an interpretable system [ 17 ] . Another avenue investigated in MIR is the use of (self-)attention for interpretability purposes, e.g., [ 18 ] , but the assumptions underlying this type of approach have been questioned [ 19 ] . Beyond