Exploring Local Interpretable Model-Agnostic Explanations for Speech Emotion Recognition with Distribution-Shift

Maja J. Hjuler, Line H. Clemmensen, Sneha Das · 2025

Read Exploring Local Interpretable Model-Agnostic Explanations for Speech Emotion Recognition with Distribution-Shift by Maja J. Hjuler, Line H. Clemmensen, Sneha Das (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05368.txt.

Introduction

Maja Hjuler, Line Clemmensen, and Sneha Das introduce in 2025 a way to explain what a speech emotion model is using, even when the data shift. Their tool adapts a known local explanation method for models that read emotion from voice. It gives high level reasons and names the exact frequency ranges that swayed the call for a given clip.

Tests cover three emotional speech data sets, with models built on hand made sound features and on learned speech embeddings. The tool held up better across different models than across data sets that had shifted. Within one data set, its explanations were steadier, which the authors offer as a step toward trust in voice emotion systems.

Catalog record

CREATORMaja J. Hjuler, Line H. Clemmensen, Sneha Das
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05368

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring Local Interpretable Model-Agnostic Explanations for Speech Emotion Recognition with Distribution-Shift Maja J. Hjuler, Line H. Clemmensen, Sneha Das Abstract We introduce EmoLIME 1 1 1 Source code: https://github.com/snehadas/EmoLIME , a version of local interpretable model-agnostic explanations (LIME) for black-box Speech Emotion Recognition (SER) models. To the best of our knowledge, this is the first attempt to apply LIME in SER. EmoLIME generates high-level interpretable explanations and identifies which specific frequency ranges are most influential in determining emotional states. The approach aids in interpreting complex, high-dimensional embeddings such as those generated by end-to-end speech models. We evaluate EmoLIME, qualitatively, quantitatively, and statistically, across three emotional speech datasets, using classifiers trained on both hand-crafted acoustic features and Wav2Vec 2.0 embeddings. We find that EmoLIME exhibits stronger robustness across different models than across datasets with distribution shifts, highlighting its potential for more consistent explanations in SER tasks within a dataset. \textsuperscript{1} \textsuperscript{1} footnotetext: The author was affiliated with the Technical University of Denmark when this work was carried out. † † footnotetext: Corresponding Author I Introduction Transformer models have revolutionized large-scale signal processing, influencing all data modalities [ [ 1 ] , [ 2 ] , [ 3 ] ], including speech and audio signals [ [ 4 ] , [ 5 ] , [ 6 ] ]. While they are versatile across different domains due to their ability to incorporate information and structure in over-parameterized spaces, this also leads to black-box decisions, which is one of their main drawbacks. In other words, it is non-trivial to understand the decision-making process in transformers. In contrast to hand-crafted features, deep features may not represent any physical interpretation, and require alternative explainability techniques to aid the transparency and understanding behind the automated decisions. Fig. 1: Functional block diagram of EmoLIME inspired by [ 7 ] and [ 8 ] . Explainable Artificial Intelligence (XAI) is rapidly advancing due to the importance of understanding the decision-making process of black-box deep-learning and machine learning models. This is particularly critical in high-stakes sectors such as healthcare, law, and education, where the model outcome is as important as how one arrived at it . Transparency and explainability of automated systems are now also necessitated through regulatory mandates and frameworks like the EU AI act and the OECD AI principles, respectively [ [ 9 ] , [ 10 ] ]. XAI techniques are widely researched and established in computer vision (CV) and Natural Language Processing (NLP). Due to the tangible and physical nature of visual and text data, defining connections between input and output through models, and thereby explaining model predictions, is relatively more intuitive. This is in contrast to speech and audio signals, where XAI methods need to consider what to explain? ; this is further influenced by the corresponding speech processing task and its application. Therefore, only a few XAI methods developed for CV and NLP are directly transferable to speech processing. (a) wav2vec2-SVC (b) ComParE-SVC Fig. 2: Example explanations for the happy expression of a German sentence from EMODB. Components highlighted in green account for a true prediction. Weights are annotated in white. a) Higher weight is given to high-pitch sounds (high frequency) for wav2vec2-SVC . b) The same pattern cannot be recognized for the ComParE-SVC model. LIME (Local Interpretable Model-Agnostic Explanations) and SHAP (SHapley Additive exPlanations) are state-of-the-art XAI methods [ [ 11 ] , [ 12 ] ] and are model-agnostic, ie: they can be applied to any machine-learning model. Hence, they have also been explored within speech-based classification models; LIME has been adapted to Automatic Speech Recognition (ASR) [ 13 ] and SHAP has been employed in speech emotion recognition (SER) to evaluate feature importance [ [ 14 ] , [ 15 ] ]. In contrast to gradient-based XAI techniques, LIME has an advantage in explaining waveform-fed models by directly assigning importance to decomposed audio patches rather than single time points [ 16 ] . This makes LIME explanations more aligned with human intuition and easier to interpret since we can relate different elements or segments of the audio to the prediction. SHAP was first proposed as a unified framework for interpreting predictions and it is based on Shapley values from game theory. Some disadvantages of SHAP when compared to LIME include a lack of intuitiveness when working with complex transformed features from deep learning models that do not directly represent any physical characteristics of the audio. If the end-users are non-technical experts, even hand-crafted features like Mel-frequency cepstral coefficients (MFCCs) may not be considered interpretable. Furthermore, the technique can be computationally expensive for high-dimensional datasets and multi-class classification. The hand-crafted feature sets can consist of thousands of acoustic parameters making SHAP infeasible depending on system memory constraints. In this work, we present EmoLIME, to explain the predictions of SER classifiers, developed for both hand-crafted and deep features. Due to the relevance of frequency based features in SER (eg: tone, pitch, etc), we primarily focus on spectral decomposition. EmoLIME is developed on LIME by decomposing the audio into equally sized frequency components. This leads to spectral masking in the training of the surrogate model. Explanations are generated by perturbing the input and training a linear sparse surrogate model which assigns weights to each input component. Our main contributions are summarised as follows: 1. We introduce EmoLIME, a LIME technique for interpretable local explanations of black-box SER models. To the best of our knowledge, our work represents the first attempt to apply LIME in SER. 2. We demonstrate EmoLIME on three emotional speech datasets for classifiers trained on hand-crafted and deep features, i.e. embeddings from a general speech model. 3. We investigate the transferability of the explanations across three datasets, with statistical conclusions on the influence of distribution shifts on the explanations. (a) wav2vec2-SVC (b) ComParE-SVC Fig. 3: Explanations for the angry expression of a German sentence from EMODB. a) More weight is given to low-pitch sounds (low frequency) for wav2vec2-SVC . b) Weights are more uniformly distributed for the ComParE-SVC model. II Related Work XAI methods are often classified by the stage of application (before, during, or after model training), the scope (local or global), and the input data format [ 17 ] . The explanations can also have different formats including numerical, logical, visual, and textual. Depending on the input audio representation (waveform, spectrogram, etc.) different XAI methods are applicable. In a recent review [ 18 ] , existing XAI methods for audio models are summarized and the authors emphasize the importance of enhancing their interpretability and trust. XAI methods are split into two categories: generic XAI methods, e.g. Integrated gradients [ 19 ] , LIME [ 11 ] , and SHAP [ 12 ] , and XAI methods specialized for audio models, e.g. LRP [ 20 ] and DFT-LRP [ 21 ] . Common to methods is they aim to explain complex audio signals and leverage human adeptness at interpreting harmonies, rhythm, and other high-level concepts through listening. SoundLIME (SLIME) proposed in [ 7 ] extends LIME to music content analysis, specifically to singing voice detection. Furthermore, LIME was proposed for audio classification in AudioLIME [ 8 ] , a system that uses source separation to produce listenable explanations. Recently, an

Read the complete text