Investigating Modality Contribution in Audio LLMs for Music
Giovana Morais, Magdalena Fuentes · 2025
Read Investigating Modality Contribution in Audio LLMs for Music by Giovana Morais, Magdalena Fuentes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20641.txt.
Introduction
Are music chatbots actually listening? Giovana Morais and Magdalena Fuentes measure each sense's contribution in a 2025 arXiv paper on audio language models. Recent benchmarks hinted that models might answer music questions from text habits rather than sound. The authors adapt a Shapley-value framework that scores how much each input modality drives a prediction, regardless of accuracy.
Two models were tested on the MuChoMusic benchmark. The more accurate model leaned more heavily on text than on audio overall. Deeper inspection softened that verdict: the models still located key sound events correctly, so the audio channel was not being ignored. The study is the first application of this attribution method to audio language models. It gives explainability research a firmer way to audit what multimodal models really use.
Catalog record
| CREATOR | Giovana Morais, Magdalena Fuentes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20641
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Investigating Modality Contribution in Audio LLMs for Music Giovana Morais, Magdalena Fuentes Abstract Audio Large Language Models (Audio LLMs) enable human-like conversation about music, yet it is unclear if they are truly listening to the audio or just using textual reasoning, as recent benchmarks suggest. This paper investigates this issue by quantifying the contribution of each modality to a model’s output. We adapt the MM-SHAP framework, a performance-agnostic score based on Shapley values that quantifies the relative contribution of each modality to a model’s prediction. We evaluate two models on the MuChoMusic benchmark and find that the model with higher accuracy relies more on text to answer questions, but further inspection shows that even if the overall audio contribution is low, models can successfully localize key sound events, suggesting that audio is not entirely ignored. Our study is the first application of MM-SHAP to Audio LLMs and we hope it will serve as a foundational step for future research in explainable AI and audio. † † address: † Music and Audio Research Lab, New York University, USA ⋆ Integrated Design & Media, New York University, USA 1 Introduction Audio Large Language Models (Audio LLMs) aim to expand the capabilities of LLMs by incorporating audio information into their reasoning [ 1 ] . While the number of proposed models continues to grow [ 2 , 3 , 4 , 5 , 6 ] difficulty lies in assessing free-form text outputs, due to the unstructured nature of the predictions [ 7 ] . Additionally, evaluation benchmarks must go beyond measuring natural language understanding to explicitly test a model’s ability to reason using audio. Multiple evaluation datasets have been proposed that assess model performance in tasks such as captioning [ 8 ] and compositional reasoning [ 9 ] . The lack of consistent evaluation methods inspired researchers to build new comprehensive benchmarks to evaluate and compare Audio LLMs, such as MuChoMusic [ 10 ] and the Massive Multi-Task Audio Understanding and Reasoning Benchmark (MMAU) [ 11 ] . These datasets feature multiple-choice questions, with the goal that the model will choose the most appropriate answer based on the input audio. The main advantages of this evaluation method are scalability and simplicity, since the model’s answers are matched against predefined options rather than parsed from open-ended text. Furthermore, the questions are designed to test various dimensions of music understanding, such as historical knowledge, music structure, and rhythm. A surprising outcome is that audio-text models perform poorly on these benchmarks, despite achieving strong results on tasks such as audio captioning and description [ 10 , 11 ] , although the reasons for this remain unclear. Experiments that replace the input audio with random noise or silence result in negligible changes to model performance [ 10 ] , suggesting that the models’ use of the audio modality may be limited. While these outcomes indicate a potential imbalance in the modalities (i.e., the text modality is the dominant contributor to the model’s output), the benchmarks primarily rely on indirect metrics, like accuracy, which can be misleading. Accuracy-based evaluations fail to capture cases where a model uses relevant information from a modality but still produces an incorrect prediction. Similar modality-imbalance issues have been reported in Vision LLMs, where unimodal models can often achieve comparable accuracy to a multimodal one on a vision-language task [ 12 ] , suggesting unimodal collapse. To better understand this phenomenon without relying on performance metrics, [ 13 , 14 ] proposed MM-SHAP. They utilize Shapley values [ 15 ] , a post-hoc explainability technique to quantify the relative contribution of each modality in a model’s prediction, irrespective of its accuracy. We investigate MM-SHAP’s adaptability to the modality of audio. Particularly, our main contributions are that we: 1. Adapt MM-SHAP [ 13 ] to inspect how Audio LLMs are using each modality in different tasks; 2. Investigate two well-known Audio LLMs (Qwen-Audio [ 2 ] and MU-LLaMA [ 3 ] ) in multiple-choice Q&A using the open-source MuChoMusic benchmark dataset [ 10 ] ; and 3. Examine how the Audio LLMs use the two modalities. We show that the usage of text is higher for multiple-choice questions, aligning with results from Vision LLMs. We also demonstrate that good performance on MuChoMusic does not imply balanced modality contributions and vice versa. Our aim is to gain insight into how much these models employ each modality to reason over music, and how the task and the MM-SHAP design choices affect these interactions. 2 Related Work Figure 1 : We compute Shapley values by masking all combinations of inputs (approximated via random permutation), and averaging the change in the logits of the base answer (unmasked inference indicated in solid line). We mask text tokens and audio waveform segments. Within explainability techniques in machine learning, there is a family of “post-hoc” methods whose aim is to analyze how each input feature contributes to a given model output via input perturbations. These include approaches like LIME (Local Interpretable Model-agnostic Explanations) [ 16 ] , that explain a prediction by approximating it locally with an interpretable model (e.g., linear regression or a decision tree). To the best of our knowledge, most of the post-hoc techniques applied to music are limited to LIME and LIME-variations [ 17 ] , [ 18 ] . Recently, [ 19 ] expanded LIME methods to investigate music understanding models by analyzing the most important features for genre classification from both text and audio modalities. As for modality contribution itself, the DIsentangled Multimodal Explanations (DIME) [ 20 ] was proposed as a visualization technique to gain insights into each modality’s contribution to the model’s output. DIME disentangles a model into unimodal and multimodal contributions and then produces visualizations on each sub-model using LIME. Because of its focus on visual explanations, DIME is hard to use as a quantitative measure of modality contribution. A common strategy for assessing modality contribution is to conduct ablation studies by removing or replacing one of the modalities with a random input. For example, [ 10 ] swaps the audio with silence, white noise, or another audio and evaluates how much the accuracy changes. The main limitation of this approach is that completely removing a modality obscures how the model uses each modality and their interactions, and to what extent its output depends on the missing modality. As argued in [ 21 ] , comparing the unimodal and multimodal performances does not explain how the model uses cross-modality interactions. To address the limitations of ablation studies and provide stronger theoretical guarantees than surrogate models like LIME, another family of “post-hoc” methods based on Shapley Values has gained prominence. Shapley Values are the only feature attribution method that satisfies theoretical guarantees [ 22 ] . To the best of our knowledge, the only exploration of Shapley values and music audio was performed in [ 23 ] . Recently, Parcalabescu and Frank proposed MultiModal-SHAP (MM-SHAP) [ 13 ] , which quantifies modality contribution in text-vision models by adapting Shapley values to measure how input perturbations across modalities affect the model’s output. 3 Method 3.1 Shapley Values and Feature Contribution Shapley values were first proposed in the context of game theory to estimate how much