AR&D: A Framework for Retrieving and Describing Concepts for Interpreting AudioLLMs
Townim Faisal, Ta Duc Huy, Siqi Pan, Jeremy Stoddard, Zhibin Liao · 2026
Read AR&D: A Framework for Retrieving and Describing Concepts for Interpreting AudioLLMs by Townim Faisal, Ta Duc Huy, Siqi Pan, Jeremy Stoddard, Zhibin Liao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22253.txt.
Description
Audio-language models perform strongly on perception tasks, yet remain hard to read: single neurons often fire for several unrelated concepts at once. Townim Faisal Chowdhury and four co-authors introduce AR&D, the first mechanistic framework for reading audio-language models. Sparse autoencoders split tangled multi-meaning activations into clean single-meaning features.
The pipeline picks sample audio clips, names the found concepts through auto captioning, and validates them with human checks and steering tests. Tests show audio-language models do encode structured, readable features. The work lays groundwork for trusted use in high-stakes settings and for finer studies of sound and speech.
Catalog record
| CREATOR | Townim Faisal, Ta Duc Huy, Siqi Pan, Jeremy Stoddard, Zhibin Liao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22253