AR&D: A Framework for Retrieving and Describing Concepts for Interpreting AudioLLMs

Townim Faisal, Ta Duc Huy, Siqi Pan, Jeremy Stoddard, Zhibin Liao · 2026

Read AR&D: A Framework for Retrieving and Describing Concepts for Interpreting AudioLLMs by Townim Faisal, Ta Duc Huy, Siqi Pan, Jeremy Stoddard, Zhibin Liao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22253.txt.

Description

Audio-language models perform strongly on perception tasks, yet remain hard to read: single neurons often fire for several unrelated concepts at once. Townim Faisal Chowdhury and four co-authors introduce AR&D, the first mechanistic framework for reading audio-language models. Sparse autoencoders split tangled multi-meaning activations into clean single-meaning features.

The pipeline picks sample audio clips, names the found concepts through auto captioning, and validates them with human checks and steering tests. Tests show audio-language models do encode structured, readable features. The work lays groundwork for trusted use in high-stakes settings and for finer studies of sound and speech.

Catalog record

CREATORTownim Faisal, Ta Duc Huy, Siqi Pan, Jeremy Stoddard, Zhibin Liao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22253

Browse the full library · About the Tower of Babel