AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoders
Georgii Aparin, Tasnima Sadekova, Alexey Rukhovich, Assel Yermekova · 2026
Read AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoders by Georgii Aparin, Tasnima Sadekova, Alexey Rukhovich, Assel Yermekova (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05027.txt.
Description
Sparse autoencoders have become a loved tool for peering inside language and vision models, but audio models had been left out. Georgii Aparin and 7 co-authors fill that gap in this 2026 paper, accepted at EACL 2026. They trained the autoencoders on each encoder layer of two leading audio models, Whisper and HuBERT.
The learned features proved steady, with over half surviving retraining with varied random seeds, and rebuild quality held up. Features caught both broad sound traits and set events, from background noise to laughter and whispering. Ideas could be erased by removing only about a fifth to a quarter of the features. Steering features cut Whisper's false speech hits by 70 percent with almost no cost to transcription accuracy. Some features even tracked human brain activity while people listened to speech.
Catalog record
| CREATOR | Georgii Aparin, Tasnima Sadekova, Alexey Rukhovich, Assel Yermekova |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05027