CALM: Class-Conditional Sparse Attention Vectors for Large Audio-Language Models
Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, M. Jehanzeb Mirza · 2026
Read CALM: Class-Conditional Sparse Attention Vectors for Large Audio-Language Models by Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, M. Jehanzeb Mirza (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07077.txt.
Description
Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, and M. Jehanzeb Mirza improve few-shot classification with large audio-language models. These models show strong zero-shot ability on audio question answering and reasoning, but lag specialized models on discriminative tasks like audio classification. Recent work showed sparse subsets of attention heads can serve as strong feature extractors through simple voting, but those methods weight every selected head equally across all categories.
Their method, CALM, learns class-dependent importance weights over attention heads, letting individual heads specialize in distinct semantic categories and contribute proportionally to their estimated reliability. On multiple few-shot audio and audiovisual benchmarks, CALM consistently beat state-of-the-art uniform voting approaches, with absolute gains of up to about 14.5 percent on audio classification, about 1.5 percent on audio-visual classification, and about 8.4 percent on spoofing detection.
Catalog record
| CREATOR | Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, M. Jehanzeb Mirza |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07077