CALM: Class-Conditional Sparse Attention Vectors for Large Audio-Language Models

Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, M. Jehanzeb Mirza · 2026

Read CALM: Class-Conditional Sparse Attention Vectors for Large Audio-Language Models by Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, M. Jehanzeb Mirza (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07077.txt.

Description

Videet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, and M. Jehanzeb Mirza improve few-shot classification with large audio-language models. These models show strong zero-shot ability on audio question answering and reasoning, but lag specialized models on discriminative tasks like audio classification. Recent work showed sparse subsets of attention heads can serve as strong feature extractors through simple voting, but those methods weight every selected head equally across all categories.

Their method, CALM, learns class-dependent importance weights over attention heads, letting individual heads specialize in distinct semantic categories and contribute proportionally to their estimated reliability. On multiple few-shot audio and audiovisual benchmarks, CALM consistently beat state-of-the-art uniform voting approaches, with absolute gains of up to about 14.5 percent on audio classification, about 1.5 percent on audio-visual classification, and about 8.4 percent on spoofing detection.

Catalog record

CREATORVideet Mehta, Liming Wang, Hilde Kuehne, Rogerio Feris, James R. Glass, M. Jehanzeb Mirza
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07077

Browse the full library · About the Tower of Babel