Generalizable Prompt Tuning for Audio-Language Models via Semantic Expansion

Jaehyuk JangWonjun Lee Kangwook Ko Changick Kim · 2026

Read Generalizable Prompt Tuning for Audio-Language Models via Semantic Expansion by Jaehyuk JangWonjun Lee Kangwook Ko Changick Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20867.txt.

Description

Jaehyuk Jang, Wonjun Lee, Kangwook Ko, and Changick Kim study how to tune audio-language models so the skill transfers. Their 2026 paper concerns prompt tuning. The method adjusts a small set of learned prompts instead of the whole model. It worked well for vision-language models and is now used for audio-language models too. Its generalization, though, remains largely unexplored.

The authors spot a base-new trade-off in standard prompt tuning. Gains on known classes come at the cost of new ones. They trace the issue to a disrupted semantic structure in the embedding space. Their fix expands that semantic structure to protect it. The work helps audio models that must greet new sounds without forgetting old ones. It is a careful study of a small method with wide use.

Catalog record

CREATORJaehyuk JangWonjun Lee Kangwook Ko Changick Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20867

Browse the full library · About the Tower of Babel