SpeechLLM: Unified Speech and Language Model for Enhanced Multi-Task Understanding in Low Resource Settings

Jaekwon, Kunal, Divya, Abenezer, Chandra · 2025

Read SpeechLLM: Unified Speech and Language Model for Enhanced Multi-Task Understanding in Low Resource Settings by Jaekwon, Kunal, Divya, Abenezer, Chandra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04473.txt.

Description

Jaekwon Yoo and four co-authors link speech to language models cheaply for low-resource settings in a 2025 research paper. Joining a speech encoder to a large language model usually demands heavy data and compute. Their parameter-efficient adapter converts speech embeddings, numeric sound summaries, into tokens the language model can read. Three spoken tasks are targeted together: transcription, named entity recognition, and sentiment analysis. A language model also labels synthetic training data, cutting annotation costs.

With seven times fewer trainable parameters, the adapter still improved all three tasks substantially on standard measures. Extra gains came from a classifier regularizer and low-rank adaptation of the main model. Scores on the SLUE spoken understanding benchmark rose clearly. Smaller teams can now attempt unified speech systems.

Catalog record

CREATORJaekwon, Kunal, Divya, Abenezer, Chandra
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-04473

Browse the full library · About the Tower of Babel