SpeechLLM: Unified Speech and Language Model for Enhanced Multi-Task Understanding in Low Resource Settings
Jaekwon, Kunal, Divya, Abenezer, Chandra · 2025
Read SpeechLLM: Unified Speech and Language Model for Enhanced Multi-Task Understanding in Low Resource Settings by Jaekwon, Kunal, Divya, Abenezer, Chandra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04473.txt.
Description
Jaekwon Yoo and four co-authors link speech to language models cheaply for low-resource settings in a 2025 research paper. Joining a speech encoder to a large language model usually demands heavy data and compute. Their parameter-efficient adapter converts speech embeddings, numeric sound summaries, into tokens the language model can read. Three spoken tasks are targeted together: transcription, named entity recognition, and sentiment analysis. A language model also labels synthetic training data, cutting annotation costs.
With seven times fewer trainable parameters, the adapter still improved all three tasks substantially on standard measures. Extra gains came from a classifier regularizer and low-rank adaptation of the main model. Scores on the SLUE spoken understanding benchmark rose clearly. Smaller teams can now attempt unified speech systems.
Catalog record
| CREATOR | Jaekwon, Kunal, Divya, Abenezer, Chandra |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04473