StreamUni: Achieving Streaming Speech Translation with a Unified Large Speech-Language Model

Shoutao Guo, Xiang Li, MengGe Liu, Wei Chen, Yang Feng · 2025

Read StreamUni: Achieving Streaming Speech Translation with a Unified Large Speech-Language Model by Shoutao Guo, Xiang Li, MengGe Liu, Wei Chen, Yang Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07803.txt.

Description

Shoutao Guo and co-authors present, in a 2025 paper, a single model that translates speech as it arrives, without a pause for the full sentence. Live speech translation must pick when to speak: too soon and the sense is wrong, too late and the user waits. Past systems worked on cut chunks of speech and needed a second model to make the cuts. Those cuts starve the translator of context, and policy rules are hard to learn from speech alone.

Their model, StreamUni, folds speech sense, cut choice, and translation into one large speech-language model. A speech chain-of-thought step guides it to output in stages: cut, decide, translate. A training trick uses a small set of such chains to sharpen fast choices. Tests put the model at the top of its class, the team reports.

Catalog record

CREATORShoutao Guo, Xiang Li, MengGe Liu, Wei Chen, Yang Feng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-07803

Browse the full library · About the Tower of Babel