STCTS: Generative Semantic Compression for Ultra-Low Bitrate Speech via Explicit Text-Prosody-Timbre Decomposition

Siyu Wang, Haitao Li, Donglai Zhu 1 · 2025

Read STCTS: Generative Semantic Compression for Ultra-Low Bitrate Speech via Explicit Text-Prosody-Timbre Decomposition by Siyu Wang, Haitao Li, Donglai Zhu 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00451.txt.

Description

Voice calls over satellite, maritime, and tactical links are expensive because bandwidth is scarce. Siyu Wang, Haitao Li, and Donglai Zhu present STCTS in 2025, a generative semantic compression framework for speech at ultra-low bitrates. Traditional codecs struggle below one kilobit per second.

Earlier semantic approaches convert speech to text and back, sacrificing prosody and speaker identity. STCTS decomposes speech explicitly into text, prosody, and timbre, then regenerates natural voice from that compact description. Keeping the speaker's tone and identity at very low rates could change communication wherever bandwidth is precious. The target rate, around eighty bits per second, is far below ordinary telephony. Prosody carries emotion and emphasis, which text-only schemes throw away.

Catalog record

CREATORSiyu Wang, Haitao Li, Donglai Zhu 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-00451

Browse the full library · About the Tower of Babel