DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion

Hanlin ZHANG, Daxin Tan, Dehua Tao, Xiao Chen, Haochen Tan, Yunhe Li, Yuchen Cao, Jianping Wang, Linqi Song · 2026

Read DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion by Hanlin ZHANG, Daxin Tan, Dehua Tao, Xiao Chen, Haochen Tan, Yunhe Li, Yuchen Cao, Jianping Wang, Linqi Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-09239.txt.

Description

Hanlin Zhang and eight co-authors split speech into two code streams: sense and sound. A speech code turns a wave into a short list of codes a chat model can use. Past codes mix what was said with how it sounds. That mix makes it hard to swap voice yet keep words, or to keep voice and change words.

Their code tool is called DSA-Tokenizer. It holds sense codes and sound codes apart by set rules in train. A flow match step then joins the two in a ranked way for the next stage. A reader in speech tech gets a split code that may serve voice swap and text true tasks at once.

Catalog record

CREATORHanlin ZHANG, Daxin Tan, Dehua Tao, Xiao Chen, Haochen Tan, Yunhe Li, Yuchen Cao, Jianping Wang, Linqi Song
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-09239

Browse the full library · About the Tower of Babel