DashengTokenizer: One layer is enough for unified audio understanding and generation

Heinrich Dinkel, Xingwei Sun, Gang Li, Jiahao Mei, Yadong Niu, Xiyang Li, Yifan Liao, Jiahao Zhou, Junbo Zhang, Jian Luan · 2026

Read DashengTokenizer: One layer is enough for unified audio understanding and generation by Heinrich Dinkel, Xingwei Sun, Gang Li, Jiahao Mei, Yadong Niu, Xiyang Li, Yifan Liao, Jiahao Zhou, Junbo Zhang, Jian Luan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23765.txt.

Description

Heinrich Dinkel and ten co-authors present DashengTokenizer, a single-layer tool that turns sound into a compact form for both understanding and creating audio. The 2026 paper reverses the usual design: it starts from frozen meaning features and adds sound detail, rather than training a sound codec first.

In tests across many tasks, the method beats earlier audio codecs and encoders by a clear margin, while keeping sound rebuild quality competitive. Gains show up in speech emotion, music understanding, and scene sorting. For creation, it beats standard variational autoencoder methods on text-to-audio and text-to-music, and it works well for speech cleanup too. The authors argue that such autoencoder designs are not required for audio synthesis.

Catalog record

CREATORHeinrich Dinkel, Xingwei Sun, Gang Li, Jiahao Mei, Yadong Niu, Xiyang Li, Yifan Liao, Jiahao Zhou, Junbo Zhang, Jian Luan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23765

Browse the full library · About the Tower of Babel