Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis

Weiwei Lin, Chenghan He · 2025

Read Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis by Weiwei Lin, Chenghan He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01084.txt.

Description

Weiwei Lin and Chenghan He wrote a 2025 paper on making computers speak with a natural voice. Their method builds speech step by step from smooth, continuous sound features. It avoids the chopped token approach used by many recent speech models.

The system pairs a tool that squeezes speech into a rich latent form with a step-by-step model that predicts what comes next. A new alignment trick keeps the sounds locked to the text in strict order. In tests, the system beat the well-known VALL-E model on both human ratings and lab scores. It did so with only about a tenth of VALL-E's size, which makes it cheaper to run.

Catalog record

CREATORWeiwei Lin, Chenghan He
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-01084

Browse the full library · About the Tower of Babel