Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis
Weiwei Lin, Chenghan He · 2025
Read Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis by Weiwei Lin, Chenghan He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01084.txt.
Description
Weiwei Lin and Chenghan He wrote a 2025 paper on making computers speak with a natural voice. Their method builds speech step by step from smooth, continuous sound features. It avoids the chopped token approach used by many recent speech models.
The system pairs a tool that squeezes speech into a rich latent form with a step-by-step model that predicts what comes next. A new alignment trick keeps the sounds locked to the text in strict order. In tests, the system beat the well-known VALL-E model on both human ratings and lab scores. It did so with only about a tenth of VALL-E's size, which makes it cheaper to run.
Catalog record
| CREATOR | Weiwei Lin, Chenghan He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-01084