Aligner-Guided Training Paradigm: Advancing Text-to-Speech Models with Aligner Guided Duration
1 st Haowei Lou, 2 nd Helen Paik, 3 rd Wen Hu, 4 th Lina Yao · 2024
Read Aligner-Guided Training Paradigm: Advancing Text-to-Speech Models with Aligner Guided Duration by 1 st Haowei Lou, 2 nd Helen Paik, 3 rd Wen Hu, 4 th Lina Yao (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08112.txt.
Description
Speech made by computers can sound flat when word timing is off. Haowei Lou and co-authors take up that snag in a 2024 study of text-to-speech tools. Most tools get their timing from a stand-alone aligner, a step that is slow and hard to change. The team flips the order and trains the aligner first, inside the same flow.
With timing set early, word error rates drop by as much as a sixth in their tests. Sound match for speech sounds and tones also gets much sharper. The team tries three kinds of sound input to see which helps most. Their results point to a path toward speech that is clear and sounds more like a real voice.
Catalog record
| CREATOR | 1 st Haowei Lou, 2 nd Helen Paik, 3 rd Wen Hu, 4 th Lina Yao |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08112