AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder
Samir Sadok 1 , Simon Leglaive 2 , Laurent Girin 3 , Gaël Richard 4 , Xavier Alameda-Pineda 1 · 2025
Read AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder by Samir Sadok 1 , Simon Leglaive 2 , Laurent Girin 3 , Gaël Richard 4 , Xavier Alameda-Pineda 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05332.txt.
Description
Samir Sadok and four co-authors introduce AnCoGen, a single model that can analyze, control, and generate speech. The model is built on a masked autoencoder, which learns by hiding parts of a signal and rebuilding them. One unified model for all three jobs is rare in speech work.
From speech input the model estimates speaker identity, pitch, content, loudness, and noise and clarity measures. From those attributes it can synthesize new speech, and users can edit the attributes to steer the output. Tests cover analysis and resynthesis, pitch estimation and change, and speech enhancement. Results support the claim that one model can handle the full loop with strong quality.
Catalog record
| CREATOR | Samir Sadok 1 , Simon Leglaive 2 , Laurent Girin 3 , Gaël Richard 4 , Xavier Alameda-Pineda 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-05332