AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder

Samir Sadok 1 , Simon Leglaive 2 , Laurent Girin 3 , Gaël Richard 4 , Xavier Alameda-Pineda 1 · 2025

Read AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder by Samir Sadok 1 , Simon Leglaive 2 , Laurent Girin 3 , Gaël Richard 4 , Xavier Alameda-Pineda 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05332.txt.

Description

Samir Sadok and four co-authors introduce AnCoGen, a single model that can analyze, control, and generate speech. The model is built on a masked autoencoder, which learns by hiding parts of a signal and rebuilding them. One unified model for all three jobs is rare in speech work.

From speech input the model estimates speaker identity, pitch, content, loudness, and noise and clarity measures. From those attributes it can synthesize new speech, and users can edit the attributes to steer the output. Tests cover analysis and resynthesis, pitch estimation and change, and speech enhancement. Results support the claim that one model can handle the full loop with strong quality.

Catalog record

CREATORSamir Sadok 1 , Simon Leglaive 2 , Laurent Girin 3 , Gaël Richard 4 , Xavier Alameda-Pineda 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-05332

Browse the full library · About the Tower of Babel