Masked Autoencoders as Universal Speech Enhancer Thanks: *Work performed during internship at AWS AI Labs.
Rajalaxmi Rajagopalan*, Ritwik Giri, Zhiqiang Tang, Kyu Han, Gerald Friedland · 2026
Read Masked Autoencoders as Universal Speech Enhancer Thanks: *Work performed during internship at AWS AI Labs. by Rajalaxmi Rajagopalan*, Ritwik Giri, Zhiqiang Tang, Kyu Han, Gerald Friedland (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02413.txt.
Description
Clean reference speech is scarce in real settings, so Rajalaxmi Rajagopalan and 3 co-authors train a speech enhancer without it, in a 2026 arXiv paper. Their masked autoencoder learns by hiding parts of a speech spectrogram, a picture of sound over time, and reconstructing them. Extra distortions are deliberately added during training, so the model learns to remove noise it has never been handed cleanly.
The enhancer is universal: it does not need to know which distortion struck, and it can handle several at once. Pretrained embeddings then feed small fine-tuning models for specific jobs. The authors evaluate denoising and dereverberation, and they test choices such as multi-speaker augmentation and feature compression. The method beat its baseline and reached top performance on both familiar and unfamiliar datasets.
Catalog record
| CREATOR | Rajalaxmi Rajagopalan*, Ritwik Giri, Zhiqiang Tang, Kyu Han, Gerald Friedland |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02413