ReverbMiipher: Generative Speech Restoration meets Reverberation Characteristics Controllability
2025
Read ReverbMiipher: Generative Speech Restoration meets Reverberation Characteristics Controllability (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05077.txt.
Description
Speech recorded in a reverberant room carries the fingerprint of that space, and most cleanup tools erase it completely. Wataru Nakata and seven co-authors argue the echo is worth keeping, and even steering. Their model, ReverbMiipher, restores noisy speech through parametric resynthesis while a dedicated encoder pulls a compact feature describing the reverberation out of the recording.
During training, that feature is sometimes swapped for a zero vector, forcing it to encode echo and nothing else. The cleaned speech is rebuilt from the feature, so the original room character survives while noise and other flaws are removed. Because the echo now lives in one feature, it can be blended between recordings, borrowed from another utterance, or sampled fresh to invent new room effects. In tests, listeners and metrics alike rated the results above conventional cleanup pipelines.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-05077