ReverbMiipher: Generative Speech Restoration meets Reverberation Characteristics Controllability

2025

Read ReverbMiipher: Generative Speech Restoration meets Reverberation Characteristics Controllability (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05077.txt.

Description

Speech recorded in a reverberant room carries the fingerprint of that space, and most cleanup tools erase it completely. Wataru Nakata and seven co-authors argue the echo is worth keeping, and even steering. Their model, ReverbMiipher, restores noisy speech through parametric resynthesis while a dedicated encoder pulls a compact feature describing the reverberation out of the recording.

During training, that feature is sometimes swapped for a zero vector, forcing it to encode echo and nothing else. The cleaned speech is rebuilt from the feature, so the original room character survives while noise and other flaws are removed. Because the echo now lives in one feature, it can be blended between recordings, borrowed from another utterance, or sampled fresh to invent new room effects. In tests, listeners and metrics alike rated the results above conventional cleanup pipelines.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05077

Browse the full library · About the Tower of Babel