Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy

Ke Xue, Rongfei Fan, Kai Li, Shanping Yu, Puning Zhao, Jianping An · 2026

Read Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy by Ke Xue, Rongfei Fan, Kai Li, Shanping Yu, Puning Zhao, Jianping An (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00568.txt.

Description

Ke Xue and colleagues build DVPD, a lightweight diffusion model for speech enhancement that treats spectrograms as images and frequency signals. Score-based models that treat spectrograms as generic images waste structure and compute, so DVPD compresses spectra with an adaptive encoder that keeps low harmonics and prunes high redundancy. An image-based module adds a visual view with overhead, and a training-free boost refines output at inference without fine-tuning. Tests show state-of-the-art quality with 35% of the parameters and 40% of the compute of PGUSE.

Catalog record

CREATORKe Xue, Rongfei Fan, Kai Li, Shanping Yu, Puning Zhao, Jianping An
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72707
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00568

Browse the full library · About the Tower of Babel