Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy
Ke Xue, Rongfei Fan, Kai Li, Shanping Yu, Puning Zhao, Jianping An · 2026
Read Dual-View Predictive Diffusion: Lightweight Speech Enhancement via Spectrogram-Image Synergy by Ke Xue, Rongfei Fan, Kai Li, Shanping Yu, Puning Zhao, Jianping An (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00568.txt.
Description
Ke Xue and colleagues build DVPD, a lightweight diffusion model for speech enhancement that treats spectrograms as images and frequency signals. Score-based models that treat spectrograms as generic images waste structure and compute, so DVPD compresses spectra with an adaptive encoder that keeps low harmonics and prunes high redundancy. An image-based module adds a visual view with overhead, and a training-free boost refines output at inference without fine-tuning. Tests show state-of-the-art quality with 35% of the parameters and 40% of the compute of PGUSE.
Catalog record
| CREATOR | Ke Xue, Rongfei Fan, Kai Li, Shanping Yu, Puning Zhao, Jianping An |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72707 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.00568