Unified Diffusion Refinement for Multi-Channel Speech Enhancement and Separation

Zhongweiyang Xu, Ashutosh Pandey, Juan Azcarreta, Zhaoheng Ni, Sanjeel Parekh, Buye Xu, Romit Roy Choudhury · 2026

Read Unified Diffusion Refinement for Multi-Channel Speech Enhancement and Separation by Zhongweiyang Xu, Ashutosh Pandey, Juan Azcarreta, Zhaoheng Ni, Sanjeel Parekh, Buye Xu, Romit Roy Choudhury (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24810.txt.

Description

Xu and co-authors present Uni-ArrayDPS, a diffusion refinement framework that unifies multi-channel speech enhancement and separation. Discriminative models reach high signal-to-noise ratios but can leave unnatural, distorted speech. Uni-ArrayDPS refines any such model's output with a clean speech diffusion prior. It is generative, array-agnostic, and training-free. The refined output plus the noisy mixture yield a noise spatial covariance estimate, which supplies the likelihood for diffusion posterior sampling. Experiments show it generalises across tasks, array shapes, and model backbones with no extra training.

Catalog record

CREATORZhongweiyang Xu, Ashutosh Pandey, Juan Azcarreta, Zhaoheng Ni, Sanjeel Parekh, Buye Xu, Romit Roy Choudhury
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67647
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24810

Browse the full library · About the Tower of Babel