ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior

Zhongweiyang Xu, Xulin Fan, Zhong-Qiu Wang, Xilin Jiang, Romit Roy Choudhury · 2025

Read ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior by Zhongweiyang Xu, Xulin Fan, Zhong-Qiu Wang, Xilin Jiang, Romit Roy Choudhury (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05657.txt.

Description

The authors present ArrayDPS, a method that splits mixed voices apart using only a microphone array recording. The task is blind: the room echo, the array layout, and the voices are all unknown. The method leans on a diffusion model trained on single speakers as a prior for what clean speech sounds like.

At each step, a side calculation guesses the room acoustics and how each microphone heard the sound. Those guesses steer the sampling toward voices that fit the recording. Tests show the method beats all rival unsupervised methods and nearly matches supervised ones in clarity.

Catalog record

CREATORZhongweiyang Xu, Xulin Fan, Zhong-Qiu Wang, Xilin Jiang, Romit Roy Choudhury
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05657

Browse the full library · About the Tower of Babel