ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior
Zhongweiyang Xu, Xulin Fan, Zhong-Qiu Wang, Xilin Jiang, Romit Roy Choudhury · 2025
Read ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior by Zhongweiyang Xu, Xulin Fan, Zhong-Qiu Wang, Xilin Jiang, Romit Roy Choudhury (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05657.txt.
Description
The authors present ArrayDPS, a method that splits mixed voices apart using only a microphone array recording. The task is blind: the room echo, the array layout, and the voices are all unknown. The method leans on a diffusion model trained on single speakers as a prior for what clean speech sounds like.
At each step, a side calculation guesses the room acoustics and how each microphone heard the sound. Those guesses steer the sampling toward voices that fit the recording. Tests show the method beats all rival unsupervised methods and nearly matches supervised ones in clarity.
Catalog record
| CREATOR | Zhongweiyang Xu, Xulin Fan, Zhong-Qiu Wang, Xilin Jiang, Romit Roy Choudhury |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 102 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-05657