Fast Multichannel NMF with Block-Diagonal Spatial Covariance Matrices for Efficient Blind Source Separation Using Distributed Microphone Arrays
\authorblockN Hirotaka Nishikori \authorrefmark 1, Nobutaka Ito \authorrefmark 2, Kouei Yamaoka \authorrefmark 1, Norihiro Takamune \authorrefmark 1, and Hiroshi Saruwatari \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Tokyo, Tokyo, Japan \authorblockA \authorrefmark 2 The National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan · 2026
Read Fast Multichannel NMF with Block-Diagonal Spatial Covariance Matrices for Efficient Blind Source Separation Using Distributed Microphone Arrays by \authorblockN Hirotaka Nishikori \authorrefmark 1, Nobutaka Ito \authorrefmark 2, Kouei Yamaoka \authorrefmark 1, Norihiro Takamune \authorrefmark 1, and Hiroshi Saruwatari \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Tokyo, Tokyo, Japan \authorblockA \authorrefmark 2 The National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19388.txt.
Introduction
Nishikori and colleagues speed up blind source separation for microphone networks spread over a wide area. Running fast multichannel matrix math across every mic at once demands repeated inversions of huge matrices, while using one subarray wastes the rest. Their shared version forces a block shape on spatial spread patterns, so inversions stay inside subarrays while a shared sound-pattern model pools source activity. In quiet synced tests it ran faster than the full method, beat the single-subarray version on sound quality, and handled five sources.
Catalog record
| CREATOR | \authorblockN Hirotaka Nishikori \authorrefmark 1, Nobutaka Ito \authorrefmark 2, Kouei Yamaoka \authorrefmark 1, Norihiro Takamune \authorrefmark 1, and Hiroshi Saruwatari \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Tokyo, Tokyo, Japan \authorblockA \authorrefmark 2 The National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33435 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19388
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast Multichannel NMF with Block-Diagonal Spatial Covariance Matrices for Efficient Blind Source Separation Using Distributed Microphone Arrays \authorblockN Hirotaka Nishikori \authorrefmark 1, Nobutaka Ito \authorrefmark 2, Kouei Yamaoka \authorrefmark 1, Norihiro Takamune \authorrefmark 1, and Hiroshi Saruwatari \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Tokyo, Tokyo, Japan \authorblockA \authorrefmark 2 The National Institute of Advanced Industrial Science and Technology (AIST), Tokyo, Japan Abstract Distributed microphone arrays composed of multiple subarrays enable blind source separation over a wide spatial area. Directly applying fast multichannel nonnegative matrix factorization (FastMNMF) to all subarrays can exploit observations from all subarrays, but it requires repeated inversions of large matrices spanning all microphones, causing the computational cost to increase rapidly as the number of microphones grows. In contrast, applying FastMNMF to one subarray reduces the matrix size but cannot exploit observations from other subarrays. We propose distributed FastMNMF , which imposes a block-diagonal structure on the source spatial covariance matrices, so that matrix inversions are performed within subarrays. The NMF-based source spectrogram model is shared across subarrays, allowing the method to aggregate source activity information while discarding inter-subarray covariance. In synchronized, noiseless simulations with fixed room and array/source geometry, the method required less computation time than conventional FastMNMF using all subarrays, achieved a higher average source-to-distortion ratio than conventional FastMNMF using one subarray, and was applicable in the tested five-source condition, where each four-microphone subarray was locally underdetermined. † † footnotetext: This work was supported by JSPS KAKENHI Grant Numbers 24K23854, 25K21220 and 21H05054. {IEEEkeywords} Distributed microphone arrays, acoustic sensor network, blind source separation, fast multichannel nonnegative matrix factorization. 1 Introduction Blind source separation (BSS) [ 9 ] aims to separate source signals from observed mixtures without detailed prior information. Independent vector analysis (IVA) [ 2 , 6 ] and independent low-rank matrix analysis (ILRMA) [ 8 ] are efficient in determined or overdetermined conditions, where microphones are at least as many as sources. However, they are generally not applicable to underdetermined mixtures, where there are more sources than microphones, and are not well suited to modeling diffuse noise. Multichannel nonnegative matrix factorization (MNMF) [ 12 , 14 ] can handle underdetermined conditions and model diffuse noise by using full-rank spatial covariance matrices (SCMs), but requires repeated matrix inversions, which are extremely costly. FastMNMF [ 4 , 15 , 3 ] reduces this cost while maintaining separation performance comparable to that of MNMF by assuming jointly diagonalizable SCMs. While conventional array signal processing typically assumes a single compact array, distributed arrays enable BSS over a wide area using spatially separated microphones or subarrays, but practical use requires synchronization/calibration [ 10 ] and often microphone clustering [ 7 ] . Moreover, designing BSS algorithms for distributed arrays is itself challenging because such algorithms must exploit information across many subarrays while remaining robust to less reliable inter-subarray phase relations and avoiding prohibitive computational cost as the number of microphones grows [ 16 , 19 ] . Here we focus on reducing the computational cost of distributed-array BSS under the assumption that synchronization/calibration and microphone clustering have been addressed. In this paper, “distributed” refers to the array geometry composed of spatially separated subarrays. The proposed algorithm is not a decentralized one with explicit communication constraints but a centralized one using observations from all subarrays. Evaluating the proposed BSS method under synchronization/calibration errors and extending it to joint microphone clustering are left for future work. To reduce the computational cost of distributed-array BSS, we propose distributed FastMNMF by imposing a block-diagonal structure on the source SCMs, where each block corresponds to one subarray. A naive extension of FastMNMF is to process all subarrays jointly as a single large array, which can exploit information across subarrays but incurs rapidly increasing computational cost as the number of microphones grows. Another option is to process only one subarray, which is computationally efficient but yields limited separation performance because it cannot exploit information from other subarrays. Unlike FastMNMF using all subarrays, the proposed method performs joint diagonalization within each subarray, reducing the sizes of the matrices to be diagonalized/inverted. Unlike FastMNMF using one subarray, it shares the source spectrograms across subarrays, thereby aggregating source spectrogram information while discarding inter-subarray covariance. The goal is not to outperform FastMNMF using all subarrays, but to provide a computationally efficient intermediate model between FastMNMF using all subarrays and that using one subarray. Compared with distributed MNMF-based methods [ 16 ] , the proposed method uses joint diagonalizability and block-diagonality for efficiency. Unlike decentralized IVA [ 19 ] , it can handle locally underdetermined subarrays, and unlike transfer-function-gain NMF [ 17 , 1 ] , it can exploit within-subarray phase information. 2 Preliminaries 2.1 FastMNMF [ 4 , 15 , 3 ] Suppose N source signals are mixed and observed by M microphones. Here, m\in\{1,\dots,M\} and n\in\{1,\dots,N\} denote the microphone and source indices, respectively. Let \bm{x}_{ij}=(x_{ij1},\dots,x_{ijM})^{\mathsf{T}}\in\mathbb{C}^{M} denote the short-time Fourier transform (STFT) coefficients of the observed signals, where i\in\{1,\dots,I\} and j\in\{1,\dots,J\} are the frequency-bin and time-frame indices, respectively, and \cdot^{\mathsf{T}} represents the transpose. In addition, \cdot^{\mathsf{H}} , \det , and \ln denote the Hermitian transpose, determinant, and natural logarithm, respectively. \bm{x}_{ij} is modeled as the sum of source images \bm{c}_{ijn} , each of which represents the contribution of a source to all microphones. Assuming that each \bm{c}_{ijn} follows a multivariate complex Gaussian distribution with zero mean and covariance matrix h_{ijn}\bm{R}_{in} and that \{\bm{c}_{ijn}\}_{n} are mutually statistically independent, the closure property of the multivariate complex Gaussian distribution yields the generative model of \bm{x}_{ij} : \displaystyle p(\bm{x}_{ij}) \displaystyle=\mathcal{N}_{\mathbb{C}}\bigg(\bm{x}_{ij};\bm{0},\sum_{n}h_{ijn}\bm{R}_{in}\bigg). (1) Here, h_{ijn}\in\mathbb{R}_{\geq 0} and \bm{R}_{in}\in\mathbb{S}^{M}_{+} denote the source spectrogram and the SCM of each source, respectively. \mathbb{R}_{\geq 0} is the set of nonnegative real numbers and \mathbb{S}^{M}_{+} is the set of M\times M complex Hermitian positive semidefinite matrices. Note that the observation covariance matrix \sum_{n}h_{ijn}\bm{R}_{in} is assumed to be positive definite so that ( 1 ) is well-defined. Furthermore, h_{ijn} is modeled using the NMF model \displaystyle h_{ijn}=\sum_{k}t_{ikn}v_{kjn}, (2) where t_{ikn},v_{kjn}\in\mathbb{R}_{\geq 0} denote the spectral basis and its temporal activation, respectively, and k\in\{1,\dots,K\} is the basis index. MNMF [ 14 ] does not impose a particular constraint on \bm{R}_{in} , whereas FastMNMF assumes joint diagonalizability of \bm{R}_{in} across all sources to reduce computational cost: \bm{W}_{i}^{\mathsf{H}}\bm{R}_{in}\bm{W}_{i}=\bm{\Lambda}_{in},\qquad\forall n=1,\dots,N, (3) where \bm{W}_{i}=(\bm{w}_{i1},\dots,\bm{w}_{iM})\in\mathbb{C}^{M\times M} is a nonsingular transformation matrix and \bm{\Lambda}_{in}\in\mathbb{S}^{M}_{+} is diagonal. Then, \bm{y}_{ij}=\bm{W}_{i}^{\mathsf{H}}\bm{x}_{ij} follows a multivariate complex Gaussian distribution with zero mean and covariance matrix \sum_{n}h_{ijn}\bm{\Lambda}_{in} . Since \bm{W}_{i} decorrelates the observed signals, we call \bm{y}_{ij}=(y_{ij1},\dots,y_{ijM})^{\mathsf{T}}\in\mathbb{C}^{M} the decorrelated observed signals. The negative log-likelihood up to an additive constant is \displaystyle\sum_{i,j,m}\biggl(\frac{\lvert y_{ijm}\rvert^{2}}{\sum_{k,n}t_{ikn}v_{kjn}[\bm{\Lambda}_{in}]_{mm}}+\ln\sum_{k,n}t_{ikn}v_{kjn}[\bm{\Lambda}_{in}]_{mm}\biggr) (4) \displaystyle-\sum_{i}J\ln\lvert\det\bm{W}_{i}\rvert^{2}, where [\bm{\Lambda}_{in}]_{mm} denotes the (m,m) th element of \bm{\Lambda}_{in} . Sekiguchi et al. [ 15 ] proposed update rules based on iterative projection (IP) [ 11 ] and majorization-minimization (MM) algorithm, which guarantee a monotonic non-increase of ( 4 ). The update rules for \bm{W}_{i} based on IP are \!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\bm{Q}_{im}\leftarrow\frac{1}{J}\sum_{j}\eta_{ijm}^{-1}\bm{x}_{ij}\bm{x}_{ij}^{\mathsf{H}}, (5) \!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\!\bm{w}_{im}\leftarrow\left(\bm{W}_{i}^{\mathsf{H}}\bm{Q}_{im}\right)^{-1}\bm{e}_{m}, (6) \bm{w}_{im}\leftarrow\bm{w}_{im}\left(\bm{w}_{im}^{\mathsf{H}}\bm{Q}_{im}\bm{w}_{im}\right)^{-\frac{1}{2}}, (7) where \bm{e}_{m}\in\mathbb{R}^{M} denotes the m th column vector of the M -dimensional identity matrix and \eta_{ijm}=\sum_{k,n}t_{ikn}v_{kjn}[\bm{\Lambda}_{in}]_{mm} . The update rules for t_{ikn} , v_{kjn} , and [\bm{\Lambda}_{in}]_{mm} based on the MM algorithm are \quad\quad\,t_{ikn}\leftarrow t_{ikn}\sqrt{\frac{\sum_{j,m}v_{kjn}[\bm{\Lambda}_{in}]_{mm}\lvert y_{ijm}\rvert^{2}\eta_{ijm}^{-2}}{\sum_{j,m}v_{kjn}[\bm{\Lambda}_{in}]_{mm}\eta_{ijm}^{-1}}},\\ (8) \quad\>\>\>\;v_{kjn}\leftarrow v_{kjn}\sqrt{\frac{\sum_{i,m}t_{ikn}[\bm{\Lambda}_{in}]_{mm}\lvert y_{ijm}\rvert^{2}\eta_{ijm}^{-2}}{\sum_{i,m}t_{ikn}[\bm{\Lambda}_{in}]_{mm}\eta_{ijm}^{-1}}},\\ (9) [\bm{\Lambda}_{in}]_{mm}\leftarrow[\bm{\Lambda}_{in}]_{mm}\sqrt{\frac{\sum_{j,k}t_{ikn}v_{kjn}\lvert y_{ijm}\rvert^{2}\eta_{ijm}^{-2}}{\sum_{j,k}t_{ikn}v_{kjn}\eta_{ijm}^{-1}}}. (10) Here, \eta_{ijm} is updated after every update in ( 8 )–(