cSTMM: A Unified Complex Spherical Student’s t t Mixture Model for Directional Statistics in Mask-Based Blind Speech Separation
2026
Read cSTMM: A Unified Complex Spherical Student’s t t Mixture Model for Directional Statistics in Mask-Based Blind Speech Separation (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25512.txt.
Introduction
Nobutaka Ito unifies directional models for blind speech separation in one complex spherical Student's t mixture model. Existing angular models are defined separately, making density-shape effects hard to isolate. His cSTMM connects the angular Gaussian, Bingham, and Watson mixtures through freedom and eigenvalue constraints, with an expectation-maximization framework. On reverberated LibriSpeech mixtures, a freedom value of 1 beat the equivalent choice in all 18 conditions, gaining 0.25 decibels on average. It reduces to the angular Gaussian mixture at matched freedom and approaches Bingham and Watson mixtures at large values.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18444 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25512
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
cSTMM: A Unified Complex Spherical Student’s t t Mixture Model for Directional Statistics in Mask-Based Blind Speech Separation Abstract Mask-based blind speech separation (BSS) estimates source-wise time–frequency (TF) masks by clustering multichannel observations using spatial information. The directional statistical approach clusters normalized multichannel observations on the complex unit sphere, without explicitly extracting phase and level difference features based on the plane-wave or spherical-wave assumptions. However, prior studies have mostly compared a small number of separately defined directional statistical mixture models, whereas a broader distribution family would enable a more systematic study of how density profiles affect separation performance. We propose the complex spherical Student’s t t mixture model (cSTMM), a directional mixture model that connects the complex angular central Gaussian mixture model (cACGMM), complex Bingham mixture model (cBMM), and complex Watson mixture model (cWMM) through the degrees-of-freedom parameter ν \nu . We also derive a generalized minorization-maximization (MM) based procedure for parameter estimation. A no-restart evaluation on noise-free LibriSpeech mixtures reverberated with measured room impulse responses shows that a single development-selected value ν ∗ = 1 \nu^{\ast}=1 achieved higher test-set mean signal-to-distortion ratio improvements (SDRi) than the cACGMM-equivalent setting ν = M \nu=M in all acoustic conditions, with an average condition-wise gain of 0.25 dB. The experiments also numerically verify that the proposed formulation numerically recovers the cACGMM, cBMM, and cWMM cases. Index Terms — Blind speech separation, directional statistics, clustering, complex spherical t distribution, microphone array signal processing. 1 Introduction TF masks are a fundamental intermediate representation in speech processing, and widely used in speech separation and enhancement [ 1 , 2 , 3 , 4 , 8 , 9 , 5 , 6 , 7 , 10 , 11 , 12 ] . They are either applied directly to the mixtures in the TF domain [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] , or used to estimate spatial covariance matrices for designing a beamformer [ 8 , 9 , 10 , 11 , 12 ] . Approaches to mask estimation can be broadly divided into fully supervised learning with deep neural networks (DNNs) [ 7 , 9 ] and recording-adaptive estimation with spatial mixture models [ 1 , 2 , 3 , 4 , 5 , 6 , 8 , 10 , 11 , 12 ] . The latter is particularly important because reliable training data for supervised learning are often difficult to collect. For example, in meeting transcription front ends [ 10 , 11 , 12 ] , ground-truth clean speech signals are rarely available, and realistically simulating meeting recordings is challenging. Within recording-adaptive spatial modeling, directional statistical mixture models operate directly on normalized multichannel observations on the complex unit sphere, without extracting phase and level difference features that rely on the plane-wave or spherical-wave assumptions. The cWMM represents each source by a unit-norm orientation vector and imposes tied dispersion across the non-principal directions [ 3 , 13 ] . The cBMM generalizes the cWMM by using a Hermitian parameter matrix, allowing anisotropic distributions on the complex unit sphere [ 5 , 14 ] . In contrast, the cACGMM has a density proportional to a negative power of a quadratic form [ 6 , 15 ] , instead of the exponential of a quadratic form in the cWMM and cBMM. Experimental comparisons have shown that the cACGMM yields higher separation performance than the cWMM and cBMM [ 6 ] . Moreover, cACGMM-based guided source separation (GSS) has been adopted in the top-performing systems and official baseline systems in CHiME meeting transcription tasks [ 10 , 11 , 12 ] . However, prior studies have mostly compared a small number of separately defined directional statistical mixture models, leaving a broader class of distributions insufficiently explored. We introduce the cSTMM, a unified framework encompassing the cACGMM, cBMM, and cWMM as special or limiting cases. Specifically, the cACGMM appears at \nu=M after reparameterizing the precision matrix, the cBMM appears as \nu\to\infty , and a Watson-constrained case with tied nonprincipal eigenvalues becomes the cWMM as \nu\to\infty . We derive a generalized MM-based procedure with exact mixture weight and eigenvector updates and a high concentration approximation (HCA) for the eigenvalue update. The proposed framework enables the density profile of normalized complex observations to be varied within a single maximum-likelihood mask estimation framework, rather than choosing among separately defined directional mixture models. 2 Preliminaries 2.1 Mask estimation with directional statistics Let \bm{y}_{tf}\in\mathbb{C}^{M} be the short-time Fourier transform (STFT) coefficients of multichannel observation at frame t and frequency bin f , where M is the number of microphones. The cSTMM in this paper uses the normalized observation \bm{z}_{tf}=\frac{\bm{y}_{tf}}{\|\bm{y}_{tf}\|_{2}},\hskip 9.24994pt\mathcal{T}_{f}=\{t\mid\|\bm{y}_{tf}\|_{2}\geq\varepsilon\}, (1) where \mathcal{T}_{f} is the set of valid TF bins at frequency bin f . Let s^{(n)}_{tf} be the n th source signal in the STFT domain and \bm{h}^{(n)}_{f} the transfer function from the n th source to the microphones. Under the usual dominant source approximation, \bm{y}_{tf}\approx\bm{h}_{f}^{(n)}s_{tf}^{(n)} (2) when source n dominates the TF bin, so \bm{z}_{tf} is mainly determined by the transfer function vector of the dominant source. Let d_{tf} be the index of the dominant source at frame t and frequency bin f . A frequency-wise mixture model is p(\bm{z}_{tf};\Theta_{f})=\sum_{n=1}^{N}w_{f}^{(n)}p(\bm{z}_{tf}\mid d_{tf}=n;\Theta_{f}), (3) where mixture weights w_{f}^{(n)} satisfy w_{f}^{(n)}\geq 0 and \sum_{n}w_{f}^{(n)}=1 , and \Theta_{f} is the set of parameters at frequency bin f . The posterior probability \gamma_{tf}^{(n)}=\frac{w_{f}^{(n)}p(\bm{z}_{tf}\mid d_{tf}=n;\Theta_{f})}{\sum_{n^{\prime}}w_{f}^{(n^{\prime})}p(\bm{z}_{tf}\mid d_{tf}=n^{\prime};\Theta_{f})} (4) is used as the soft mask. Since the model is fitted independently at each frequency, permutation alignment is applied afterward [ 4 ] . 2.2 Established probability models The cWMM uses the complex Watson density [ 13 ] p(\bm{z})\propto\exp(\kappa|\bm{a}^{\mathrm{H}}\bm{z}|^{2}) (5) with \|\bm{a}\|_{2}=1 and \kappa\geq 0 . The cBMM uses the complex Bingham density [ 14 ] p(\bm{z})\propto\exp(\bm{z}^{\mathrm{H}}\bm{A}\bm{z}), (6) where \bm{A} is Hermitian. The cACGMM uses the complex angular central Gaussian density [ 15 ] p(\bm{z})\propto(\bm{z}^{\mathrm{H}}\bm{P}\bm{z})^{-M}, (7) where \bm{P}\succ\bm{O} is scale-invariant. These models differ not only in isotropy but also in how their densities decay away from high-probability directions. The role of the cSTMM is to place these choices in one distribution family and to allow \nu to vary the shape of that family. 3 Proposed method 3.1 Full cSTMM and relation to the cACGMM and cBMM For each frequency and source, the cSTMM uses a mixture weight w_{f}^{(n)} and a Hermitian matrix \bm{A}_{f}^{(n)} . On the complex unit sphere, the component density is given by [ 16 ] p(\bm{z}\mid\bm{A},\nu)=C(\bm{A},\nu)\left(1-\frac{2}{\nu}\bm{z}^{\mathrm{H}}\bm{A}\bm{z}\right)^{-(\nu+M)/2}, (8) with \lambda_{\max}(\bm{A})<\frac{\nu}{2}. (9) Because \|\bm{z}\|_{2}=1 , \bm{A} and (\bm{A}-a\bm{I})/(1-2a/\nu) define the same normalized density for any a<\nu/2 . We therefore use the representation in which the largest eigenvalue of \bm{A} is zero. The exact normalizer C(\bm{A},\nu) is expressed by a Gauss hypergeometric function of matrix argument [ 17 ] . In implementation, we evaluate the analytically equivalent simplex integral, with a hypergeometric series fallback. The family contains the established models. As \nu\to\infty , ( 8 ) tends to the complex Bingham density ( 6 ). If \nu=M and \bm{P}=\bm{I}-2\bm{A}/M\succ\bm{O} , ( 8 ) becomes the cACG density ( 7 ) up to scale invariance. 3.2 Degenerate eigenvalue case and relation to the cWMM The Watson-type case is obtained by starting from a positive semidefinite matrix of rank at most one before the above reparameterization.