Two statistical problems for multivariate mixture distributions
Fraiman Ricardo, Moreno Leonardo, Ransford Thomas · 2025
Read Two statistical problems for multivariate mixture distributions by Fraiman Ricardo, Moreno Leonardo, Ransford Thomas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12147.txt.
Introduction
Ricardo Fraiman, Leonardo Moreno, and Thomas Ransford take up two problems about mixture distributions in this 2025 statistics paper. The first is estimating mixtures of multivariate normal distributions, and of t-distributions, from one dimensional projections of the data. The second is measuring how far apart two clusterings are by comparing the mixture distributions fitted to each.
Their approach rests on earlier work with a neat trick. Such mixtures can be told apart by projecting them onto a fixed finite set of lines. The number of lines depends only on how many components are involved and on the dimension. The authors give algorithms for both tasks, compare them with robust versions of the expectation maximization method, and test the methods in simulations.
Catalog record
| CREATOR | Fraiman Ricardo, Moreno Leonardo, Ransford Thomas |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-12147
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Two statistical problems for multivariate mixture distributions Fraiman Ricardo, Moreno Leonardo, Ransford Thomas Abstract We address two important statistical problems: that of estimating mixtures of multivariate normal distributions and mixtures of t t -distributions based on univariate projections, and that of quantifying a discrepancy between mixture distributions induced by two model-based clusterings. In the second problem, rather than introducing a direct metric on partitions, we propose a model-based distributional discrepancy between the fitted mixture distributions associated with two clusterings. The results are based on an earlier work of the authors, where it was shown that mixtures of multivariate Gaussian or t t -distributions can be distinguished by projecting them onto a certain predetermined finite set of lines, the number of lines depending only on the total number of distributions involved and on the ambient dimension. We also compare our proposal with robust versions of the expectation-maximization method EM. In each case, we present algorithms for effecting the task, and compare them with existing methods by carrying out some simulations. keywords clustering, Gaussian distribution, identifiability, mixture, projection, t -distribution † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. 1 Introduction 1.1 Random projections in statistics Random-projection (RP) techniques have become a cornerstone in high-dimensional statistical analysis. Over the last two decades, the theoretical and applied developments of RP have flourished. Early applications emphasized computational efficiency and scalability, particularly for clustering and matrix approximations ( Bingham and Mannila, 2001 ; Halko et al., 2011 ) . The work presented in ( Achlioptas, 2001 ) introduced more efficient sparse and structured random matrices, which proved crucial for large-scale implementations. The best-known method for applications involving random projections is the one based on the Johnson–Lindenstrauss lemma, which has numerous applications, especially in image processing. Although there are many other proposals based on RP, in what follows we will briefly describe the Johnson–Lindenstrauss approach below and then focus solely on methods based on extensions of the Cramér–Wold theorem. We will describe each of them in more detail below. 1.1.1 RP via the Johnson–Lindenstrauss lemma This lemma can be stated as follows. Lemma (Johnson–Lindenstrauss lemma, ( Johnson and Lindenstrauss, 1984 ) ). Let \aleph_{n} be a set of n points in \mathbb{R}^{d} , let 0<\epsilon<1 and let q>(8\log n)/\epsilon^{2} . Then there exists a linear map f:\mathbb{R}^{d}\to\mathbb{R}^{q} such that, for all u,v\in\aleph_{n} , (1-\epsilon)\|u-v\|^{2}\leq\|f(u)-f(v)\|^{2}\leq(1+\epsilon)\|u-v\|^{2}. (1) Thus any set of points in high-dimensional Euclidean space can be linearly embedded into a much lower-dimensional space such that pairwise distances are approximately preserved. This result lays the theoretical foundation for the widespread application of RP in modern data science and machine learning. A natural question that arises is how to find the linear map f . Dasgupta and Gupta ( Dasgupta and Gupta, 2003 ) propose a solution based on the following result, which allows us to find f in randomized polynomial time. Theorem 1 (Dasgupta–Gupta ( Dasgupta and Gupta, 2003 ) ) . Let \aleph_{n} and \epsilon be as in Theorem 1 , and let q>(4\log n)/(\epsilon^{2}/2-\epsilon^{3}/3) . Define f(u):=\sqrt{(d/q)}PUu , where U is a d\times d unitary matrix whose columns are iid (independent and identically distributed) random vectors uniformly distributed on the unit sphere in \mathbb{R}^{d} , and P:\mathbb{R}^{d}\to\mathbb{R}^{q} denotes the projection onto the first q coordinates. Then \mathbb{P}\Bigl((1-\epsilon)\|u-v\|^{2}\leq\|f(u)-f(v)\|^{2}\leq(1+\epsilon)\|u-v\|^{2})~\forall u,v\in\aleph_{n}\Bigr)\geq 1/n. Recent studies continue to build on the Johnson–Lindenstrauss lemma, investigating its application in modern contexts, for example, as a method for dimensionality reduction ( Dasgupta, 2013 ) , particularly in machine-learning applications, in high-dimensional clustering, and nearest neighbor search. These studies demonstrate how RP can preserve important properties in high-dimensional spaces while dramatically reducing the computational complexity of various algorithms. A nice property of the inequality ( 1 ) is that it does not depend on the dimension d . However, if \epsilon is small then q becomes very large. 1.1.2 RP via the Cramér–Wold theorem A more recent and statistically grounded direction emerged in the work of Cuesta, Fraiman and Ransford ( Cuesta-Albertos et al., 2007 ) , based on extensions of the Cramér–Wold theorem. In its original form, established in ( Cramér and Wold, 1936 ) , the Cramér–Wold theorem says that a multivariate distribution is uniquely determined by its one-dimensional projections. Subsequent work of Rényi ( Rényi, 1952 ) , Gilbert ( Gilbert, 1955 ) , Bélisle–Massé–Ransford ( Bélisle et al., 1997 ) and Cuesta–Fraiman–Ransford ( Cuesta-Albertos et al., 2007 ) showed that, under appropriate assumptions on the growth of its moments, a multivariate distribution is determined by a ‘sufficiently rich’ set of lower-dimensional projections, thereby allowing it to be determined from random projections onto low-dimensional subspaces. Here is one such result. In what follows, given a Borel probability measure P on \mathbb{R}^{d} and a vector subspace H of \mathbb{R}^{d} , we denote by P_{H} the projection of P onto H , defined as the Borel probability measure on H given by P_{H}(B):=P(\pi_{H}^{-1}(B)), where \pi_{H}:\mathbb{R}^{d}\to H is the orthogonal projection of \mathbb{R}^{d} onto H . Also, if x\in\mathbb{R}^{d} , then \langle x\rangle denotes the vector subspace spanned by x . Theorem 2 (Cuesta–Fraiman–Ransford ( Cuesta-Albertos et al., 2007 , Corollary 3.2) ) . Let P and Q be Borel probability measures on \mathbb{R}^{d} , where d\geq 2 . Assume that: (i) the absolute moments m_{n}=\int\|x\|^{n}\,dP(x) are finite and satisfy the condition \sum_{n=1}^{\infty}m_{n}^{-1/n}=\infty ; (ii) the set \{x\in\mathbb{R}^{d}:P_{\langle x\rangle}=Q_{\langle x\rangle}\} is of positive Lebesgue measure. Then P=Q. Cuesta–Fraiman–Ransford focused on using RP not only as a computational tool but as a vehicle for inferring robust statistical structure. In particular, they demonstrated how statistical procedures random-projection tests can preserve desirable properties such as consistency and robustness while remaining computationally feasible. This line of work differs fundamentally from algorithmic RP approaches. Rather than using RP solely for dimensionality reduction, Cuesta, Fraiman and their collaborators exploit the probabilistic distribution of projections to characterize centrality, perform goodness-of-fit tests ( Cuesta-Albertos et al., 2007 ) , depth measure ( Cuevas et al., 2007 ) , detect outliers ( Navarro-Esteban and Cuesta-Albertos, 2021 ) , and hypothesis tests ( Fraiman et al., 2017 ) . For example, in their framework, distributions are projected onto randomly chosen lines, and classical univariate techniques are applied. Repeating this process over multiple projections yields statistical conclusions that are consistent with high-dimensional structures. These methods have inspired extensions in several applied domains. For instance, random-projection depth was later adapted to functional data analysis, see ( Cuevas and Fraiman, 2009 ) and ( Cuesta-Albertos and Febrero-Bande, 2010 ) . The article ( Nieto-Reyes et al., 2014 ) proposes tests for functional data using projections, while ( Bali et al., 2011 ) explores robust estimators via projection-pursuit methods. These studies reinforce the versatility of random projections as not only an algorithmic trick but a robust statistical principle. Moreover, this framework aligns conceptually with the work of ( Donoho and Tanner, 2009 ) , which emphasized the geometric underpinnings of high-dimensional phenomena, although the focus in ( Donoho and Tanner, 2009 ) is often more combinatorial. In contrast to mainstream applications of random projection, such as kernel approximation or compressed sensing, the approach developed in ( Cuesta-Albertos et al., 2006 ; Cuesta-Albertos et al., 2007 ) is