On the Distribution of the Sample Covariance from a Matrix Normal Population Journal: arXiv https://arxiv.org/abs/2410.14490
Haoming Wang · 2025
Read On the Distribution of the Sample Covariance from a Matrix Normal Population Journal: arXiv https://arxiv.org/abs/2410.14490 by Haoming Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00470.txt.
Description
A 2025 arXiv research paper by Haoming Wang. This paper discusses the joint distribution of sample variances and covariances, expressed in quadratic forms in a matrix population arising in comparing the differences among groups under homogeneity of variance. One major concern of this article is to compare K K different populations, by assuming that the mean values of x 11 ( k ) , x 12 ( k ) , … , x 1 p ( k ) , x 21 ( k ) , x 22 ( k
Catalog record
| CREATOR | Haoming Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00470
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On the Distribution of the Sample Covariance from a Matrix Normal Population Journal: arXiv https://arxiv.org/abs/2410.14490 Haoming Wang Abstract This paper discusses the joint distribution of sample variances and covariances, expressed in quadratic forms in a matrix population arising in comparing the differences among groups under homogeneity of variance. One major concern of this article is to compare K K different populations, by assuming that the mean values of x 11 ( k ) , x 12 ( k ) , … , x 1 p ( k ) , x 21 ( k ) , x 22 ( k ) , … x_{11}^{(k)},x_{12}^{(k)},\dots,x_{1p}^{(k)},x_{21}^{(k)},x_{22}^{(k)},\dots , x 2 p ( k ) , … , x n 1 ( k ) , x n 2 ( k ) , … , x_{2p}^{(k)},\dots,x_{n1}^{(k)},x_{n2}^{(k)},\dots, x n p ( k ) x_{np}^{(k)} in each population are M ( k ) M^{(k)} ( n × p n\times p ), k = 1 , 2 , … , K k=1,2,\dots,K and M M ( n × p n\times p ) a fixed matrix, with this hypothesis H 0 : M ( 1 ) = M ( 2 ) = ⋯ = M ( k ) = M , H_{0}:M^{(1)}=M^{(2)}=\dots=M^{(k)}=M, when the inter-group covariances are neglected and the intra-group covariances are equal. The N N intra-group variances and 1 2 N ( N − 1 ) \frac{1}{2}N(N-1) intra-group covariances where N = n p N=np are classified into four categories T 1 T_{1} , T 1 1 2 T_{1\frac{1}{2}} , T 2 T_{2} and T 3 T_{3} according to the spectral forms of the precision matrix. The joint distribution of the sample variances and covariances is derived under these four scenarios. Besides, the moment generating function and the joint distribution of latent roots are explicitly calculated. As an application, we consider a classification problem in the discriminant analysis where the two populations should have different intra-group covariances. The distribution of the ratio of two quadratic forms is considered both in the central and non-central cases, with their exact power tabulated for different n n and p p . 2020 MSC Primary 62H10; Secondary 33B15, 33C20 1 Introduction In the early 20th century, Wishart 1928 once studied the joint distribution of sample variances and covariances, leading to the product moment distribution in independent identically distributed samples X_{1},X_{2},\dots,X_{n} from a multivariate normal population N_{p}(0,B) , where B is a p\times p real symmetric positive definite matrix. His result, for combination with Anderson 1946 to be deduced later by replacing the central mean with any non-central matrix M ( n\times p ) ( \operatorname{rank}(M)\leq 2 ), and the result in James 1955 with M at any rank, equals \displaystyle W_{p}(S;n)=\frac{1}{2^{\frac{np}{2}}\Gamma_{p}(\frac{n-1}{2})|B|^{\frac{n}{2}}}\operatorname{etr}\left(-\frac{1}{2}B^{-1}S\right)|S|^{\frac{n-p-1}{2}}\text{ when }M=0; (1.1) \displaystyle\times\operatorname{etr}\left(-\frac{1}{2}\Omega\right){}_{0}F_{1}\left(\frac{n}{2};\frac{1}{4}\Omega B^{-1}S\right)\text{ when }M\neq 0; where \Gamma_{p}(a) is the multivariate Gamma function, \operatorname{etr}(Z)=\exp\operatorname{tr}(Z) and {}_{0}F_{1}(a;Z) is the hypergeometric function in a positive constant a and a univariate matrix argument Z . In ( 1.1 ), n is the size of independent identical normally distributed samples, |S| the determinant of the symmetric matrix S=(s_{ij}) of the \frac{1}{2}p(p+1) product moment coefficients of X=[X_{1}^{\prime};X_{2}^{\prime};\dots;X_{n}^{\prime}] , and \Omega=(\omega_{ij}) the non-central parameter, \Omega=B^{-1}M^{\prime}M,\quad S=X^{\prime}X Thus, if x_{1},\dots,x_{n} are the sample values, this reduces to the constant (n-1) times Pearson’s non-central \chi^{2} -distribution \displaystyle n\bar{x} \displaystyle= \displaystyle\sum_{1}^{n}(x) \displaystyle ns^{2} \displaystyle= \displaystyle\sum_{1}^{n}(x-\bar{x})^{2} After the 1960s, various writers turned their attention to the problems that arise when samples are not independent and identically distributed, assumed in most cases for simplicity to be normal. Dawid 1977 discussed the matrix normal distribution, denoted as N_{n,p}(M;A,B) \displaystyle F_{n,p}(X)=\frac{1}{(2\pi)^{\frac{np}{2}}|A|^{\frac{p}{2}}|B|^{\frac{n}{2}}}\operatorname{etr}\left(-\frac{1}{2}B^{-1}X^{\prime}A^{-1}X\right)\text{ when }M=0; (1.2) \displaystyle\times\operatorname{etr}\left(-\frac{1}{2}B^{-1}M^{\prime}A^{-1}M\right)\operatorname{etr}\left(-B^{-1}M^{\prime}A^{-1}X\right)\text{ when }M\neq 0; where A and B are n\times n and p\times p real symmetric positive definite matrices respectively and M an arbitrary n\times p real matrix, which has been treated as a special case of the vector elliptical contoured distribution in Fang and Zhang 1990 . The quadratic form S=X^{\prime}X , by introducing a new variable X=A^{\frac{1}{2}}Y , will become \frac{1}{2}p(p+1) independent quadratic forms in Y=(y_{1},\dots,y_{p}) , \displaystyle y_{1}^{\prime}Ay_{1},y_{1}^{\prime}Ay_{2},\dots,y_{1}^{\prime}Ay_{p}, \displaystyle y_{2}^{\prime}Ay_{2},\dots,y_{2}^{\prime}Ay_{p}, \displaystyle\vdots \displaystyle y_{p}^{\prime}Ay_{p}, while the vectors y_{1},\dots,y_{p} are not independent in most cases. When M=0 , though a bit difficult, the joint distribution of sample variances and covariances, first given by Khatri 1966 , with the aid of the hypergeometric function, is \displaystyle V_{n,p}(S)=\frac{|S|^{\frac{n-p-1}{2}}\operatorname{etr}\left(-q^{-1}B^{-1}S\right)}{2^{\frac{np}{2}}\Gamma_{p}(\frac{n-1}{2})|A|^{\frac{p}{2}}|B|^{\frac{n}{2}}}{{}_{0}}F_{0}\left(I-\frac{1}{2}qA^{-1},q^{-1}B^{-1}S\right), (1.3) where q is an arbitrary positive constant. When A=I , the density ( 1.3 ) for the quadratic form reduces to the central Wishart density ( 1.1 ) based on samples from a multivariate normal population. Despite significant progress, e.g., Srivastava and Khatri 1979 , Jensen and Good 1981 , and Läuter et al. 1998 among these years, the non-central distribution for the \frac{1}{2}p(p+1) quadratic forms hasn’t been obtained yet. In modern analysis of variance, we usually want to compare the means between different groups by assuming the intra-group covariances of populations are equal and known, where the populations are assumed to be scalars or vectors. This article now seeks to move forward from vectors to matrices. Formally speaking, we may consider K different populations under homogeneity of variance, assuming that the mean values of x_{11}^{(k)},x_{12}^{(k)},\dots,x_{1p}^{(k)},x_{21}^{(k)},x_{22}^{(k)},\dots , x_{2p}^{(k)},\dots,x_{n1}^{(k)},x_{n2}^{(k)},\dots,x_{np}^{(k)} in each population are M^{(k)} ( n\times p ), k=1,2,\dots,K , have the common mean M ( n\times p ), or testing the hypothesis H_{0}:M^{(1)}=M^{(2)}=\dots=M^{(k)}=M. For example, if n=1 and we have K groups of vectors x^{(k)} with common intra-group covariances and without inter-group covariances, then the hypothesis for the mean values \mu^{(k)} of x^{(k)} , k=1,2,\dots,K , H_{0}^{\prime}:\mu^{(1)}=\mu^{(2)}=\dots=\mu^{(K)}=\mu, is widely used in the multivariate analysis of variance, by assuming normality. For K=2 and general n , now let (x_{1},x_{2},\dots,x_{p}) and (y_{1},y_{2},\dots,y_{p}) be such two different groups according to the left-spherical distribution in Fang and Zhang 1990 . There are usually \frac{1}{2}p(p+1) intra-group covariances of size n by the assumption of homogeneity of variance for each group, when the inter-group covariances are neglected, e.g., the two groups are uncorrelated. If we put x_{i}=\operatorname{Cov}(x_{i},x_{i})^{\frac{1}{2}}t_{i} and A_{ji}=\operatorname{Corr}(x_{j},x_{i})^{-1} , then this can also be visualised by the \frac{1}{2}p(p+1) quadratic forms, \displaystyle t_{1}^{\prime}t_{1},t_{1}^{\prime}A_{12}t_{2},\dots,t_{1}^{\prime}A_{1p}t_{p}, \displaystyle t_{2}^{\prime}t_{2},\dots,t_{2}^{\prime}A_{2p}t_{p}, \displaystyle\vdots \displaystyle t_{p}^{\prime}t_{p}, It so requires us to develop mathematical techniques in handling the \frac{1}{2}p(p+1) quadratic forms with possibly different coefficients. In practice, it also occurs such a problem quite often that the number of parameters to be estimated when we have no prerequisite knowledge on the normal sample is too large. For example, if the N=np values are assumed to be drawn from N distinct normal populations, there are N variances and \frac{1}{2}N(N-1) pairwise correlation coefficients or regression coefficients, giving amounts to \frac{1}{2}N(N+1) , an approximate O(N^{2}) unknown parameters. It is impossible to draw any meaningful conclusion without a reduction in parameters of the population sampled. In order to handle this problem, we introduce four covariance structures, i.e., T_{1} , T_{1\frac{1}{2}} , T_{2} , and T_{3} of a matrix population equivalent to four nested types of spectral decompositions of the precision matrix. Under these four scenarios, the non-central distribution of these \frac{1}{2}p(p+1) quadratic forms is explicitly calculated. For the population T_{3} , these results extend ( 1.3 ) and the others generalise the \frac{1}{2}p(p+1) quadratic forms to different correlation matrices. The matrix-variate analysis of variance is equivalent to the linear discriminant