Tests for the mean of high-dimensional data

Dietmar Ferger · 2026

Read Tests for the mean of high-dimensional data by Dietmar Ferger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16033.txt.

Introduction

Ferger considers testing the mean of high-dimensional data when the dimension may grow freely relative to the sample size. His test avoids inverting the covariance matrix, so it suits such wide data. He proves long-run results for fixed and growing dimension by placing observations in Hilbert space. A bootstrap version yields valid tests with no extra assumptions about the shape of the data.

Catalog record

CREATORDietmar Ferger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39092
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16033

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tests for the mean of high-dimensional data Dietmar Ferger Abstract We consider the problem of testing the mean of high-dimensional data when the dimension may grow without explicit rate restrictions relative to the sample size. The proposed procedure is based on the statistic V n = n ​ ‖ X ¯ n ‖ 2 V_{n}=n||\overline{X}_{n}||^{2} , which avoids inversion of the covariance matrix and is therefore suitable for high-dimensional settings. We establish asymptotic distributional results for both fixed and increasing dimension by embedding the observations into the Hilbert space l 2 l^{2} . Furthermore, we prove the asymptotic validity of a bootstrap approximation for the distribution of the test statistic. The resulting bootstrap test yields asymptotic level-a procedures without requiring sparsity assumptions or structural conditions on the covariance matrix. In all this, a new Central Limit Theorem in l 2 l^{2} is proving to be an extremely useful tool. MSC Classification]62H15; 62G09; 60F05; 60B12; 62E20. keywords high-dimensional data; hypothesis testing; mean vector; bootstrap; central limit theorem in Hilbert space l^{2} ; triangular arrays; asymptotic inference. pacs [ 1 Introduction The problem of testing hypotheses on high-dimensional mean vectors has attracted considerable attention in recent years, motivated by applications in fields such as genomics, finance, and signal processing. In modern data-sets, the dimension of the observations is often comparable to or larger than the sample size, which renders classical multivariate procedures unreliable. In particular, Hotelling’s T^{2} -test is no longer applicable when the sample covariance matrix becomes singular, a phenomenon that occurs as soon as the dimension exceeds the sample size. To overcome this difficulty, a large body of literature has developed alternative procedures that avoid explicit inversion of the covariance matrix. A seminal contribution is due to Bai and Saranadasa Bai , who proposed a test based on the squared Euclidean norm of the sample mean. This idea has been further developed by Chen and Qin ChenQin and many subsequent authors (e.g., Srivastava and Du SrivastavaDu , Zhang et al. Zhang ), leading to a class of L_{2} -type tests that are particularly powerful under dense alternatives. Complementary approaches are based on maximum-type statistics and multiple testing ideas, which are well suited for sparse alternatives. Notable examples include the procedures of Cai, Liu and Xia Cai and Xue and Yao XueYao , as well as higher criticism methods introduced by Donoho and Jin DonohoJin . Adaptive procedures that combine the advantages of different test statistics have also been proposed (e.g., Xu et al. Xu , He et al. He ), reflecting the fact that no single method is uniformly optimal across different alternatives. Further developments include projection-based tests that incorporate dependence structures (Lopes et al. Lopes , Thulin Thulin , Huang Huang ), as well as nonparametric and robust methods based on spatial signs, ranks, or U-statistics (Chakraborty and Chaudhuri Chakraborty , He et al. He ). Despite this diversity, most existing approaches rely on specific structural assumptions, such as sparsity, dependence patterns, or explicit growth conditions relating the dimension d to the sample size n. In contrast to these frameworks for two-sample problems, we consider for the one-sample problem an asymptotic regime in which the dimension d_{n} is allowed to diverge without imposing explicit rate conditions relative to the sample size. Our approach is based on the test statistic V_{n}:=n||\overline{X_{n}}||^{2}, which arises naturally from the Euclidean norm of the sample mean. In fixed dimension, the asymptotic distribution of V_{n} follows from the multivariate Central Limit Theorem and can be expressed as a weighted sum of independent \chi_{1}^{2} -random variables. However, this representation depends on the eigenvalues of the covariance matrix, which are typically unknown and difficult to estimate in high-dimensional settings. To overcome this difficulty, we employ bootstrap methods to approximate the distribution of the test statistic. Our analysis proceeds in two steps. First, in Lemma 1 we consider the finite-dimensional case and establish a triangular array version of the Central Limit Theorem for the statistic V_{n} . In particular, it forms the basis for subsequent results. Building on this, Theorem 1 establishes the consistency of the bootstrap approximation in fixed dimension. In a second step, we extend the analysis to the high-dimensional setting where d_{n}\rightarrow\infty. To this end, we embed the observations into the Hilbert space l^{2} and interpret the finite-dimensional vectors as truncations of an underlying infinite-dimensional random element. Within this framework, Proposition 3 establishes weak convergence of V_{n}=V_{n}(d_{n}) under suitable second-moment and covariance conditions. The key technical result is Proposition 4 , which provides a new central limit theorem for triangular arrays of l^{2} -valued random variables. This result can be viewed as a concrete and verifiable version of abstract central limit theorems for Banach space-valued random variables, tailored to the structure of l^{2} . Finally, we combine these results to establish the asymptotic validity of the bootstrap in the high-dimensional setting. This yields a practical procedure for constructing tests based on V_{n}(d_{n}) without requiring explicit estimation of the eigenvalues of the covariance operator. Our results thus provide an alternative approach to high-dimensional mean testing that avoids sparsity assumptions and explicit rate conditions, and instead exploits the underlying Hilbert space structure of the data. As for d finite (Proposition 2 ) we obtain asymptotic level- \alpha tests (Proposition 6 ). 2 The case d is finite For each n\in\mathbb{N} let X_{1},\ldots,X_{n} be independent and identically distributed (i.i.d.) random vectors in the euclidian space \mathbb{R}^{d} defined on a common probability space (\Omega,\mathcal{A},\mathbb{P}) . If \mu:=\mathbb{E}[X_{1}] , then we want to test the hypothesis H_{0}:\mu=\mu_{0} against the alternative H_{1}:\mu\neq\mu_{0} for some given \mu_{0}\in\mathbb{R}^{d} . Since \mu_{0} is known, we can w.l.o.g. assume that \mu_{0}=0 , because otherwise transform the data into the centered X_{i}-\mu_{0} . Notice that \mu=0 or \mu\neq 0 is equivalent to ||\mu||^{2}=0 or ||\mu||^{2}>0 , respectively. Here, ||x||:=\sqrt{x^{\prime}x} denotes the euclidian norm of a column-vector x\in\mathbb{R}^{d} , where the superscript \prime denotes matrix transposition. Since the arithmetic mean \overline{X}_{n}:=n^{-1}\sum_{i=1}^{n}X_{i} is an unbiased and consistent estimator for \mu , it is reasonable to reject the hypothesis H_{0} for large values of ||\overline{X}_{n}||^{2} . Assume that \mathbb{E}[||X_{1}||^{2}]<\infty. Then the multivariate Central Limit Theorem (CLT) says that under H_{0} \frac{1}{\sqrt{n}}\sum_{i=1}^{n}X_{i}\stackrel{{\scriptstyle\mathcal{D}}}{{\rightarrow}}Z\sim N(0,\Gamma)\quad\text{in }\mathbb{R}^{d}, (1) where \Gamma=\text{Cov}(X_{1}) is the covariance matrix of X_{1} . Thus V_{n}:=n||\overline{X_{n}}||^{2}=||\frac{1}{\sqrt{n}}\sum_{i=1}^{n}X_{i}||^{2}\stackrel{{\scriptstyle\mathcal{D}}}{{\rightarrow}}||Z||^{2}=:V (2) by continuity of the norm ||\cdot|| and the Continuous Mapping Theorem (CMT). As to the limit variable V in ( 2 ) it is well known that V\stackrel{{\scriptstyle\mathcal{D}}}{{=}}\sum_{i=1}^{d}\lambda_{i}N_{i}^{2}, where \lambda_{1},\ldots,\lambda_{d} are the eigenvalues of \Gamma and N_{1},\ldots,N_{d} are i.i.d. standard normal random variables. In particular, the distribution function F of V is continuous. Therefore, by Pólya’s theorem the distributional convergence ( 2 ) is equivalent to \sup_{x\in\mathbb{R}}|\mathbb{P}(V_{n}\leq x)-F(x)|\rightarrow 0,\;n\rightarrow\infty. (3) Now, we reject H_{0} , if V_{n}>c_{\alpha} , where c_{\alpha} is the (1-\alpha) -quantile of F with \alpha\in(0,1) . It follows from ( 2 ) and continuity of F that this is an asymptotic level- \alpha test. Even though we have a nice representation of the limit variable V it is unknown to the statistician. One obvious way would be to estimate the unknown covariance matrix \Gamma by the sample covariance matrix, say \Gamma_{n} , and then approximate the \lambda_{i} by the eigenvalues \lambda_{n,i} of \Gamma_{n} . This leads to \sum_{i=}^{d}\lambda_{n,i}N_{i}^{2} and the

Read the complete text