Rank-based Maxsum test for high dimensional regression coefficient
Ping Zhao a , Liangliang Yuan b,c a School of Mathematical Science, Tiangong University, China b School of Mathematics and Statistics, Nanjing University of Science and Technology, China c School of Statistics and Data Science, LEBPS, KLMDASR, and LPMC, Nankai University, China · 2026
Read Rank-based Maxsum test for high dimensional regression coefficient by Ping Zhao a , Liangliang Yuan b,c a School of Mathematical Science, Tiangong University, China b School of Mathematics and Statistics, Nanjing University of Science and Technology, China c School of Statistics and Data Science, LEBPS, KLMDASR, and LPMC, Nankai University, China (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14231.txt.
Introduction
Zhao and Yuan build rank-based maxsum tests for regression coefficients in high-dimensional linear models. Sum-type tests catch dense signals, max-type tests catch sparse ones, and users rarely know which case they face. Heavy-tailed errors break many standard tools. The authors prove that their rank sum and max statistics become independent under the null. That fact supports two adaptive tests that merge p-values by the Cauchy method. Simulations show sound size control and strong power across error shapes.
Catalog record
| CREATOR | Ping Zhao a , Liangliang Yuan b,c a School of Mathematical Science, Tiangong University, China b School of Mathematics and Statistics, Nanjing University of Science and Technology, China c School of Statistics and Data Science, LEBPS, KLMDASR, and LPMC, Nankai University, China |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33682 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.14231
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rank-based Maxsum test for high dimensional regression coefficient Ping Zhao a , Liangliang Yuan b,c a School of Mathematical Science, Tiangong University, China b School of Mathematics and Statistics, Nanjing University of Science and Technology, China c School of Statistics and Data Science, LEBPS, KLMDASR, and LPMC, Nankai University, China Abstract We study global inference for regression coefficients in high-dimensional linear models under potentially heavy-tailed errors. While sum-type tests are powerful for dense alternatives and max-type tests excel for sparse alternatives, practical applications rarely reveal the sparsity level, and many existing procedures rely on light-tail assumptions. Motivated by the Wilcoxon-score sum test of 8 and the two Wilcoxon-score maximum tests of 20 , we establish under H 0 H_{0} the asymptotic independence between the rank-based sum statistic and each max statistic. These joint limit results justify principled p p -value aggregation, and we propose two adaptive rank-based maxsum tests via the Cauchy combination method ( 15 ) . The proposed procedures inherit robustness from rank-based construction and adaptivity from combining dense- and sparse-sensitive components. Simulation studies confirm accurate size control and strong power across a wide range of error distributions and sparsity regimes. Keywords : Cauchy combination test; High dimensional data; Maxsum test; Rank-based test; Wilcoxon score test. 1 Introduction High-dimensional linear regression has become a basic modeling tool across modern data-driven sciences, where the number of covariates can be comparable to or far larger than the sample size. Typical examples include large-scale genetic association studies and genotype–phenotype mapping ( 5 ; 2 ; 7 ) , high-throughput gene expression and pathway analysis ( 18 ; 19 ) , and data-rich problems in drug discovery and bioavailability prediction ( 13 ; 17 ) . In such applications, a fundamental inferential task is to test whether the covariates collectively contribute to the response, namely the global hypothesis H_{0}:\bm{\beta}=\bm{0} in the high-dimensional linear model. Reliable global testing procedures are essential not only for scientific discovery but also for downstream procedures such as screening, model building, and resource allocation. A natural starting point is to generalize the classical low-dimensional F -test to high dimensions. 10 proposed a global test against high-dimensional alternatives (and developed asymptotic type-I error control in generalized linear models ( 11 ) ), offering a principled extension of score-type testing ideas to settings where p is large. In linear regression with structured designs, 21 developed tests that can be viewed as high-dimensional analogues of the classical F -statistic. However, a common limitation of such sum- or quadratic-form-type procedures is that their power is primarily driven by dense alternatives, where many coordinates of \bm{\beta} deviate from zero. When the signal is sparse (only a small subset of coefficients is nonzero), maximum-type procedures are often substantially more powerful. This sparsity–density tradeoff has motivated the development of complementary max-type tests and, importantly, combination strategies that remain powerful without knowing the underlying sparsity level. A recent representative line of work establishes asymptotic independence between suitably standardized sum-type and max-type statistics under H_{0} , which enables simple combination rules such as selecting the minimum of the component p -values ( 9 ) . Most of the aforementioned high-dimensional regression tests are derived under light-tailed error assumptions (Gaussian or sub-Gaussian-like) and can exhibit degraded performance when errors are heavy-tailed or contaminated. To address robustness, 8 extended classical rank-based inference ( 16 ; 12 ) to high-dimensional regression by proposing a Wilcoxon-score-based global test. This rank-based sum-type test is distribution-free under H_{0} (under mild regularity) and shows strong empirical performance under heavy-tailed errors, especially for dense alternatives. Complementing this, 20 introduced two Wilcoxon-score-based maximum-type tests for high-dimensional regression coefficients, tailored to sparse alternatives: a marginal max statistic and a precision-transformed max statistic designed to accommodate predictor dependence. Despite their complementary strengths, the sparsity level is unknown in practice, so a single procedure that is simultaneously robust to heavy tails and adaptive to sparsity is highly desirable. This paper develops such adaptive and robust global tests by combining the rank-based sum-type statistic of 8 with the Wilcoxon-score-based max-type statistics of 20 . Our key theoretical contribution is to prove, under H_{0} , the asymptotic independence between the Wilcoxon sum-type statistic and each of the two Wilcoxon max-type statistics. This joint limit theory justifies principled combination of the corresponding p -values. Building on the Cauchy combination methodology ( 15 ) , we propose two rank-based maxsum tests that fuse evidence from dense- and sparse-sensitive components. The resulting procedures are (i) robust to heavy-tailed and non-Gaussian errors by construction, and (ii) adaptive to unknown sparsity through maxsum combination. Extensive simulations further demonstrate that the proposed maxsum tests maintain stable size and deliver strong power across a wide range of error distributions and sparsity regimes, improving upon using either component alone. The remainder of the paper is organized as follows. Section 2 states two asymptotic independence theorems under H_{0} and presents the proposed Cauchy-combination maxsum tests. Section 3 reports simulation results. Technical proofs are collected in the Appendix. 2 Rank-based Maxsum Tests We consider the high-dimensional linear regression model Y_{i}=\bm{X}_{i}^{\top}\bm{\beta}+\varepsilon_{i},i=1,\ldots,n, (1) where \bm{X}_{1},\ldots,\bm{X}_{n} are i.i.d. p -dimensional covariates and \bm{\beta}\in\mathbb{R}^{p} is the regression coefficient vector. The noise \varepsilon_{i} is independent of \bm{X}_{i} . Throughout, we assume the covariates are standardized so that \mathbb{E}(\bm{X}_{i})=\bm{0}_{p} and \mathrm{Var}(X_{ik})=1 for k=1,\ldots,p . Let \Sigma=\mathrm{Var}(\bm{X}_{i}) and assume \Sigma is positive definite to ensure identifiability. Our goal is to test the global hypothesis H_{0}:\bm{\beta}=\bm{\beta}_{0}\quad\text{vs}\quad H_{1}:\bm{\beta}\neq\bm{\beta}_{0}, (2) for a given \bm{\beta}_{0}\in\mathbb{R}^{p} ; without loss of generality we take \bm{\beta}_{0}=\bm{0}_{p} . When p<n , the classical F -test provides a standard solution. In high dimensions, however, the F -test may suffer substantial power loss as p approaches n and becomes ill-defined once the relevant sample covariance matrices are singular (e.g., when p\geq n ). To circumvent the inversion of \bm{X}^{\top}\bm{X} in the classical F -statistic, 10 introduced an empirical-Bayes-type global test based on T_{EB}=\frac{\bm{Y}^{\top}\bm{X}\bm{X}^{\top}\bm{Y}}{\bm{Y}^{\top}\bm{Y}}, (3) which can be interpreted as a score test for a hyper-parameter in a prior placed on \bm{\beta} . Along a related direction, 21 proposed a centered U -statistic-based procedure, Z_{n}=\frac{1}{4P_{n}^{4}}\sum^{*}(\bm{X}_{i_{1}}-\bm{X}_{i_{2}})^{\top}(\bm{X}_{i_{3}}-\bm{X}_{i_{4}})(Y_{i_{1}}-Y_{i_{2}})(Y_{i_{3}}-Y_{i_{4}}), where \sum^{*} sums over mutually distinct indices and P_{n}^{4}=n!/(n-4)! , and established asymptotic normality under a diverging factor structure ( 1 ) . Both T_{EB} and Z_{n} are representative sum-type (quadratic-form/U-statistic) tests, which are typically effective against dense alternatives but can be less sensitive when the signal is sparse . To enhance power under sparse signals, 9 developed a maximum-type statistic of the form T_{MAX}=\max_{1\leq j\leq p}\left(\frac{1}{\sqrt{n}}\,\mathbb{X}_{j}^{\top}\bm{Y}\right)^{2}\big/\hat{\sigma}^{2}, (4) where \mathbb{X}_{j} is the j th column of \bm{X} and \hat{\sigma}^{2} consistently estimates \mathrm{Var}(\varepsilon_{i}) . Moreover, they proved asymptotic independence between a max-type component and a sum-type component (e.g., T_{EB} ), which enables adaptive testing by combining information from both regimes via a minimum- p strategy. The above procedures are largely motivated by light-tailed noise settings and may lose robustness when \varepsilon_{i} is heavy-tailed. To address this issue, 8 extended rank-based methodology to high-dimensional regression. Let R_{i} be the rank of Y_{i} among \{Y_{1},\ldots,Y_{n}\} and define the Wilcoxon scores e_{i}=\sqrt{12}\left(\frac{R_{i}}{n+1}-\frac{1}{2}\right),i=1,\ldots,n, (5) with \bm{e}=(e_{1},\ldots,e_{n})^{\top} . Under H_{0} and continuity, \{e_{i}\} are distribution-free with \mathbb{E}(e_{i})=0 and \mathrm{Var}(e_{i})=1 . They proposed a rank-score U -statistic W_{n}=\frac{1}{n(n-1)}\sum_{1\leq i<k\leq n}\bm{X}_{i}^{\top}\bm{X}_{k}\,e_{i}e_{k}, (6) and the standardized sum-type statistic T_{RS}=\frac{nW_{n}}{\sqrt{2\widehat{\mathrm{tr}(\mathbf{\Sigma}^{2})}}}, (7) where \widehat{\mathrm{tr}(\mathbf{\Sigma}^{2})} is