High-dimensional Longitudinal Inference via a De-sparsified Dantzig-Selector
2025
Read High-dimensional Longitudinal Inference via a De-sparsified Dantzig-Selector (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07498.txt.
Introduction
Nathan Huey, writing alone in 2025, builds a tool for drawing firm conclusions from studies with far more variables than people. His paper treats longitudinal data, where each person or unit is measured again and again, clustered in time. Standard sparse regression picks the key variables but cannot say how sure each effect is.
Huey starts from a Dantzig-type regularized estimator and de-sparsifies it, a fix that restores valid uncertainty ranges. Theory backs the method for both plain and generalized linear models. Simulations on steady and yes-no outcomes show it behaves as promised. When the time correlation is modeled rightly, the estimator reaches the best possible efficiency for continuous outcomes. A genetics data set on bacterial vitamin production shows the method at work.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 115 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07498
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
High-dimensional Longitudinal Inference via a De-sparsified Dantzig-Selector Abstract \DeclareNewLayer [ foreground, contents=]blankpage.fg \DeclarePageStyleByLayers blankblankpage.fg Nathan W. Huey 1,2 1 Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA 2 Current Address: Department of Clinical Research, Massachusetts Eye and Ear Hospital, Boston, MA, USA Abstract We address the problem of valid statistical inference in high-dimensional generalized linear models with longitudinally clustered data. We propose a de-sparsified estimator, constructed from an initial Dantzig-type regularized fit, that enables asymptotically normal inference for individual regression coefficients without requiring model selection consistency. Theoretical results establish validity for both continuous and binary outcomes, and for continuous data under linear models, we prove that the estimator achieves the semiparametric efficiency bound when the working correlation structure is correctly specified. Extensive simulation studies demonstrate accurate coverage and competitive power relative to existing methods. We further illustrate the approach in a genetic association study of bacterial riboflavin production, highlighting its applicability to complex, high-dimensional longitudinal data. 1 Introduction In the last two decades, conducting statistical inference on low-dimensional quantities in otherwise high-dimensional settings has received considerable attention. Indeed, this is in no small part influenced by the ever-increasing availability of these kinds of data from fields ranging from economics to signal processing to genetics ( Fan et al., 2011 , Shuman et al., 2013 , Lange et al., 2014 ) – where the abundance of data as well growing computational power has allowed us to explore nuances of high dimensionality that were not possible to address a few decades earlier. While much progress has been made in this arena of high-dimensional statistics, especially when sparse structures are assumed on underlying models, one important area still to be developed full generality is that of inference with high-dimensional longitudinal data, i.e. data with p\gg n ( p being the number of variables in the study and n the sample size) and non-independent correlation structures. In the present work we address this area of research and propose a “de-sparsifying” method using a preliminary Dantzig selector type estimator ( Candes and Tao, 2007 ; Bickel et al., 2009 ) utilizing generalized estimating equation representation of generalized linear models. We present theory first for the linear model which includes demonstrating \sqrt{n} -convergence of the proposed estimator to a limiting normal distribution. We demonstrate that among a reasonable class of asymptotically linear estimators, ours attains the lowest possible variance – and thereby justifying a notion of efficience ( Jankova and Van De Geer, 2018 ) . Numerical simulations are provided for both continuous and dichotomous outcomes. We conclude with an application of our method to a relevant dataset. First, we place this work in a context of related, though distinct, literature. 1.1 Related Work The method we propose here fits within the general structure developed in Neykov et al., 2018 . They note three advantages of their method over existing inferential methods in high dimensions. Firstly, many existing methods depend on the specification of a loss function, such as a negative log-likelihood, which has been used to construct an initial estimator of the quantity of interest that one seeks to operate on to produce a de-biased asymptotically normal estimator. While many estimating equations may correspond to the gradient of a loss function (e.g. score functions for parametric models), this is not a strict requirement. Second, Neykov et al., 2018 ’s method is not constrained only to linear and generalized linear models. Finally, and most importantly for us, we will show that the framework of Neykov et al., 2018 can be successfully adapted to our clustered data setting. Before we proceed further, we present a broad overview of the inferential developments for high dimensional sparse generalized linear models. In the context of high-dimensional sparse generalized linear models Bühlmann, 2013 , inspired by Zhang and Zhang, 2014 developed a de-biasing procedure by using Lasso regression-based initial estimation. In the context of linear regression, Javanmard and Montanari, 2018 showed that asymptotic normality of the debiased LASSO follows with s=o_{p}(n/(\log{p})^{2}) if the rows of the precision matrix of the covariates have sparsity s_{\Omega}=o_{p}(\sqrt{n}/\log p). In contrast, s_{\Omega} is too large, then asymptotic normality follows only if s=o_{p}(\sqrt{n}/(\log{p})) . Subsequently, Ning et al., 2017 introduced a decorrelated score approach which operates under a suitable loss-based framework. It is unclear, how to extend this without a likelihood framework that arises in high dimensional generalized estimating equations. Moreover, Chernozhukov et al., 2015 discusses orthogonality conditions needed for valid post-regularization inference in high-dimensional models which deals with general linear functionals of nonparametric regressions and their derivatives. Finally, Xia and Shojaie, 2022 provide inference theory for a de-biased estimator also based on generalized estimating equations. However, Their estimator differs from ours in several points including the choice of initial sparse estimator, where they choose to use a quasi-likelihood-based estimator. They also employ a different tuning procedure compared to our method. They note that solving for a zero as we do may lead to numerical instability in cases other than linear regression. Finally, they do not prove any efficiency results for their estimator. As of the writing of this paper, they do not provide a publicly available implementation of their method. Last but not least, Jankova and Van De Geer, 2018 develops lower bounds for high-dimensional semiparametric linear and Gaussian graphical models. We crucially adapt this framework to establish the optimality of our methods in the longitudinal data setting. 1.2 Notation \norm{\cdot}_{2} refers to the L_{2} norm when applied to vectors and the operator/spectral norm of a matrix. For two matrices A and B , A\otimes B denotes the Kronecker product. \norm{A}_{\max} refers to the maximum magnitude of the elements of a matrix A . \norm{x}_{1} refers to the L_{1} -norm of a vector, x . \norm{x}_{\infty} refers to the maximum magnitude of the elements of a vector x . \lambda_{\min}(A) and \lambda_{\max}(A) refer to the minimum and maximum eigenvalues of a matrix A , respectively. For a set of indices Q , x_{Q} refers to the vector with the elements of the indices not in Q replaced with zeros. x_{-Q} refers to the vector with the elements of the indices in Q replaced with zeros. x_{j} refers to the j th element of a vector x . [A]_{i\cdot} refers to the i th row of the matrix A . 1.3 Contribution In the work that follows, we develop an estimator for the j th element of \bm{\beta} , \bm{\beta}_{j} , in the high-dimensional, longitudinal setting that, under certain mild conditions, is asymptotically normal with an \sqrt{n} -convergence rate. We then show that, when the cluster-specific correlation structure is correctly specified, our estimator asymptotically attains an efficiency bound within a class of asymptotically unbiased linear estimators, the definition and associated discussions of which are collected in Section 3 . To our knowledge, this is the first time that a declassified estimator for clustered data settings has been shown to attain such a bound. For example, our estimator is similar to that of Xia and Shojaie, 2022 , but they do not include any efficiency results. To construct our estimator, we first identify a set of estimating equations such that the expectation at \bm{\beta} is zero. Since we are in a high-dimensional