Semiparametric model averaging for high-dimensional quantile regression with nonignorable nonresponse
Wei Xiong, Dianliang Deng, Dehui Wang · 2025
Read Semiparametric model averaging for high-dimensional quantile regression with nonignorable nonresponse by Wei Xiong, Dianliang Deng, Dehui Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00464.txt.
Introduction
Wei Xiong, joined by two co-authors, Dianliang Deng and Dehui Wang, tackles quantile regression, a method that models a spread of outcomes rather than just an average. Their problem is data with many variables and with missing answers that cannot be ignored, where who responds affects what is seen.
Xiong and his co-authors build a model averaging method, a way to combine several candidate models with weights, that loosens strict rules about how respondents behave. They use a two-phase plan for the missing-data step and for the weighting step. Tests and theory suggest their estimator can settle on the best correct model and stay efficient even under hard missing patterns.
Catalog record
| CREATOR | Wei Xiong, Dianliang Deng, Dehui Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-00464
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semiparametric model averaging for high-dimensional quantile regression with nonignorable nonresponse Wei Xiong, Dianliang Deng, Dehui Wang Abstract Model averaging has demonstrated superior performance for ensemble forecasting in high-dimensional framework, its extension to incomplete datasets remains a critical but underexplored challenge. Moreover, identifying the parsimonious model through averaging procedure in quantile regression demands urgent methodological innovation. In this paper, we propose a novel model averaging method for high-dimensional quantile regression with nonignorable missingness. The idea is to relax the parametric constraint on the conditional distribution of respondents, which is constructed through the two-phase scheme: (i) a semiparametric likelihood-based estimation for the missing mechanism, and (ii) a semiparametric weighting procedure to combine candidate models. One of pivotal advantages is our SMA estimator can asymptotically concentrate on the optimally correct model when the candidate set involves at least one correct model. Theoretical results show that the estimator achieves asymptotic optimality even under complex missingness conditions. Empirical conclusions illustrate the efficiency of the method. Keywords: Asymptotic optimality, Missing not at random (MNAR), Frequentist model averaging, Quantile regression, Weight consistency. 1 Introduction Statistical inference of high-dimensional data has become increasingly important across many scientific fields. In the past two decades, there has been a number of contributive literature such as Fan and Lv (2008) , Wang (2011) , Li et al. (2012) . Compared to least squares model, quantile regression ( Koenker 2005 ) offers a robust alternative to check the effect of high-dimensional covariates on the entire response distribution. To efficiently select active predictors, He et al. (2013) introduced a criterion of variable screening by marginal quantile utility. More recently, Kong et al. (2019) and Jiang et al. (2024) modified the method and used it to refine variable selection in ultra-high dimensional quantile model, respectively. One of central challenges in high-dimensional regression analysis is prediction. Model averaging emerges as a compelling alternative to classical selection procedures (such as AIC and BIC), effectively addressing the inherent uncertainty associated with selecting a single model. Following a series of pioneering contributions by Yang (2001) , Hjort and Claeskens (2003) , and Hansen (2007) , theoretical development of frequentist model averaging has been rapidly advancing. For quantile regression, Shan and Yang (2009) applied the adaptive aggregating algorithm for mixing different specifications, Lu and Su (2015) proposed the jackknife model averaging (JMA) procedure for the divergent number of predictors, Wang et al. (2023) combined JMA with variable screening for the ultra-high dimensional case, Xu et al. (2023) studied the application of cross-validation model averaging (CVMA) in functional linear model, and among others. Abovementioned methodologies are established with fully available dataset. In practice, nonresponse is frequently encountered during data collecting. Naive exclusion of missingness may causes biased results when the response mechanism depends on unobserved parts — the scenario defined as missing not at random (MNAR) ( Little and Rubin 2002 ; Kim and Shao 2021 ). Statistical inference of MNAR data has been greatly developed, including dimension reduction and estimation (e.g., Kim and Yu 2011 , Miao and Tchetgen 2016 , Shao and Wang 2016 , Morikawa and Kim 2021 , Zhang et al. 2020 , Zhao et al. 2021 ). In recent years, researchers begin to take focus on model averaging with missing data, and most of studies are regarded with ignorable mechanisms. For example, Wei et al. (2021) , Xie et al. (2021) used frequentist model averaging and inverse probability weighting (IPW) to predict the conditional mean function, respectively. However, for MNAR, the literature currently lacks model averaging procedures for either the response mechanism or the conditional quantile function (CQF). We wish to address the void in this paper. The objective of the paper is to contribute a novel semiparametric model averaging (SMA) procedure for predicting CQF. To the best of our knowledge, most of methodologies can hardly skirt the estimation of MNAR mechanism. As pointed out by Li et al. (2023) , instability will be occurred through the moment estimating equation. They suggested a likelihood estimation under the parametric assumption of the conditional distribution of respondents. In the high-dimensional case, we derive a weighted estimator that combines semiparametric likelihood and model averaging. The advantage is to avoid potential misspecification of the conditional distribution, and the computational burden from nonparametric parts can be practically reduced by a sampling technique. We verify that the estimator of nuisance parameter is consistent when the correct model are contained in the candidate set. Asymptotic theory of the weight estimator is another interesting topic in model averaging literature, while related studies are almost focused on least squares regression ( Zhang and Liu 2019 ; Zhang et al. 2020 ; Fang et al. 2023 ). Recent advance in Xu et al. (2023) addressed the gap by establishing the over-consistency (the concept refers to Chen et al. 2023 ) of weights of CVMA, while the behavior of the weight assigned to the optimally correct model remains to be developed. The current paper enriches the theoretical results of proposed procedure in two scenarios: (i) when the candidate set contains at least one correct model, SMA can asymptotically put the weight one to the optimally correct model, i.e., parsimony; (ii) when all candidates are misspecified, SMA preserves the same asymptotic optimality derived from full data in the sense that its prediction risk via quantile loss is asymptotically identified to the best–but–infeasible averaging estimator. Note that above conclusions are investigated on the continuous weight support with “nonnegative and sum-up-to-one”, it is regarded as a supplement beyond conventional least squares framework. Numerically we propose a sampling approximation for SMA procedure to alleviate computational burden induced by nonparametric regression. Besides, to address the curse of dimensionality and efficiently construct candidate sets, we also develop a greedy post-selection algorithm based on grouped variable importance. We empirically compare the proposed estimation to existing methods of model selection and model averaging. Numerical results demonstrate that SMA can effectively identify the optimal candidate and has satisfactory predictive performance. Further, our method is more robust than others to against misspecification of the response mechanism. The reminder of this paper is organized as follows. Section 2 describes the model framework, the SMA procedure for MNAR mechanism, and investigates the consistency of nuisance parameter. Section 3 proposes the SMA criterion to predict CQF. Section 4 establishes the theoretical properties of the CQF estimator. Section 5 introduces an efficient computational sampling method to evaluate conditional expectations of respondents. Numerical studies are presented in Section 6. A post-selection algorithm for preparing candidate sets is described in Appendix. Supplementary simulation results and technical details of proofs are attached in online supplementary material, respectively. 2 Model and estimation for MNAR mechanism 2.1 Model specification Let \mathcal{D}_{n}=\{(\bm{x}^{\top}_{i},y_{i})^{\top}:i=1,...,n\} be the set of independent and identically distributed (i.i.d.) copies of (\bm{x}^{\top},y)^{\top} , where \bm{x} is a p -dimensional covariate vector that can be fully observed, and y is the outcome with some of observations are nonresponse. Given a probability level \tau\in(0,1) , the CQF of the response takes the form as Q_{\tau}(y_{i}|\bm{x}_{i})=\bm{\beta}^{\top}(\tau)\bm{x}_{i}\triangleeq\mu_{i}(\tau), (2.1) where \bm{\beta}(\tau) is the parameter vector that may depends on \tau . Obviously ( 2.1 ) is equivalent to the following quantile regressive model: y_{i}=\mu_{i}(\tau)+\varepsilon_{i}(\tau), where \varepsilon_{i}(\tau) ’s are i.i.d. random errors such that \mathrm{Pr}(\varepsilon_{i}(\tau)\leq 0|\bm{x}_{i})=\tau . Hereafter we omit