A Fast Screening Approach for High-dimensional Outcomes and High-dimensional Predictors
Hongju Park, Zhenyao Ye, Shuo Chen · 2026
Read A Fast Screening Approach for High-dimensional Outcomes and High-dimensional Predictors by Hongju Park, Zhenyao Ye, Shuo Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03018.txt.
Introduction
Park, Ye, and Chen shrink both sides of a high-dimensional data problem at once. Cross-modal work is hard: outcomes and predictors can each be huge, noisy, and tangled. Most screening tools cut predictors only. Outcomes stay full size, and since each outcome picks its own predictor set, the joint set stays large.
Their scheme, Graph Independence Dual Screening, cuts outcomes and predictors in one pass. Fast code feeds later selection steps, and theory backs the design. In sims it beat tools that screen predictors alone. On Alzheimer's data, it cut over 865,000 methylation marks and about 49,000 gene reads to near 9,000 and 2,000. Blocks of marks and gene reads with strong links stood out. The team reads those blocks as signs of joint gene control in the disease, which plain one-side screening had missed.
Catalog record
| CREATOR | Hongju Park, Zhenyao Ye, Shuo Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03018
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Fast Screening Approach for High-dimensional Outcomes and High-dimensional Predictors Hongju Park, Zhenyao Ye, Shuo Chen Abstract Modeling interactions among multimodal, high-dimensional data is intrinsically challenging due to ultra-high dimensionality and complex dependence structure with high level noise. Screening methods are effective for reducing dimensionality, but most existing approaches shrink only the predictor space while retaining all outcomes. In cross-modal analyses, different outcomes often select different predictor subsets, so the union remains large and the response dimension is unchanged—limiting the practical benefit of screening. This gives rise to heavy computational burdens and poor interpretability. To address these limitations, we propose a new screening framework, Graph Independence Dual Screening (GIDS), which simultaneously reduces the dimensionality of response variables and predictors. We design computationally efficient algorithms that facilitate downstream selection procedures, improving accuracy and scalability, and establish supporting theoretical results. Exensive simulation studies demonstrate that GIDS outperforms the existing methods, which screen only predictors. To illustrate its utility, we applied GIDS to the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset, analyzing interactions between genome-wide 865,353 DNA methylation and 49,386 transcriptomic variables. GIDS reduced the feature space to approximately 9,000 CpGs and 2,000 transcripts, uncovering blockwise interaction structures—clusters of CpG sites and gene transcripts with strong associations. These findings not only improve computational tractability but also yield interpretable biological insights, highlighting coordinated regulatory mechanisms underlying Alzheimer’s disease. keywords Screening for Joint Data Sets , Dimensionality Reduction , Best Subset Selection , Joint High-dimensional Data Analysis , Integrative Data Analysis , and ?? School of Pharmacy, University of North Carolina, Chapel Hill, ?? ?? Maryland Psychiatric Research Center, School of Medicine, University of Maryland, ?? ; ?? 1 Introduction The joint analysis of multi-modal high-dimesional data has garnered increasing attention as a powerful approach for uncovering relationships between two high-dimensional datasets. For example, multi-modal high-dimesional data studies for the multi-omics such as genome-wide single-nucleotide polymorphism (SNP) and transcriptomics [ 18 , 29 , 15 ] and imaging-genetics [ 27 , 28 ] often face ultra-high dimensional and complex interactive patterns between datasets. These challenges lead to substantial computational burdens, such as the memory demands required to store a cross-correlation matrix involving both high-dimensional outcomes and predictors [ 1 ] . For instance, the joint analysis of DNA methylation and transcriptomics data considered in this work involves 5\times 10^{4} and 8\times 10^{5} variables on each side, resulting in a cross-correlation matrix with roughly 4\times 10^{10} entries, which requires approximately 300GB memory. In addition, in ultra-high dimensional setups, a major technical challenge is controlling the noise introduced by spurious correlations, as the magnitude of spurious correlations significantly grows uncontrollably with the number of predictors [ 9 ] . This issue is further exacerbated in joint setups, where the effective dimensionality increases multiplicatively with the numbers of predictors and responses. Consequently, large spurious correlations between unrelated pairs become much more frequent, which can severely bias variable ranking. Existing methods for multiple responses [ 16 , 24 , 20 , 17 ] , when screening predictors only, often mitigate this problem using hard or soft thresholding for screening measures of predictors. However, these techniques are not well-suited for joint screening, as they fail to account for the noise caused by ultra-high dimensional responses. We present this challenge using the following notations. For two high-dimensional data sets \mathbf{X}=[X_{1}~X_{2}~\cdots~X_{p}]\in\mathbb{R}^{n\times p} and \mathbf{Y}=[Y_{1}~Y_{2}~\cdots~Y_{q}]\in\mathbb{R}^{n\times q} with n samples, then an assosiation matrix lies in \mathbb{R}^{p\times q} . As both p and q are high-dimensional, reducing p or q separately cannot solve this challenges, as mentioned above. Our goal is to seek a efficent solution to simultaneously reduce p and q while preserving most true associations between \mathbf{X} and \mathbf{Y} . To this end, we consider the problem of estimating a p\times q -dimensional parameter matrix \bm{\beta}\in\mathbb{R}^{p\times q} in the multivariate linear model \displaystyle\mathbf{Y}=\mathbf{X}\bm{\beta}+\bm{\epsilon}, where \mathbf{Y} is a response matrix, \mathbf{X} is a design matrix with independent and identically distributed (i.i.d.) rows, \bm{\beta}\in\mathbb{R}^{p\times q} is the unknown coefficient matrix, \bm{\epsilon}\in\mathbb{R}^{p\times q} is a random error matrix, and n is the sample size. In high-dimensional settings, where both p and q may be large, it is commonly assumed that only a small subset of predictors and responses are truly associated. Under the joint high-dimensional setup, variable selection plays a crucial role in improving estimation accuracy by isolating the relevant predictors. Additionally, it enhances interpretability by yielding a parsimonious representation of the underlying model structure. Screening has long played a central role in high-dimensional data analysis to reduce the dimension to the managible size. Especially, correlation-based screening methods have widely used due to their simplicity, interpretability, and scalability. A notable example is the Sure Independence Screening (SIS) method introduced by [ 9 ] , which uses marginal Pearson correlations to efficiently reduce dimensionality by filtering out irrelevant predictors. However, such methods are primarily designed for single-response models and may fail to capture complex dependence structures inherent in high-dimensional multivariate settings. In practice, different outcomes often correspond to distinct subsets of predictors, so their union remains large and the response dimension is unchanged, resulting in limited dimensionality reduction and reduced interpretability. Furthermore, this approach lacks a mechanism for screening responses, highlighting the need for joint screening of both predictors and responses. The following proposition illustrates this limitation. Proposition 1 . Let \bm{\beta}\in\mathbb{R}^{q\times p} with true model \mathcal{M}:=\{(i,j):\beta_{ij}\neq 0\}=\{(i,j):1\leq i\leq p_{0},~1\leq j\leq q_{0}\} and true model for the j th outcome \mathcal{M}_{j}=\{i:(i,j)\in\mathcal{M}\} . Suppose that an independent screening is performed for each outcome with the true and false positive probablity of selecting true predictors such that \mathbb{P}\big(i\in\widehat{\mathcal{M}}_{j}\,\big|\,i\in\mathcal{M}_{j}\big)=1-\xi_{1},\quad\text{and}\quad\mathbb{P}\big(i\in\widehat{\mathcal{M}}_{j}\,\big|\,i\notin\mathcal{M}_{j}\big)=\xi_{2}, where 1-\xi_{1}\gg\xi_{2} . Then, the probability of union of screening results for q outcomes satisfies \mathbb{P}\Big(\big|\cup_{j=1}^{q}\widehat{\mathcal{M}}_{j}\big|=p\Big)\;\geq\;1-p(1-\xi_{2})^{q}. This proposition guarantees a lower bound on the probability that no predictors are excluded with high probability, when performing screening for q outcomes separately. For example, when p=q=10,000 , the minimum probability of screening results including all predictors is 1.000 for \xi_{2}=0.005 . Therefore, traditional screening methods may not exclude any predictors and outcomes for the downstreaming analyses, which poses both computational challenges and replicablity crisis. Over the past decade, many existing works have extended single-response screening to the joint analysis of predictors and responses. For example, SIS has been extended to handle multiple responses using the distance correlation [ 16 ] , the martingale difference correlation [ 24 ] , and the ball correlation [ 20 ] . Furthermore, screening methods using a rank-based correlation [ 11 ] and projection correlation [ 17 ] have been proposed for joint high-dimensional settings. However, these methods still focus primarily on screening predictors while treating responses as fixed, leaving the joint screening of both predictors and responses underexplored. As a result, even after predictor screening, computation remains intractable for multimodal data analysis. For instance, when jointly analyzing genome-wide DNA methylation (hundreds of thousands of CpG sites) and transcriptomic data (tens of thousands of genes), screening only predictors still leaves tens of thousands of responses, producing a prohibitively large cross-correlation matrix that is both computationally and memory intensive. In practice, screening both sides is critical: it improves the detection of truly relevant variable pairs by enhancing the signal-to-noise ratio and uncovering latent regulatory structures. Partial correlation-based methods [ 14 ] , building on earlier univariate approaches [ 3