On self-training of summary data with genetic applications

Buxin Su, Jiaoyang Huang, Jin Jin, Bingxin Zhao · 2025

Read On self-training of summary data with genetic applications by Buxin Su, Jiaoyang Huang, Jin Jin, Bingxin Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12155.txt.

Introduction

Buxin Su and co-authors study self-training on summary data, a way to build prediction models when privacy rules block access to person-level records. The method samples fake datasets from published summary statistics, then trains on those. Genetic risk models lean on it heavily, yet its basic behavior was unproven.

Using random matrix theory, the team works out the method's limits for high-dimensional data. Within a class of linear estimators, self-training matches the accuracy of training on the real records, at least in the limit. One surprise: the fake training and check sets lean on each other, yet that leaning cancels in the accuracy math, so overfitting stays away.

Catalog record

CREATORBuxin Su, Jiaoyang Huang, Jin Jin, Bingxin Zhao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE207 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-12155

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On self-training of summary data with genetic applications Buxin Su, Jiaoyang Huang, Jin Jin, Bingxin Zhao Abstract Prediction model training is often hindered by limited access to individual-level data due to privacy concerns and logistical challenges, particularly in biomedical research. Resampling-based self-training presents a promising approach for building prediction models using only summary-level data. These methods leverage summary statistics to sample pseudo datasets for model training and parameter optimization, allowing for model development without individual-level data. Although increasingly used in precision medicine, the general behaviors of self-training remain unexplored. In this paper, we leverage a random matrix theory framework to establish the statistical properties of self-training algorithms for high-dimensional sparsity-free summary data. Notably, we demonstrate that, within a class of linear estimators, resampling-based self-training achieves the same asymptotic predictive accuracy as conventional training methods that require individual-level datasets. These results suggest that self-training with only summary data incurs no additional cost in prediction accuracy, while offering significant practical convenience. Our analysis provides several valuable insights and counterintuitive findings. For example, while pseudo-training and validation datasets are inherently dependent, their interdependence unexpectedly cancels out when calculating prediction accuracy measures, effectively preventing overfitting in self-training algorithms. Furthermore, we extend our analysis to show that the self-training framework maintains this no-cost advantage when combining multiple methods (e.g., in ensemble learning) or when jointly training on data from different distributions (e.g., in multi-ancestry genetic data training). We numerically validate our findings through extensive simulations and real data analyses using the UK Biobank. Our study highlights the potential of resampling-based self-training to advance genetic risk prediction and other fields that make summary data publicly available. Keywords : Genetic prediction; Prediction models; Precision medicine; Random matrix theory; Resampling; Summary statistics. 1 Introduction Developing prediction models—one of the major tasks in statistical learning and various scientific fields—typically relies on access to individual-level data for model training and validation. For example, in a traditional prediction model training process, individual-level datasets are required and are often split into independent training and validation subsets (or used in a cross-validation design) for parameter optimization, to avoid overfitting and ensure generalizability. However, in many applications, accessing individual-level data is challenging. A notable example is genetic risk prediction in precision medicine ( Lennon et al.,, 2024 ) , which uses genetic variants from genome-wide association studies (GWAS) ( Uffelmann et al.,, 2021 ) as predictors. Due to privacy restrictions and logistical challenges, summary-level GWAS data (such as marginal genetic effect estimates and standard errors) rather than original individual-level genetic profiles, have become the standard for data sharing in genetic research ( Pasaniuc and Price,, 2017 ) . Using these summary statistics, polygenic risk scores (PRS) have been widely developed to assess genetic risk for various complex traits and diseases ( Purcell et al.,, 2009 ) . Millions of genetic variants in GWAS are used as predictors, each contributing only a small amount of information ( Boyle et al.,, 2017 ) . Over the last two decades, a wide variety of statistical methods have been developed to improve PRS performance by better aggregating predictive power across high-dimensional genetic predictors ( Vilhjálmsson et al.,, 2015 ; Mak et al.,, 2017 ; Ma and Zhou,, 2021 ; Ge et al.,, 2019 ; Pattee and Pan,, 2020 ; Hu et al.,, 2017 ; Yang and Zhou,, 2020 ) . Although most PRS prediction models only require summary-level data from the training sample as model input, they typically still need access to individual-level validation data during the training process for model parameter tuning ( Choi et al.,, 2020 ; Mak et al.,, 2017 ; Vilhjálmsson et al.,, 2015 ; Márquez-Luna et al.,, 2021 ) . However, this individual-level validation dataset may not always be available to researchers who need to develop the prediction model, as sharing and accessing genetic datasets—even small validation data—can pose risks and raise concerns regarding data privacy and policy. Such privacy and logistical barriers have significantly limited the accessibility and scalability of PRS applications ( Bonomi et al.,, 2020 ; Wan et al.,, 2022 ; Jin et al.,, 2025 ) . Recent advances in genetic fields have facilitated pseudo-training for PRS models directly using high-dimensional summary-level data ( Zhao et al., 2024c, ; Zhao et al.,, 2021 ; Jiang et al.,, 2024 ; Chen et al.,, 2024 ; Song et al.,, 2019 ) . The principle of this approach is that, given the summary-level data, it is possible to sample pseudo-training and validation summary statistics from their underlying probability distribution. These sampled summary statistics closely mimic what would be obtained if there were access to two independent subsets of the individual-level data. Therefore, using these pseudo-training and validation datasets, it is possible to tune parameters and ultimately derive a prediction model, allowing for the self-training of summary statistics. Despite their strong preliminary numerical performance in several application examples ( Jiang et al.,, 2024 ; Jin et al.,, 2025 ) and emerging extensions to other biomedical fields ( Wu et al.,, 2023 ; Wang et al.,, 2024 ) , little statistical research has been conducted to understand the general properties of resampling-based self-training for summary-level data. It remains unclear whether these methods lead to potential reductions in model performance, especially regarding the trade-offs between practical convenience and decreased prediction accuracy, as well as the key factors influencing their performance in practical applications. Therefore, it is crucial to establish a framework to quantify the performance of self-training and compare it to conventional model training with individual-level data. In this paper, we propose a general random matrix theory framework ( Bai and Silverstein,, 2010 ; Yao et al.,, 2015 ; Dobriban and Sheng,, 2021 ) to model and understand self-training with high-dimensional summary-level data. Our study provides several key contributions. First, we establish the statistical properties of self-training algorithms for high-dimensional predictors with a general covariance structure, without imposing sparsity constraints on regression coefficients. We demonstrate that, under flexible conditions, a class of linear estimators achieves the same asymptotic predictive accuracy as their counterparts trained using individual-level data. We provide detailed analytical evaluations of ridge-type estimators and marginal thresholding estimators, both of which, along with their variants, are widely used in PRS applications ( Ma and Zhou,, 2021 ) . These analyses provide deep insights for practical applications and reveal notable counterintuitive findings. For example, unlike individual-level training and validation datasets, pseudo-training and validation datasets are inherently dependent, as they are derived from the same summary-level data. However, surprisingly, we find that this interdependence cancels out during the calculation of prediction accuracy measures, such as R -squared ( R^{2} ) or mean squared error. This phenomenon effectively prevents overfitting in self-training algorithms. Furthermore, we show that self-training can facilitate the combination of different estimators using summary statistics within an ensemble learning framework. Self-training also enables joint training across multiple datasets from different distributions, which is particularly relevant to the emerging field of multi-ancestry genetic risk prediction ( Kachuri et al.,, 2024 ; Zhang et al.,, 2023 ; Jin et al.,, 2024 ) . We numerically validate our theoretical findings with extensive simulations and real data analyses from the UK Biobank ( Bycroft et al.,, 2018 ) . The rest of the paper proceeds as follows. In Section

Read the complete text