Post-selection Inference in Regression Models for Group Testing Data
Qinyan Shen, Karl Gregory, Xianzheng Huang · 2025
Read Post-selection Inference in Regression Models for Group Testing Data by Qinyan Shen, Karl Gregory, Xianzheng Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11767.txt.
Introduction
Qinyan Shen, Karl Gregory, and Xianzheng Huang fix trust checks after model choice in twenty twenty-five. Their case is group test data, where the true scores are seen in part at best. In place of true scores, teams see pooled test scores that can be wrong. The choice of which traits count has to deal with that gap in what is known.
A back and forth max step works out LASSO picked scores with a fine built in. Once choice is done, plain trust bands read too bold, since the same data did double work. The team stretches past choice trust checks, built on the polyhedral lemma, to fit this case. Test runs show their bands hold up more well than plain ones do. The piece gives sound checks for pooled test work, where choice of traits and gauge of traits share one set of data.
Catalog record
| CREATOR | Qinyan Shen, Karl Gregory, Xianzheng Huang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11767
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Post-selection Inference in Regression Models for Group Testing Data Qinyan Shen, Karl Gregory, Xianzheng Huang Abstract We develop methodology for valid inference after variable selection in logistic regression when the responses are partially observed, that is, when one observes a set of error-prone testing outcomes instead of the true values of the responses. Aiming at selecting important covariates while accounting for missing information in the response data, we apply the expectation-maximization algorithm to compute maximum likelihood estimators subject to LASSO penalization. Subsequent to variable selection, we make inferences on the selected covariate effects by extending post-selection inference methodology based on the polyhedral lemma. Empirical evidence from our extensive simulation study suggests that our post-selection inference results are more reliable than those from naive inference methods that use the same data to perform variable selection and inference without adjusting for variable selection. 1 Introduction When testing a large number of individuals for a disease or infection, it can be advantageous to test individuals in groups rather than one-by-one. This strategy is called group testing. In group testing, individuals are placed (usually at random) into groups (often small, of 2 to 10 individuals), and the specimens drawn from the individuals in each group are combined into a single pooled specimen. Then the pooled specimen is tested for the presence of the disease or infection, giving a positive or negative result for each group. If individual diagnoses are desired, individuals in groups which tested positive can be retested one-by-one; depending on the goals of the study, one may or may not retest individuals in groups that tested positive. One advantage of group testing is that it can greatly reduce the cost of disease surveillance. Even if individuals in positive pools are retested, it is the case that when the disease is rare, the majority of the pools will test negative, resulting in a significant reduction in the total number of tests that need to be performed. A more hidden advantage to group testing is that, when positive pools are retested, one can, if the disease is rare, obtain more accurate estimators of disease prevalence, etc. than one would obtain if one tested individuals one-by-one. The reason for this is that each test is assumed to be liable to error; that is, it can give a false positive or a false negative result. The source of the hidden advantage can be put simply: The smaller the number of tests, the fewer the opportunities to make one of these errors. The sensitivity and specificity of the tests will therefore play an important role in any analysis of group testing data. The sensitivity of a test is the probability that it is positive when the infection is present, while its specificity is the probability that it is negative when the infection is absent. Throughout our work we will assume that the sensitivity and specificity of the group or individual tests are known and that they are less than 1 , so that each testing outcome is liable to error. Given the liability to error of each test, we will throughout this work make a distinction between testing outcomes associated with individuals, which we can observe, and individuals’ true disease statuses, which we cannot observe. Group testing has been implemented with success in many settings. Sinnott-Armstrong et al., (2020) demonstrated that the number of individuals it was possible to test was doubled with only a marginal increase in the number of testing kits needed when utilizing group testing for SARS-CoV-2 RNA detection; Verdun et al., (2021) further optimized group testing strategies tailored to the COVID-19 pandemic, leading to a 10-fold increase in testing efficiency. Pilcher et al., (2020) developed a model to assess the efficiency and accuracy of specimen pooling algorithms for SARS-CoV-2, and showed that group testing could enable rapid scale-up of testing and real-time surveillance of incidence. McMahan et al., (2017) report that the State Hygienic Laboratory at the University of Iowa, which tests thousands of Iowans annually for chlamydia and gonorrhea, has saved approximately $3.1 million from 2009 to 2014 by adopting a group testing approach. Besides disease detection, researchers are interested in performing logistic regression with group testing data in order to identify risk factors or important covariates for the prediction of disease incidence at the individual level. The main challenge to fitting regression models with group testing data is that instead of observing individuals’ true disease statuses, we observe testing outcomes which are only guaranteed to be correct with certain probabilities. As we will see in the development of our methods, the likelihood functions based on the observed testing outcomes are much more complicated than the likelihood functions based on individuals’ true disease statuses, and they depend intricately on the sensitivity and specificity of the tests. Xie, (2001) , Zhang et al., (2013) , and Gregory et al., (2019) addressed these complications by employing the expectation-maximization (EM) algorithm to estimate parameters in generalized linear regression models for the individual response based on group testing data. McMahan et al., (2017) took a Bayesian approach for regression analysis of group testing data. Joyner et al., (2020) formulated a Bayesian generalized linear mixed model that can accommodate any group testing protocol, and used a spike-and-slab prior to facilitate variable selection. Focusing on multiple-infection group testing data, Lin et al., (2019) proposed a method exploiting the LASSO penalty for variable selection to identify risk factors for each infection. Subsequent to variable selection, one may wish to make inferences on the effects of the selected covariates, such as testing hypotheses regarding covariate effects or constructing confidence intervals for them. A naive approach to inference after variable selection is to fit the regression model using only the selected covariates and then to make inference as though the process of choosing the covariates had not used the same data. There is abundant evidence in the literature that this naive approach can lead to inflated Type I error rates and confidence intervals that are too narrow ( Berk et al.,, 2013 ; Lee et al.,, 2016 ; Tibshirani et al.,, 2016 ) . As our own simulation studies demonstrate, naive post-selection inference will have the same undesired consequences in the case of regression with group testing data. We present a procedure for making valid post-selection inferences in this setting. The rest of the paper is organized as follows: We provide in Section 2 a brief review of post-selection inference literature. In Section 3 , we present the EM algorithm for LASSO-penalized estimation of regression parameters in a logistic regression model for individual testing data when the individual tests have some sensitivity Se and specificity Sp. We then derive a method for valid post-selection inference. Section 4 extends the method to group testing data. Section 5 presents simulation studies of the empirical performance of the proposed methodology and illustrates its implementation on a real data set. Section 6 outlines key takeaways and suggestions for future research. 2 Overview of post-selection inference Throughout this paper we will use the terms model selection and variable selection interchangeably to mean the process of deciding from among a set of available predictors which ones to keep. Post-selection inference aims to account for the uncertainty introduced