Two-Phase Sampling Designs and Analysis Approaches for Ordinal Outcomes
Yunbi Nam, Nathan I. Shapiro, Eric P. Schmidt, Wesley H. Self, Ran Tao, Jonathan S. Schildcrout · 2026
Read Two-Phase Sampling Designs and Analysis Approaches for Ordinal Outcomes by Yunbi Nam, Nathan I. Shapiro, Eric P. Schmidt, Wesley H. Self, Ran Tao, Jonathan S. Schildcrout (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27330.txt.
Introduction
Yunbi Nam and colleagues extend two-phase sampling designs to studies with ordinal outcomes. They propose three outcome-informed ways to pick the phase 2 subset, then build valid estimation methods around them. Simulations beat simple random sampling, and a sepsis trial example links interleukin-6 to a four-level clinical status outcome.
Catalog record
| CREATOR | Yunbi Nam, Nathan I. Shapiro, Eric P. Schmidt, Wesley H. Self, Ran Tao, Jonathan S. Schildcrout |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54809 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27330
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Two-Phase Sampling Designs and Analysis Approaches for Ordinal Outcomes Yunbi Nam, Nathan I. Shapiro, Eric P. Schmidt, Wesley H. Self, Ran Tao, Jonathan S. Schildcrout Abstract Modern clinical trials and cohort studies gather low-cost data on all participants but may have limited resources to assess expensive exposures such as biomarkers or genomic data. When interest lies in associations involving expensive exposures, two-phase designs provide a cost-effective framework by using information available on all participants to guide the targeted selection of a subset for additional measurements. We extend this framework to studies with ordinal outcomes, a common yet previously unexplored setting. We propose three outcome-informed phase 2 sampling designs—outcome-dependent sampling (ODS), covariate-stratified ODS, and residual-dependent sampling—that leverage phase 1 data to enrich phase 2 selection with informative subjects. We then develop analysis methods for valid and efficient estimation/inference, including conditional likelihood methods with ascertainment-corrected maximum likelihood estimation, multiple imputation, and a full likelihood method using sieve maximum likelihood estimation. Across a range of scenarios, simulation studies show that the proposed methods substantially improve efficiency over simple random sampling with standard maximum likelihood estimation. We further demonstrate their practical utility by examining the association between interleukin-6 and a four-level clinical status outcome—discharged, hospitalized but not in the ICU, hospitalized in the ICU, and death—14 days after randomization into the Crystalloid Liberal or Vasopressors Early Resuscitation in Sepsis trial. \contributed Ran Tao and Jonathan S. Schildcrout contributed equally to this work. keywords Two-phase studies | ordinal outcomes | outcome-dependent sampling | likelihood-based inference | multiple imputation | semiparametric regression \corres Yunbi Nam () \fundingInfo National Institute of Health, Grant Number: R01HL094786 and R01AI131771 1 Introduction Modern clinical trials and cohort studies routinely collect low-cost, essential data ( e.g. , treatment, baseline covariates, and outcomes) on all participants and collect and store biospecimens for future use. Biospecimen storage creates unique opportunities to address new scientific questions, after the primary study has been completed, about biomarker associations with outcomes or treatment effectiveness. However, biomarker measurement from stored samples is often expensive and therefore infeasible for the full cohort. In these settings, selecting a subset of participants for measurement is needed. Two-phase study designs provide a cost-effective framework for deciding which participants to select for such measurements: the selection of the phase 2 subset is informed by readily available phase 1 data, allowing for the strategic allocation of limited resources to measure expensive exposures 12 , 22 . The success of this framework hinges on two key elements: judicious sampling of participants for exposure ascertainment and valid, efficient statistical analysis of collected data. Enriching phase 2 samples with informative subjects—typically those with more extreme outcome values—has been shown to improve statistical efficiency. For binary outcomes, case-control designs, wherein cases are oversampled, are particularly effective for rare diseases 3 , while for continuous outcomes, oversampling individuals in the tails improves efficiency relative to simple random sampling (SRS) 25 , 10 . Efficiency can be further increased by stratifying on both the outcome and previously collected, phase 1 covariates 2 . More recent research has demonstrated efficiency gains by oversampling individuals with extreme residuals from a working regression model of the outcome on inexpensive covariates 10 , 17 , 19 , 7 . While efficient sampling designs can yield highly informative phase 2 subcohorts, it is well known that naive analyses ( i.e. , those that ignore the sampling scheme) generally lead to biased estimates. One well-known exception involves logistic regression under case-control designs where valid inferences regarding covariate-outcome associations are obtained even when the biased sampling study design is ignored 4 , 13 . Beyond such special cases, valid inference requires accounting for the sampling design, either through design-based or likelihood-based methods. Design-based methods represent the full phase 1 cohort by weighting the phase 2 subcohort using known selection probabilities, for example, through inverse probability weighting 8 , 5 , while likelihood-based methods explicitly incorporate the selection mechanism into a model-based likelihood. While design-based methods offer robustness to model misspecification, likelihood-based methods can be substantially more efficient than design-based methods 1 . In this paper, we focus on developing valid and efficient likelihood-based inference procedures. Within likelihood-based methods, we broadly classify analysis approaches into complete-case and full-data approaches. Complete-case approaches use only data collected from subjects selected in phase 2 and correct for biased sampling by incorporating the sampling probabilities into a conditional likelihood 23 , 14 . In contrast, full-data approaches retain the entire phase 1 cohort by combining complete data from subjects selected for phase 2 with partial data ( i.e. , covariates and outcomes but not the expensive exposure) from those not selected. For example, Schildcrout et al. 15 proposed multiple imputation with a parametric imputation model to fill in unobserved exposure in unselected subjects, while Tao, Zeng, and Lin 18 developed a semiparametric likelihood method that incorporates subjects with missing exposures by nonparametrically approximating the conditional exposure distribution. While most research on two-phase designs and analyses have focused on continuous, binary, and time-to-event outcomes, clinical and epidemiological studies often collect ordinal outcomes to capture graded disease severity and clinical progression. The use of such ordinal endpoints has grown in recent years, particularly during the COVID-19 pandemic when the World Health Organization introduced an ordinal clinical progression scale to standardize COVID-19 severity assessment across trials 24 , 16 . Ordinal endpoints also arise in other clinical settings; for example, the Crystalloid Liberal or Vasopressors Early Resuscitation in Sepsis (CLOVERS) trial collected daily patient status data, which allowed construction of many ordinal outcomes including hospital-free days and ICU-free days 20 . Despite the increasing prevalence of ordinal outcomes in clinical research, specifically in critical care research, two-phase methods have not yet been extended to accommodate ordinal outcomes. To address this gap, we develop the first unified framework for two-phase studies with ordinal outcomes, making three distinct contributions. First, we derive efficient phase 2 sampling designs specifically tailored to ordinal outcomes under the proportional odds model, including outcome-dependent sampling (ODS), covariate-stratified ODS (CSODS), and residual-dependent sampling (RDS). These designs exploit the ordered structure of the outcome to concentrate sampling resources on the most informative subjects—a strategy that, to our knowledge, has not previously been studied for ordinal data. Second, we develop three complementary likelihood-based inference procedures that are valid under these designs: a complete-case approach based on ascertainment-corrected maximum likelihood (ACML), and two full-data approaches—multiple imputation (MI) and sieve maximum likelihood estimation (SMLE)—that recover information from unsampled subjects. Third, we evaluate the finite-sample operating characteristics of all proposed design-analysis combinations in the ordinal outcome setting through extensive simulations and a plasmode study, demonstrating that the proposed designs and estimators yield substantial efficiency gains over simple random sampling with standard analyses. The rest of the paper is organized as follows. Section 2 introduces the proportional odds model and establishes notation. Section 3 develops the phase 2 sampling designs, followed by inference procedures in Section 4. Section 5 evaluates the finite-sample operating characteristics of the proposed design–analysis approaches through simulation studies. Section 6 demonstrates their practical utility in a plasmode simulation study 6 using data from the CLOVERS trial. Finally, Section 7 concludes with a discussion. 2 The Proportional Odds Model Consider an ordinal outcome Y\in\{1,\dots,k\} with k