Robust Survival Estimation under Interval Censoring: Expectation–Maximization and Bayesian Accelerated Failure Time Assessment via Simulation and Application

Joshua Korley · 2025

Read Robust Survival Estimation under Interval Censoring: Expectation–Maximization and Bayesian Accelerated Failure Time Assessment via Simulation and Application by Joshua Korley (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02634.txt.

Introduction

J. T. Korley wrote a 2025 solo biostatistics paper on survival analysis under interval censoring, which arises when the moment of an event is pinned down only between scheduled check-ups. Standard tools for right-censored data do not apply directly and can bias results.

Korley compares three tiers of method. An expectation-maximization version of the Turnbull estimator recovers the survival curve with few assumptions. Accelerated failure time models, in Weibull and log-normal forms, add smooth covariate effects. Bayesian versions of those models supply full uncertainty and principled model choice. Simulations show the first method best for curve recovery, the second best for prediction when correctly specified, and the third best calibrated. An ovarian cancer example demonstrates the combined workflow.

Catalog record

CREATORJoshua Korley
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-02634

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Survival Estimation under Interval Censoring: Expectation–Maximization and Bayesian Accelerated Failure Time Assessment via Simulation and Application Joshua Korley Abstract Interval censoring occurs when event times are only known to fall between scheduled assessments, a common design in clinical trials, epidemiology, and reliability studies. Standard right-censoring methods, such as Kaplan–Meier and Cox regression, are not directly applicable and can produce biased results. This study compares three complementary approaches for interval-censored survival data. First, the Turnbull nonparametric maximum likelihood estimator (NPMLE) via the EM algorithm recovers the survival distribution without strong assumptions. Second, Weibull and log-normal accelerated failure time (AFT) models with interval likelihoods provide smooth, covariate-adjusted survival curves and interpretable time-ratio effects. Third, Bayesian AFT models extend these tools by quantifying posterior uncertainty, incorporating prior information, and enabling interval-aware model comparisons via PSIS–LOO cross-validation. Simulations across generating distributions, censoring intensities, sample sizes, and covariate structures evaluated the integrated squared error (ISE) for curve recovery, integrated Brier score (IBS) for prediction, and coverage for uncertainty calibration. Results show that the EM achieves the lowest ISE for distribution recovery, AFT models improve predictive performance when families are correctly specified, and Bayesian AFT offers calibrated uncertainty and principled model selection. An application to the ovarian cancer dataset, restructured into interval-censored form, demonstrates the workflow in practice: the EM algorithm reveals the baseline shape, parametric AFT provides covariate-adjusted predictions, and Bayesian AFT validates model adequacy through posterior predictive checks. Together, these methods form a tiered strategy: EM for shape discovery, AFT for covariate-driven prediction, and Bayesian AFT for complete uncertainty quantification and model comparison. Keywords: interval censoring; EM algorithm; NPMLE; accelerated failure time; Bayesian survival; Brier score; simulation. 1 Introduction In many biomedical, engineering, and reliability studies, the event of interest is known to occur only between two scheduled assessments. This phenomenon, known as interval censoring , differs fundamentally from right censoring because the event time T_{i} for subject i is constrained to lie within an interval (L_{i},R_{i}] rather than being known only to exceed a single threshold [ 1 , 2 ] . Standard tools designed for right-censored data, such as the Kaplan–Meier estimator [ 3 ] or the Cox proportional hazards model [ 4 ] , are not directly applicable in this setting and can yield biased estimates of survival functions or regression effects when naively applied to interval-censored data. A major breakthrough was achieved by Turnbull [ 1 ] , who derived the nonparametric maximum likelihood estimator (NPMLE) under arbitrary interval-censoring. This estimator, obtained via an expectation–maximization (EM) procedure, allocates mass to a set of disjoint intervals, commonly referred to as “Turnbull intervals”and is fully data-driven without imposing structural assumptions on the hazard. The underlying EM updates follow the self-consistency principle introduced by Efron [ 5 ] . Subsequent methodological developments established efficient computation using iterative convex minorant (ICM) algorithms and convex optimization theory [ 6 , 7 ] and regression extensions under proportional hazards assumptions [ 8 ] . The NPMLE remains the foundation of nonparametric interval-censored survival analysis. Parametric approaches, such as accelerated failure time (AFT) models with Weibull or log-normal distributions, yield smooth curves, admit covariates, and provide interpretable regression effects [ 9 , 10 ] . In particular, the coefficients in the AFT models correspond to multiplicative shifts in the median or mean survival times. These advantages make AFT models attractive for predictions and extrapolations. However, their limitation lies in distributional misspecification: when the true data-generating process deviates from the assumed family, especially in the tails or under heavy censoring, the resulting estimates may be biased. Bayesian survival models extend parametric AFT formulations by placing priors on regression coefficients and shape parameters, thereby enabling full posterior inference and principled uncertainty quantification [ 11 , 12 ] . The likelihood contribution for interval-censored observations is naturally expressed as the survival probability mass between L_{i} and R_{i} , which integrates seamlessly into the Bayesian framework. Posterior predictive checks (PPCs) provide model-based diagnostics by assessing whether replicated data from the fitted posterior allocate the appropriate probability mass to each censoring interval [ 13 ] . Model comparison is facilitated by information criteria such as WAIC or PSIS–LOO cross-validation [ 14 , 15 ] , offering an interval-aware approach to assessing the adequacy of competing families. With modern Hamiltonian Monte Carlo implementations, Bayesian AFT models are computationally tractable, even for moderately large datasets. Interval-censored data arise frequently in biomedical research, for example, periodic imaging in oncology trials, incubation periods in infectious disease studies such as HIV/AIDS, and scheduled follow-ups in Alzheimer’s disease cohorts [ 2 , 16 , 17 ] . In engineering and reliability contexts, lifetime testing under inspection regimes also produces interval-censored outcomes [ 18 ] . These applications illustrate the necessity of methods that respect the interval structure; naive approaches such as midpoint imputation or treating right endpoints as exact event times can lead to severe bias in both survival estimation and covariate effects [ 19 ] . From a methodological perspective, interval censoring occupies an intermediate position between exact survival data and grouped outcome data. Unlike right censoring, which admits partial likelihood methods [ 4 , 20 ] , the interval-censored likelihood requires the integration of the density over subject-specific observation windows. This challenge has motivated developments in EM algorithms [ 1 ] , self-consistency iterations [ 5 ] , convex optimization approaches [ 6 ] , and spline-based semiparametric models [ 21 , 2 ] . Recent extensions include penalized regression, frailty models, and high-dimensional variable selection for complex interval-censored design. Contributions. This study provides a unified comparative study of three complementary approaches for interval-censored survival analysis: (i) a derivation and implementation of the EM algorithm for the Turnbull NPMLE, serving as a nonparametric benchmark; (ii) Parametric Weibull and log-normal accelerated AFT models with interval likelihoods, incorporating covariates to yield interpretable time-ratio effects. (iii) Bayesian AFT models with weakly informative priors, enabling full uncertainty quantification, posterior predictive validation, and principled model comparisons. We evaluated these methods through simulation scenarios that varied the generating distribution, censoring intensity, sample size, and covariate structure, using integrated squared error (ISE), integrated Brier score (IBS), and empirical coverage as performance criteria. In addition, we applied the workflow to an ovarian cancer dataset, restructured into an interval-censored form by imposing periodic assessment windows, thereby demonstrating how the methodology extends to real clinical data. Outline. Section 2 formalizes the data structure and likelihood of interval censoring. Section 3 presents the EM algorithm for the NPMLE, parametric and Bayesian AFT formulations, and the posterior computation. Section 4 describes the simulation scenarios and the applied analysis of the ovarian dataset. Section 5 reports the simulation and applied results, and Section 5.2 introduces the performance metrics (ISE, IBS, and coverage). Section 6 discusses the implications and limitations of this study and suggests future research directions. 2 Data structure and likelihood Let T_{i} denote the event time for subject i=1,\dots,n , with distribution function F(t)=P(T_{i}\leq t) , survival function S(t)=1-F(t) , and density f(t)=F^{\prime}(t) . Here, f(t)=F^{\prime}(t) denotes the event time density. Under interval censoring, we observe (L_{i},R_{i}] such that P(L_{i}<T_{i}\leq R_{i}\mid F)=1 , where 0\leq L_{i}<R_{i}\leq\infty . For interval-censored observations, the probability that T_{i} lies within the observed interval (L_{i},R_{i}] can be expressed equivalently as P(L_{i}<T_{i}\leq

Read the complete text