Staying Alive: Uncensored Survival Analysis with Tabular Foundation Models

Mariana Vargas Vieyra · 2026

Read Staying Alive: Uncensored Survival Analysis with Tabular Foundation Models by Mariana Vargas Vieyra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03689.txt.

Introduction

Vargas Vieyra adapts tabular foundation models to survival analysis without any training. Survival analysis models the time until an event of interest. It serves healthcare, churn prediction, and other fields. Its core snag is right-censoring, where event times are only partly observed. Tabular foundation models predict in one forward pass, with no dataset-specific fitting. Censoring had kept them from time-to-event tasks.

A training-free method closes that gap. A foundation model builds an accelerated failure time model, fitting just one scalar parameter. A Buckley-James style step then imputes censored values in context, without parameters. The loop predicts event times and refines the censored data in turn. Benchmark tests show the method rivals trained Cox and parametric models. Those rivals need full training runs. Practitioners get a near-instant survival tool for tabular data.

Catalog record

CREATORMariana Vargas Vieyra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03689

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Staying Alive: Uncensored Survival Analysis with Tabular Foundation Models Mariana Vargas Vieyra Abstract Survival Analysis (SA) is a statistical framework that models the time span until some event of interest occurs. Widely used in several domains, including healthcare and churn prediction, a central challenge in its applicability stems from the time of the event being partially observed or right-censoring . Tabular Foundation Models (TFM) have attracted significant interest in recent years due to their ability to perform prediction tasks in a single forward pass, requiring no dataset-specific parameter fitting. Despite their success, their application to prediction tasks on time-to-event data remains difficult due to right censoring. In this work, we present a training-free method to survival regression by leveraging TFMs to both predict the time of the event and iteratively impute right-censored data. Our method uses a TFM to construct an Accelerated Failure Time (AFT) model requiring no training beyond fitting a single scalar parameter. Subsequently, by building on the Buckley-James estimator, we introduce a non-parametric in-context estimator for right-censored data. Our experiments on standard survival analysis benchmarks show that our method is competitive with several parametric and semi-parametric survival regression models that require training, including Cox regression and parametric AFT models 1 1 1 Code at https://github.com/marianaw/frozenhazard.git . . 1 Introduction Survival Analysis (SA) ( 10 ) is a family of statistical procedures that aim to model the time from entry into a study and the occurrence of an event of interest, commonly referred to as time-to-event data. Applications of SA span numerous domains, such as healthcare ( 14 ) , churn prediction ( 13 ; 19 ) , and time to failure of mechanical systems ( 15 ) . In practice, time-to-event data is most commonly presented in tabular form, requiring backbone models that can handle tabular inputs natively. Tabular Foundation Models (TFM) ( 6 ; 7 ; 17 ; 18 ) have emerged as a promising paradigm for tabular data prediction tasks due to their ability to perform in-context classification and regression in a single forward pass with no dataset-specific training. However, they have limited applicability to survival regression due to right-censoring . Right-censoring is a ubiquitous phenomenon in SA: some subjects leave the study or reach the study horizon before the event occurs, leaving their event time unobserved. While classical survival models naturally account for censored data, TFMs expect fully observed prediction targets, rendering survival regression difficult. This problem requires sophisticated imputation strategies. 16 calculate pseudo-targets via jackknife leave-one-out iterations of the Kaplan-Meier estimator, transforming right-censored data into an unbiased and complete dataset. A principled solution was introduced by 1 , who proposed to calculate pseudo-targets for censored data by iteratively estimating the conditional expectation of the censored event time under the current model and updating the model accordingly. More recently, 11 introduced a TFM based algorithm that discretizes the time range and frames survival regression as a classification problem where the task is to predict the survival outcome in each bin. Even though this model can accommodate censored data, its performance is sensitive to the level of discretization, with coarser binning degrading the performance of the model. In this work we propose to frame survival regression as a prediction task and leverage TFMs for zero-shot survival prediction, introducing two complementary contributions. We first introduce a mechanism for constructing an Accelerated Failure Time model with a single scalar parameter by leveraging a TFM. To address censoring, we propose to leverage a TFM as a non-parametric in-context estimator for imputing censored data. Through experiments on five widely used survival benchmarks we demonstrate that our method achieves comparable performance to classical parametric and semi-parametric survival models that require training. 1.1 Background Survival analysis and the AFT model. We consider datasets of the form \{(t_{i},\Delta_{i},\mathbf{x}_{i})\}_{i=1}^{N} , where t_{i}=\min(T_{i},C_{i}) is the observed time, T_{i} is the event time, C_{i} is the censoring time and \Delta_{i}=\mathbf{1}(\tilde{t}_{i}\leq C_{i}) indicates whether the event was observed for subject i . In the Accelerated Failure Time (AFT) model, the logarithm of the event time is modeled linearly as \log T_{i}=\mathbf{x}_{i}^{\top}\beta+\sigma\epsilon_{i}\,, (1) where \epsilon_{i}\overset{\text{i.i.d.}}{\sim}\mathcal{N}(0,1) and \mathbf{x}_{i} is the vector of features characterizing subject i . Denoting \mu_{i}=\mathbf{x}_{i}^{\top}\beta , the corresponding survival function is \hat{S}(t\mid\mathbf{x}_{i})=1-\Phi\!\left(\frac{\log t-\mu_{i}}{\sigma}\right), (2) where \Phi denotes the standard Gaussian cumulative distribution function. Under right censoring, the log-likelihood is given by \begin{split}\ell(\sigma)=&\sum_{\Delta_{i}=1}\!\left[\log\phi\!\left(\frac{\log t_{i}-\mu_{i}}{\sigma}\right)-\log\sigma-\log t_{i}\!\right]\\ &+\sum_{\Delta_{i}=0}\log\!\left[1-\Phi\!\left(\frac{\log t_{i}-\mu_{i}}{\sigma}\right)\right].\end{split} (3) where \phi and \Phi denote the standard Gaussian density and cumulative distribution functions respectively. Buckley-James estimator. The Buckley-James estimator is an iterative regression technique for censored survival data that replaces each censored observation with its conditional expected value. That is, it computes Y_{i}^{*}=\mathop{\mathbb{E}}[\log T_{i}|\log T_{i}>\log C_{i},\mathbf{x}_{i},\beta] for censored subjects. This method combines the current model’s prediction with the Kaplan-Meier estimates of the residual distribution, allowing for a standard least-squares fit on the ”completed” dataset. More specifically, at each iteration, it defines the targets as: \displaystyle Y_{i}^{*}=\begin{cases}\log t_{i}&\text{if }\Delta_{i}=1\\[6.0pt] \hat{\mu}_{i}+\dfrac{\displaystyle\sum_{j:\,\tilde{e}_{j}>\tilde{e}_{i},\,\Delta_{j}=1}\tilde{e}_{j}\cdot w_{j}}{1-\hat{F}_{\epsilon}(\tilde{e}_{i})}&\text{if }\Delta_{i}=0\end{cases} where \tilde{e}_{i}=\log t_{i}-\hat{\mu}_{i} is the observed residual, \hat{F}_{\epsilon} is the Kaplan-Meier estimate of the residual distribution fitted on \{(\tilde{e}_{i},\Delta_{i})\}_{i=1}^{N} , and w_{j} are the probability masses assigned by \hat{F}_{\epsilon} at each uncensored residual. At its core, the Buckley-James procedure iteratively solves the following fixed point equation: \hat{\beta}=\left(\mathbf{X}^{\top}\mathbf{X}\right)^{-1}\mathbf{X}^{\top}\mathbf{Y}^{*}(\hat{\beta}) . 2 Survival Regression via In-Context Learning The goal of this work is to present a method for leveraging TFMs to perform survival regression without dataset-specific training. To this end, we frame survival regression as an in-context prediction task. Let (X_{\text{tr}},\mathbf{t}_{\text{tr}},\mathbf{\Delta}_{\text{tr}}) denote the training set and X_{\text{test}} the test set. We further define \mathcal{U}=\{i:\Delta_{i}=1\} and \mathcal{C}=\{i:\Delta_{i}=0\} as the set of uncensored and censored training instances respectively, and let f denote a TFM used as a regressor backbone. We then estimate the AFT model defined in Equation ( 1 ) by regressing the target through in-context learning: \hat{\mu}=f\!\left(\{\mathbf{x}_{i},\log t_{i}\}_{i\in\mathcal{U}},\ X_{\text{test}}\right). Once \hat{\mu} is obtained, we estimate \sigma by maximizing the log-likelihood in Equation ( 3 ): \hat{\sigma}=\arg\max_{\sigma}\ \ell(\sigma;\,\hat{\mu},\,\mathbf{t}_{\text{tr}},\,\mathbf{\Delta}_{\text{tr}}), over the full training set. Observe that \sigma is a scalar value and the sole trainable parameter in our model. This algorithm provides an effective way of leveraging TFMs for survival regression. However, restricting the training context to uncensored observations introduces bias, as samples with longer survival times are disproportionately censored, leading the model to underestimate survival times. To overcome this problem we propose to calculate pseudo-targets for censored data via an iterative mechanism analogous to the Buckley-James estimator. 2.1 Imputing censored data with TFMs The core idea is to use a TFM as a non-parametric in-context estimator, iteratively imputing survival times as pseudo-targets. Pseudo-targets are initialized with a data-driven warm start based on the Kaplan-Meier jackknife estimator. We then iteratively refine both the pseudo-targets and scale parameter \sigma . Initialization. Let t_{0} be the median observed event time and \tilde{\theta}_{i} the jackknife pseudo-observation of subject i at t_{0} , obtained via leave-one-out Kaplan-Meier estimation. We obtain a warm-start scale estimate \hat{\sigma}^{(0)} by maximizing Equation ( 3 ) using pseudo-observation-based predictions. Censored pseudo-targets are then initialized as: Y_{i}^{*(0)}=\max\!\left(\log t_{i},\ \log t_{0}-\hat{\sigma}^{(0)}\cdot\Phi^{-1}(1-\tilde{\theta}_{i})\right)\,, for i\in\mathcal{C} . This formulation inverts the AFT survival function at t_{0} to map pseudo-targets on the survival probability scale back to imputed log-times. The \max operation enforces T_{i}>C_{i} . Pseudo-targets and scale updates at iteration k . At each iteration

Read the complete text