Tackling Small Sample Survival Analysis via Transfer Learning: A Study of Colorectal Cancer Prognosis

Yonghao Zhao, Changtao Li, Chi Shu, Qingbin Wu, Hong Li, Chuan Xu, Tianrui Li, Ziqiang Wang, Zhipeng Luo *, Yazhou He * · 2025

Read Tackling Small Sample Survival Analysis via Transfer Learning: A Study of Colorectal Cancer Prognosis by Yonghao Zhao, Changtao Li, Chi Shu, Qingbin Wu, Hong Li, Chuan Xu, Tianrui Li, Ziqiang Wang, Zhipeng Luo *, Yazhou He * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12421.txt.

Introduction

Yonghao Zhao and co-authors borrow strength from big data sets to predict survival in small cancer cohorts in a 2025 paper. Prognosis models starve when a clinic has few cases. Transfer learning pre trains on a large related set, then fine tunes on the small one. The team adapted the idea to four common survival models.

The test case was stage one colon cancer: 27,379 registry patients as the source and 728 hospital patients as the target. Every model improved with transfer. One forest based method reached the top score, and gains grew even larger when target data shrank to as few as 50 cases.

Catalog record

CREATORYonghao Zhao, Changtao Li, Chi Shu, Qingbin Wu, Hong Li, Chuan Xu, Tianrui Li, Ziqiang Wang, Zhipeng Luo *, Yazhou He *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12421

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tackling Small Sample Survival Analysis via Transfer Learning: A Study of Colorectal Cancer Prognosis Yonghao Zhao, Changtao Li, Chi Shu, Qingbin Wu, Hong Li, Chuan Xu, Tianrui Li, Ziqiang Wang, Zhipeng Luo *, Yazhou He * Abstract Survival prognosis is crucial for medical informatics. Practitioners often confront small-sized clinical data, especially cancer patient cases, which can be insufficient to induce useful patterns for survival predictions. This study deals with small sample survival analysis by leveraging transfer learning, a useful machine learning technique that can enhance the target analysis with related knowledge pre-learned from other data. We propose and develop various transfer learning methods designed for common survival models. For parametric models such as DeepSurv, Cox-CC (Cox-based neural networks), and DeepHit (end-to-end deep learning model), we apply standard transfer learning techniques like pretraining and fine-tuning. For non-parametric models such as Random Survival Forest, we propose a new transfer survival forest (TSF) model that transfers tree structures from source tasks and fine-tunes them with target data. We evaluated the transfer learning methods on colorectal cancer (CRC) prognosis. The source data are 27,379 SEER CRC stage I patients, and the target data are 728 CRC stage I patients from the West China Hospital. When enhanced by transfer learning, Cox-CC’s C t ​ d C^{td} value was boosted from 0.7868 to 0.8111, DeepHit’s from 0.8085 to 0.8135, DeepSurv’s from 0.7722 to 0.8043, and RSF’s from 0.7940 to 0.8297 (the highest performance). All models trained with data as small as 50 demonstrated even more significant improvement. Conclusions: Therefore, the current survival models used for cancer prognosis can be enhanced and improved by properly designed transfer learning techniques. The source code used in this study is available at https://github.com/YonghaoZhao722/TSF. Journal: Arxiv 1 Introduction Survival analysis is a fundamental statistical method in medical research, which not only focuses on one or more events of interest, such as death and disease progression, but also the time duration, providing a mixed time-to-event measure for medical research [ 1 ] . Common statistical approaches, including the Kaplan-Meier estimator and the Cox proportional hazards model, have enabled researchers to estimate survival probabilities which could be further compared across different treatment groups while adjusting for covariates. This allows for a more nuanced understanding of how prognostic predictors contributed to outcome events over time [ 2 ] . The precision and robustness of survival analysis are highly contingent upon the number of patients enrolled and the incidence rate of the event of interest [ 3 ] . However, the prolonged follow-up time and relatively low event rates often render it prohibitive to aggregate large sample sizes in prognostic research. For instance, a common study design that investigated prognostic outcomes—clinical trials often involve small sample sizes ( < 200) based on statistics from the FDA [ 4 , 5 ] . Furthermore, there has been a growing interest in personalized medicine which relies heavily on analyses in small samples of patients with specific molecular characteristics [ 6 , 7 ] . These lead to a compelling need in novel analytic approaches that improves efficiency in statistical modelling and prediction performance [ 8 ] , in order to help inform clinical decision-making and policy formulation. Recently, more and more open-access large datasets became available, such as population-based biobanks (e.g. UK Biobank) and registry-based datasets (e.g. Surveillance, Epidemiology, and End Results Program, SEER), providing rich sources of knowledge for studying disease outcomes [ 9 , 10 ] . Transfer learning is a powerful technique in machine learning that can leverage these related large datasets to develop a pre-trained model which is then applied to improve learning and prediction performance on a smaller dataset [ 11 , 12 ] . In this study, we aimed to deal with a common challenge in medical research—to improve prediction performance based on small sample datasets in the setting of survival analysis. We investigated multiple machine learning techniques that were developed for survival analysis, including DeepSurv, Cox-CC, DeepHit, and Random Survival Forests, and developed transfer learning frameworks that incorporated these models to predict survival outcomes. We illustrated these frameworks by providing a real-word example using the SEER database as a pre-trained dataset and applying the trained model to a local cohort of colorectal cancer patients. Specifically, for DeepSurv, Cox-CC, and DeepHit model, we simply applied standard transfer learning techniques including model pretraining (pretrain a network on a source task), retraining (all the network parameters to be re-optimized on the target task), and fine-tuning (part of the parameters to be re-optimized). For random survival forests, we developed novel transferring techniques, which grow a forest on a source task and then “transplant” trees of different depths and of different feature combinations to the target task. 2 Background In this section, we briefly introduce the basic concepts of survival analysis (SA) and the prevailing SA models including DeepSurv, Cox-CC, DeepHit, and random survival forests. For more in-depth background, please refer to Klein and Moeschberger ( 2003 ). In general, the objective of SA is to model the distribution of the time T^{*} to some event of interest. Denote by F(t):=P(T^{*}\leq t) the cumulative distribution function and by f(t):=\frac{dF(t)}{dt} its density function. Instead of directly estimating F(t) , we often study the survival function S(t) and model the hazard rate h(t) , defined as follows: S(t):=P(T^{*}>t)=1-F(t) (1) h(t)=\frac{f(t)}{S(t)}=\lim_{\triangle t\to 0}\frac{1}{\triangle t}P(t\leq T^{*}<t+\triangle t\mid T^{*}\geq t) (2) Then, the cumulative hazard H(t) is frequently used as an intermediate step to calculate S(t) : H(t):=\int_{0}^{t}h(u)du=-\log(S(t)) (3) 2.1 Cox Regression with Neural Networks The Cox Proportional Hazards Model (CPH) is a classic yet popular model in survival analysis. This semi-parametric model assumes that all observations have the same form of the conditional hazard function: h(t|\mathbf{x})=h_{0}(t)\exp(g(\mathbf{x})),\hskip 14.22636ptg(\mathbf{x})=\beta^{T}\mathbf{x} (4) where h_{0}(t) is the baseline hazard function, \exp[g(\mathbf{x})] the relative risk function of given covariates \mathbf{x} , and \beta the vector of regression coefficients. \beta is usually estimated by minimizing the negative log-partial likelihood: -l(\beta)=-\sum_{i}\delta_{i}\log\left(\sum_{j\in R_{i}}\exp[g(\mathbf{x}_{j})-g(\mathbf{x}_{i})]\right) (5) where \delta_{i} is the indicator, being one if the i -th individual has experienced the event; and R_{i} is the set of individuals still at risk at time t_{i} . The DeepSurv model extends the CPH model by using a neural network to estimate the log-risk function g(\mathbf{x}) instead of the linear combination \beta^{T}\mathbf{x} : \theta_{j}=G(W\mathbf{x}_{j}+b)^{T}\beta (6) where W is the weight matrix between the input and hidden layer size H\times D , H the number of neurons in the hidden layer, D the number of input features, b the bias vector, and G a nonlinear activation function. Then, Equation ( 5 ) can be re-written as: -l(\beta,W,b)=\sum_{\delta_{i}=1}{\theta_{i}-\log\left[\sum_{j\in R_{i}}\exp(\theta_{j})\right]} (7) To improve the computation efficiency which is important in transfer learning, Kvamme and Borgan (2019)’s Cox-CC (Case-Control) employs a subset \widetilde{R}_{i} sampled from the full risk set R_{i} to approximate the entire risk set. 2.2 DeepHit In contrast to Cox-based models, DeepHit by Lee et al. bypasses the Cox hazards and directly estimates the survival distribution F(t) using neural networks. DeepHit studies on discretized times 0=\tau_{0}<\tau_{1}<\tau_{2}<...<\tau_{m} . Denote by y_{k}(\mathbf{x}_{i})=\hat{P}(T^{*}_{i}=\tau_{k}\mid\mathbf{x}_{i}) the estimated probability mass function of the times which are outputs of a neural network with covariates \mathbf{x} . Then, the estimated survival function can be written as: \hat{S}(\tau_{k}\mid\mathbf{x}_{i})=1-\sum^{k}_{\kappa=1}y_{\kappa}(\mathbf{x}_{i}) (8) And the discretized negative

Read the complete text