SurvBench: A Standardised Preprocessing Pipeline for Multi-Modal Electronic Health Record Survival Analysis
Munib Mesinovic, Tingting Zhu · 2025
Read SurvBench: A Standardised Preprocessing Pipeline for Multi-Modal Electronic Health Record Survival Analysis by Munib Mesinovic, Tingting Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11935.txt.
Introduction
Munib Mesinovic and Tingting Zhu tackle a quiet problem in medical AI. Survival models on health record data cannot be fairly compared across papers. The preprocessing that shapes the data is usually undocumented. It differs from paper to paper. A gap in reported concordance may reflect cohort choices, not modeling skill.
Their pipeline, SurvBench, is open source. It converts raw PhysioNet exports into model-ready tensors. Four critical-care databases are covered: MIMIC-IV, eICU, MC-MED, and HiRID. Four input types are handled, from time-series vitals to diagnosis codes. Standard preparation would let the field argue about models. Invisible plumbing would stop deciding the results.
Catalog record
| CREATOR | Munib Mesinovic, Tingting Zhu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-11935
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SurvBench: A Standardised Preprocessing Pipeline for Multi-Modal Electronic Health Record Survival Analysis Munib Mesinovic, Tingting Zhu Abstract Electronic health record (EHR) data present tremendous opportunities for advancing survival analysis through deep learning, yet reproducibility remains severely constrained by inconsistent preprocessing methodologies. We present SurvBench, a comprehensive, open-source preprocessing pipeline that transforms raw PhysioNet datasets into standardised, model-ready tensors for multi-modal survival analysis. SurvBench provides data loaders for three major critical care databases, MIMIC-IV, eICU, and MC-MED, supporting diverse modalities including time-series vitals, static demographics, ICD diagnosis codes, and radiology reports. The pipeline implements rigorous data quality controls, patient-level splitting to prevent data leakage, explicit missingness tracking, and standardised temporal aggregation. SurvBench handles both single-risk (e.g., in-hospital mortality) and competing-risks scenarios (e.g., multiple discharge outcomes). The outputs are compatible with pycox library packages and implementations of standard statistical and deep learning models. By providing reproducible, configuration-driven preprocessing with comprehensive documentation, SurvBench addresses the “preprocessing gap” that has hindered fair comparison of deep learning survival models, enabling researchers to focus on methodological innovation rather than data engineering. 1 Background & Summary Survival analysis, the statistical framework for modelling time-to-event data with censoring, has become increasingly important in healthcare applications ranging from mortality prediction to treatment response modelling ( Cox 1972 ; Kaplan and Meier 1958 ) . The advent of deep learning has introduced powerful non-linear methods capable of learning complex temporal patterns from electronic health records ( Kvamme et al. 2019 ; Lee et al. 2018 ; Katzman et al. 2018 ; Mesinovic et al. 2024 ; Mesinovic et al. 2025 ) . However, progress in this field has been substantially impeded by a critical “preprocessing gap”: the absence of standardised, reproducible pipelines for transforming raw EHR data into formats suitable for deep learning models in survival modelling. Existing benchmarks for clinical prediction tasks, such as those proposed by Harutyunyan et al. 2019 for MIMIC-III, have demonstrated the value of standardised preprocessing in enabling fair model comparison. However, these efforts have focused primarily on classification and regression tasks, with limited support for survival analysis. Furthermore, many preprocessing pipelines rely on intermediate CSV files that are not publicly available or require manual data transformation steps that introduce variability across implementations. This lack of standardisation makes it difficult to determine whether performance differences between methods stem from genuine algorithmic innovations or from subtle variations in data preprocessing decisions. 1.1 The Preprocessing Challenge in EHR Survival Analysis Electronic health records present unique challenges for survival analysis. These complexities require numerous preprocessing decisions that profoundly impact the performance of the downstream model ( Rajkomar et al. 2018 ; Shickel et al. 2018 ) . Critical choices include temporal aggregation strategies such as hourly binning versus fixed-width windows, each offering distinct trade-offs between temporal resolution and computational tractability ( Che et al. 2018 ; Lipton et al. 2016 ) . Missingness handling approaches range from simple imputation to explicit encoding through binary masks that preserve information about data availability ( Wells et al. 2013 ; Luo et al. 2016 ) . Feature selection criteria must balance clinical relevance against statistical considerations such as prevalence thresholds that determine which sparsely measured variables warrant inclusion ( García et al. 2016 ; Johnson et al. 2016a ) . Normalisation and scaling methods require careful consideration to ensure that features span comparable ranges while preserving meaningful variation ( Johnson et al. 2016b ; Harutyunyan et al. 2019 ) . The outcome definition and the censoring rules must align with clinical endpoints while accommodating administrative censoring and competing risks ( Putter et al. 2007 ; Andersen and Keiding 2012 ) . Finally, train-validation-test splitting protocols must enforce patient-level separation to prevent data leakage from repeated hospital encounters by the same individuals ( Wiens et al. 2016 ; Nestor et al. 2019 ) . Without standardised implementations of these decisions, researchers are forced to either re-implement preprocessing pipelines from scratch or rely on undocumented code, both of which introduce substantial variability and hinder reproducibility. 1.2 The Growing Need for Standardised Benchmarking The rapid proliferation of deep learning methods for survival analysis has created an urgent need for a standardised preprocessing and benchmarking infrastructure. As illustrated in Figure 1 , the field has experienced substantial growth in methodological innovation, with notable increases in published methods between 2020 and 2024. This surge includes diverse architectural approaches: Weibull-based parametric models (DeepWeiSurv) ( Ren et al. 2019 ) , competing risk frameworks handling multiple mutually exclusive outcomes (DeepCompete) ( Aastha et al. 2021 ) , transformer-based architectures leveraging attention mechanisms for temporal modelling (TransformerJM) ( Huang et al. 2022 ) , categorical time discretisation approaches (CAT-Surv) ( Zhang et al. 2023 ) , and conditional variational autoencoders for dynamic risk prediction (DySurv) ( Mesinovic et al. 2024 ) . The peak of 17 publications in 2022 reflects the rapid maturation of the field and the growing recognition of survival analysis as a critical application domain for deep learning in healthcare ( Wiegrebe et al. 2024 ) . However, this methodological diversity has paradoxically hindered rather than facilitated progress. Each publication typically introduces custom preprocessing pipelines tailored to specific datasets and prediction tasks, with limited documentation of critical implementation details, such as temporal aggregation strategies, feature selection criteria, and censoring protocols ( Harutyunyan et al. 2019 ; Nestor et al. 2019 ) . Consequently, the performance differences reported between methods may reflect preprocessing variations rather than genuine algorithmic improvements, making it difficult to identify which innovations truly advance the state-of-the-art ( Beam et al. 2020 ) . This “preprocessing gap” creates substantial barriers to entry for researchers seeking to benchmark new methods, as reproducing baseline comparisons requires reverse-engineering undocumented data preparation steps from incomplete method descriptions ( Peng 2011 ) . Furthermore, the absence of standardised benchmarks specific to survival analysis with electronic health records means that many studies evaluate methods on small-scale datasets or inappropriate tasks originally designed for classification rather than time-to-event modelling. This hinders fair comparison across methods and limits the ability of the community to assess generalisability across different clinical settings, patient populations, and outcome definitions ( Rajkomar et al. 2018 ; Sendak et al. 2020 ) . The emergence of diverse methodological approaches thus underscores the critical need for a transparent, reproducible preprocessing framework that enables rigorous evaluation while accommodating the unique challenges of survival analysis with censored, multi-modal EHR data. Figure 1 : Publication trends of deep learning survival analysis methods (2020–2024). The histogram shows the number of published deep learning methods for survival analysis by year, highlighting notable architectural innovations including parametric models (DeepWeiSurv, 2020), competing risks frameworks (DeepCompete, 2021), transformer-based approaches (TransformerJM, 2022), proportional hazards in neural models (CoxNAM, 2023), and complex inference models (DySurv/SurvMamba, 2024). This proliferation of methods without corresponding standardisation of preprocessing and benchmarking infrastructure motivates the development of SurvBench. Data compiled from major machine learning and medical informatics venues, including NeurIPS, ICML, ICLR, AAAI, CHIL, and domain-specific journals. 1.3 Current State of EHR Benchmarking Several initiatives have attempted to address the preprocessing challenge in clinical machine learning. The MIMIC-III benchmark by Harutyunyan et al. 2019 provides preprocessed data for four prediction tasks, but focuses on MIMIC-III (which has been superseded by MIMIC-IV) and does not