Learning temporal embeddings from electronic health records of chronic kidney disease patients

1 st Aditya Kumar, 2 nd Mario A. Cypko, 3 rd Oliver Amft · 2026

Read Learning temporal embeddings from electronic health records of chronic kidney disease patients by 1 st Aditya Kumar, 2 nd Mario A. Cypko, 3 rd Oliver Amft (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18675.txt.

Introduction

Aditya Kumar, Mario Cypko, and Oliver Amft teach tools to read the long health files of people with sick kidneys in a way that keeps the sense of the file. Each file is a long chain of tests, drugs, and stays. A tool can crush that chain into a short code that sums up the path of the disease. Most such codes are built to ace one task and are hard to read.

The team ask if a code can stay clear and of use for many tasks at once. They vary how the tool is built and grade how that shifts the worth of the code. A clear code that keeps its skill could serve many wards at once. It could also help staff see why a tool makes a call. Kidney care, with its long files, is a hard test case.

Catalog record

CREATOR1 st Aditya Kumar, 2 nd Mario A. Cypko, 3 rd Oliver Amft
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-18675

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning temporal embeddings from electronic health records of chronic kidney disease patients Thanks: This work is funded by German G-BA, grant number 01NVF21116. 1 st Aditya Kumar, 2 nd Mario A. Cypko, 3 rd Oliver Amft Abstract We investigate whether temporal embedding models trained on longitudinal electronic health records can learn clinically meaningful representations without compromising predictive performance, and how architectural choices affect embedding quality. Model-guided medicine requires representations that capture disease dynamics while remaining transparent and task-agnostic, whereas most clinical prediction models are optimised for a single task. Representation learning facilitates learning embeddings that generalise across downstream tasks, and recurrent architectures are well-suited for modelling temporal structure in observational clinical data. Using the MIMIC-IV dataset, we study patients with chronic kidney disease (CKD) and compare three recurrent architectures: a vanilla LSTM, an attention-augmented LSTM, and a time-aware LSTM (T-LSTM). All models are trained both as embedding models and as direct end-to-end predictors. Embedding quality is evaluated via CKD stage clustering and in-ICU mortality prediction. The T-LSTM produces more structured embeddings, achieving a lower Davies–Bouldin Index (DBI = 9.91) and higher CKD stage classification accuracy (0.74) than the vanilla LSTM (DBI = 15.85, accuracy = 0.63) and attention-augmented LSTM (DBI = 20.72, accuracy = 0.67). For in-ICU mortality prediction, embedding models consistently outperform end-to-end predictors, improving accuracy from 0.72–0.75 to 0.82–0.83, which indicates that learning embeddings as an intermediate step is more effective than direct end-to-end learning. I Introduction Modern healthcare is increasingly shaped by the vision of model-guided medicine (MGM) [ 1 , 2 ] . In MGM models move beyond static prediction to become continuous companions in patient care [ 2 , 3 ] . MGM also forms the foundation for digital patient models or digital twins, computational representations of individual patients that can predict disease trajectories, evaluate therapy options, and support personalised care [ 4 , 5 , 6 , 7 , 8 ] . However, in most clinical applications models have been built for single, task-specific objectives e.g., monitoring or disease progression [ 8 , 9 , 10 ] , mortality prediction [ 11 , 12 ] , readmission risk [ 13 ] , etc. The task-specific training objectives demonstrate perform well, however, such learning is tailored to a particular task rather than to the broader dynamics of disease progression. Thus, the task-specific models are difficult to extend to new endpoints without retraining from scratch [ 14 ] , which makes them unsuitable for dynamically changing clinical scenarios. Furthermore, because the internal representations of task-specific models are rarely examined [ 15 ] , it remains unclear whether the task-specific models truly capture the underlying clinical state. Therefore, there is a need to move from task-specific modelling to representation-centric modelling. An embedding model is a type of model designed not merely to predict outcomes, but to learn dense vector representations (i.e., embeddings) that encodes complex, high-dimensional input data (e.g., longitudinal EHR) into a compact, continuous space [ 16 ] . Recent work in representation learning in clinical applications have demonstrated the that one embedding can support multiple downstream tasks e.g., phenotyping [ 17 ] . A few studies have explored the application of representation learning to clinical time series [ 18 ] , however, systematic investigations remain limited. EHRs represent one of the most prominent sources of temporal data in routine healthcare. EHRs capture a patient’s evolving physiological state through laboratory tests, vital signs, medications, procedures over time [ 19 , 20 ] . However, modelling real-world EHR data is challenging due to high dimensionality [ 21 ] , irregular sampling [ 21 , 22 , 23 ] , and complex temporal dynamics [ 21 ] . Recurrent architectures, particularly Long Short-Term Memory (LSTM) networks are widely used to model EHR data for predicting clinical outcomes from patient data sequences [ 24 ] . Extensions of LSTMs including attention-augmented LSTMs [ 25 ] and time-aware LSTMs (T-LSTM) [ 26 ] address challenges associated with long sequences and irregular sampling respectively. Nevertheless, LSTM-based modelling approaches remain predominantly task-specific, i.e., trained end-to-end for a single supervised objective and evaluated solely on predictive performance for the task [ 27 ] . Consequently, LSTM-based approaches fall short of learning task-agnostic, clinically meaningful embeddings that can support the multi-objective reasoning required for MGM and digital patient modelling. To address the aforementioned gaps, this work investigates whether embedding models trained on longitudinal EHR data can produce clinically meaningful representations without sacrificing predictive performance. We compared three recurrent architectures on a cohort of Chronic Kidney Disease (CKD) patients: a vanilla LSTM, an attention-augmented LSTM, and a T-LSTM (see Fig. 1 ). Fig. 1: Overview of the approach. (a) Longitudinal EHR data are extracted and preprocessed to construct patient-specific time series. (b) Clinical trajectories are represented as irregularly sampled multivariate sequences with explicit time intervals. (c) Temporal models, including vanilla LSTM, attention-augmented LSTM, and T-LSTM, are trained as embedding models and end-to-end predictors. (d) The embedding models generate compact latent patient representations. (e) Embeddings are evaluated using intrinsic clustering analyses and extrinsic downstream prediction tasks. All three models were trained in two configurations: as embedding models and as direct end-to-end predictor models. The embedding models were trained to learn patient representations by differentiating between CKD stages. The learnt representations were subsequently used for downstream prediction of in-ICU mortality. The end-to-end predictor models were trained directly to predict in-ICU mortality from longitudinal EHR data. We assessed the quality of learnt embeddings using two complementary evaluation strategies. First, clustering analysis to examine whether patients naturally grouped according to CKD stages within the learnt embedding space. Second, downstream prediction to test whether the embeddings retained sufficient information for in-ICU mortality prediction. The two-step evaluation separates the learning of patient representations from the outcome-specific classifier, to measure how well embeddings generalise beyond the training objective. Our work makes following contributions: 1. We demonstrate that learning patient embeddings as an intermediate objective leads to better downstream prediction than direct end-to-end training across recurrent architectures. 2. We demonstrate that explicit modelling of irregular time intervals (T-LSTM) is particularly effective at learning structured and clinically meaningful representations from longitudinal EHR data. II Methods II-A Dataset We used MIMIC-IV v2.2 [ 28 ] for our study. We focused on a cohort of CKD patients. We utilised the pipeline of Gupta et al. [ 29 ] to extract our cohort (referred as CKD cohort). The CKD cohort consisted of 3932 patients diagnosed with CKD, amounting to 10,000 admission cases. The MIMIC-IV dataset is divided into two domains: hospital and ICU. The hospital domain consists of tables including patient’s personal information, records of hospital admission, records of ICD-9 and ICD-10 coded diagnoses, details on prescribed medicates, lab measurements. The ICU domain consist of tables including records of ICU stays, records of ICD-9 and ICD-10 coded diagnoses for each ICU stay, records of administered fluids and medications, chart events, procedure events. II-B Data processing Each patient admission in the CKD cohort was split into three structured files: demographic file (consisting of demographic details specific to the patient including subject_id, age, sex), static features (consisting of all static features in one single hospital or ICU stay), and time-series features (e.g., medications, lab events, procedures that change repeatedly

Read the complete text