Learning Dynamic Representations and Policies from Multimodal Clinical Time-Series with Informative Missingness
Zihan Liang, Ziwen Pan, Ruoxuan Xiong · 2026
Read Learning Dynamic Representations and Policies from Multimodal Clinical Time-Series with Informative Missingness by Zihan Liang, Ziwen Pan, Ruoxuan Xiong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21235.txt.
Introduction
Zihan Liang, Ziwen Pan, and Ruoxuan Xiong learn patient representations from multimodal clinical time series while exploiting a neglected signal: which measurements get recorded, and when. Their framework pairs a multimodal encoder that reads structured data, notes, and observation patterns with Bayesian filtering that updates a latent patient state over time. Downstream modules then learn treatment policies offline and predict outcomes from that state. On ICU sepsis cohorts from MIMIC-III, MIMIC-IV, and eICU, it beats clinician behavior on policy learning and scores strongly on post-72-hour mortality prediction.
Catalog record
| CREATOR | Zihan Liang, Ziwen Pan, Ruoxuan Xiong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105768 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21235
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Dynamic Representations and Policies from Multimodal Clinical Time-Series with Informative Missingness Zihan Liang, Ziwen Pan, Ruoxuan Xiong Abstract Multimodal clinical records contain structured measurements and clinical notes recorded over time, offering rich temporal information about the evolution of patient health. Yet these observations are sparse, and whether they are recorded depends on the patient’s latent condition. Observation patterns also differ across modalities, as structured measurements and clinical notes arise under distinct recording processes. While prior work has developed methods that accommodate missingness in clinical time series, how to extract and use the information carried by the observation process itself remains underexplored. We therefore propose a patient representation learning framework for multimodal clinical time series that explicitly leverages informative missingness. The framework combines (1) a multimodal encoder that captures signals from structured and textual data together with their observation patterns, (2) a Bayesian filtering module that updates a latent patient state over time from observed multimodal signals, and (3) downstream modules for offline treatment policy learning and patient outcome prediction based on the learned patient state. We evaluate the framework on ICU sepsis cohorts from MIMIC-III, MIMIC-IV, and eICU. It improves both offline treatment policy learning and adverse outcome prediction, achieving FQE 0.679 versus 0.528 for clinician behavior and AUROC 0.886 for post-72-hour mortality prediction on MIMIC-III. 1 Introduction Electronic health records are multimodal, consisting of structured data, such as vital signs and laboratory measurements, as well as clinical texts, such as notes and reports. These data are recorded longitudinally and encode rich temporal information about how patient health evolves over time. This makes it possible to learn dynamic patient representations that support both outcome prediction and sequential clinical decision-making. However, two key features exist in clinical observations that complicate how such representations should be learned. Figure 1: Text and structured observations exhibit temporal MNAR patterns in ICU care. (A) Two representative MIMIC-III ICU stays illustrate how acuity and observation processes co-evolve. The top row shows SOFA severity (higher = sicker); the lower rows show counts of vital-sign observations, laboratory observations, and text updates within each 4-hour bin. Compared with a lower-acuity stay (A1), a higher-acuity stay (A2) shows rising SOFA, denser laboratory measurements, and burstier documentation. (B) Across ICU stays, greater structured monitoring intensity is associated with higher in-hospital mortality. (C) Clinical text follows the same endogenous pattern: higher-acuity decision steps are more likely to already have text available and to receive new text within the next 4 hours. First, they are often sparse and irregular, and their observation process depends on both clinician decisions and the patient’s underlying health state. Figure 1 (A) illustrates this pattern using two representative ICU trajectories from MIMIC-III ( 18 ) : compared with a lower-acuity trajectory, a higher-acuity trajectory exhibits denser laboratory monitoring and more frequent text updates. The same pattern also appears at the cohort level. Using MIMIC-IV ( 17 ) , Figure 1 (B) shows that greater structured monitoring intensity is associated with higher in-hospital mortality. Figure 1 (C) shows a parallel relationship for text: higher-acuity patients are more likely to have text available at a given decision step and to receive new text in the following step. Second, observation patterns differ systematically across modalities because different types of clinical data are generated through different mechanisms. Vital signs are often collected more routinely, laboratory tests need to be ordered, and text updates depend even more directly on clinician documentation behavior. This contrast is visible in Figure 1 (A): even within the same patient trajectory, the temporal availability of structured measurements and text updates evolves differently. Taken together, these patterns suggest that observation processes are informative about patient state but should be used carefully, as their meanings differ across modalities. For structured clinical time series, prior work has proposed methods that incorporate informative missingness through masks and time gaps ( 5 ) . In the multimodal setting, 32 also explicitly models informative missingness, but without temporal dynamics. However, it remains open how to leverage informative missingness over time across modalities to learn patient representations. We propose OPL-MT-MNAR (Off-Policy Learning under Multimodal Observations with Temporal Missing-Not-At-Random Patterns), a framework that explicitly leverages informative missingness in multimodal clinical records. Our approach has two stages. In the first stage, we learn a dynamic latent representation from the multimodal observations available up to the current time. In the second stage, we use the learned patient representation for outcome prediction and offline policy learning. The first stage is motivated by Bayesian filtering and consists of two components. The first is a multimodal encoder that learns a unified representation from the data observed so far. For structured data, we construct the embedding using an extension of Gated Recurrent Units-Decay (GRU-D) ( 5 ) together with additional missingness-aware features (time since last observation, cumulative observation counts, missing rates, and windowed observation frequency). For clinical text, we introduce a temporal documentation factor that is updated at each time step and summarizes the observation pattern of the text observed so far. This factor is then used both to refine the text embedding and to guide the fusion of text and structured-data embeddings into a unified representation. The second component models patient dynamics through a latent belief state learned via variational inference. This belief state captures underlying health dynamics together with the cumulative effects of past treatment actions. It is then combined with the unified representation from the multimodal encoder to form a posterior patient state for downstream tasks. We show theoretically that without such a belief state, the multimodal encoder alone may fail to preserve sufficient information about treatment history for sequential decision-making. In the second stage, we use the posterior patient state for multiple downstream tasks. One task is offline treatment policy optimization using expectile regression ( 21 ) , which accommodates delayed rewards. The other is outcome prediction. Jointly learning these tasks allows the shared patient representation to benefit from positive transfer across tasks. We evaluate our framework on MIMIC-III, MIMIC-IV, and eICU ( 39 ) , which together cover complementary text-observation regimes and cross-institutional generalization. Our empirical focus is ICU sepsis care with 4-hour decision steps over the first 72 ICU hours. Across these settings, the learned state supports both clinically meaningful prediction and offline treatment optimization, with the largest gains appearing in high-acuity settings where observation processes are most informative. Concretely, the OPL-MT-MNAR policy achieves FQE 0.679 on MIMIC-III, 0.634 on MIMIC-IV, and 0.604 on eICU, compared with clinician behavior at 0.528, 0.521, and 0.534, respectively. Using the same learned representation, we also achieve AUROC 0.886 for post-72-hour mortality prediction on MIMIC-III, with the clearest policy improvements appearing in the highest-acuity subgroup. 2 Problem Formulation We consider a finite-horizon partially observable Markov decision process (POMDP) \mathcal{M}=(\mathcal{S},\mathcal{A},\mathcal{O},P,\Omega,R,\gamma,H) ( 19 ; 14 ) , where \mathcal{S} is the latent state space, \mathcal{A} is the discrete action space, \mathcal{O} is the observation space, P:\mathcal{S}\times\mathcal{A}\to\Delta(\mathcal{S}) is the transition kernel, \Omega:\mathcal{S}\to\Delta(\mathcal{O}) is the observation function, R is the reward function, \gamma\in[0,1) is the discount factor, and H is the horizon. The true patient state s_{h}\in\mathcal{S} at decision step h is not directly observed. At decision step h , the agent partially observes the following information o_{h}=(\bm{y}_{h}^{\mathsf{s}},\bm{m}_{h}^{\mathsf{s}},\bm{y}_{h}^{\mathsf{t}},\bm{m}_{h}^{\mathsf{t}})\in\mathcal{O}. For structured data, \bm{y}_{h}^{\mathsf{s}}\in\mathbb{R}^{|\mathcal{T}_{h}|\times D}