Differentiable latent structure discovery for interpretable forecasting in clinical time series
Ivan Lerner, Jean Feydy, Alexandre Kalimouttou, Anita Burgun, Francis Bach · 2026
Read Differentiable latent structure discovery for interpretable forecasting in clinical time series by Ivan Lerner, Jean Feydy, Alexandre Kalimouttou, Anita Burgun, Francis Bach (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27967.txt.
Introduction
Lerner and colleagues build models that forecast patchy hospital time series while showing the links between variables. Their StructGP method learns a short, ordered list of influences, and an extension adds shared hidden pathways to track how patients change over time. On septic shock records it beat separate-task baselines at short horizons and improved long-horizon creatinine forecasts, with strong calibration throughout.
Catalog record
| CREATOR | Ivan Lerner, Jean Feydy, Alexandre Kalimouttou, Anita Burgun, Francis Bach |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43655 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.27967
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Differentiable latent structure discovery for interpretable forecasting in clinical time series Ivan Lerner, Jean Feydy, Alexandre Kalimouttou, Anita Burgun, Francis Bach Abstract 1 1 1 This manuscript is under review at BioData Mining. Background: Timely, uncertainty-aware forecasting from irregular electronic health records (EHR) can support critical-care decisions, yet most approaches either impute to a grid or sacrifice interpretability. We introduce StructGP, a continuous-time multi-task Gaussian process that couples process convolutions with differentiable structure learning to uncover a sparse, ordered directed acyclic graph (DAG) of inter-variable dependencies while preserving principled uncertainty. We further propose LP-StructGP, which augments StructGP with latent pathways —shared, temporally shifted trajectories inferred via subject-specific coupling filters and a softmax gating mechanism—to capture cross-patient progression patterns. Both models are trained under sparsity and acyclicity constraints (augmented Lagrangian, Adam) using scalable low-rank updates: StructGP via exact marginal likelihood maximization and LP-StructGP via an online conditional pseudo-marginal likelihood. Results: In simulations, the approach reliably recovers ground-truth graphs (Structural Hamming Distance approaching 0 as cohorts grow) and pathway assignments (high Adjusted Rand Index). On a MIMIC-IV septic shock cohort (n=1,008; norepinephrine, creatinine, mean arterial pressure), StructGP improves short-horizon (6 h) forecasting over independent-task baselines (average RMSE 0.68 [95%CI: 0.63–0.74] vs. 0.88 [0.83–0.94]) and, with 15 additional inputs, markedly outperforms unstructured kernels (0.63 [0.58–0.69] vs. 3.02 [2.85–3.18]) with superior calibration (coverage 0.96 vs. 0.84). For long horizons (up to 6 days), LP-StructGP further reduces error for creatinine and norepinephrine (e.g., creatinine RMSE 0.95 [0.87–1.05] vs. 1.17 [1.08–1.25]) and improves overall coverage (0.94 vs. 0.91). On the PhysioNet Challenge (12k patients, 41 variables), StructGP attains competitive accuracy (MAE 3.72 × 10 − 2 3.72{\times}10^{-2} ) relative to a state-of-the-art graph neural model while maintaining calibrated uncertainty. Conclusion: These results show that structured process convolutions with latent pathways deliver interpretable, scalable, and well-calibrated forecasting for irregular clinical time series. keywords Clinical time series , Multi-task Gaussian Process , Differentiable structure learning 1 Introduction Clinical decision-making relies not only on assessing a patient’s current state but also on anticipating its future course. Care plans, for example, are adjusted when renal function declines, and more aggressive interventions may be required if cardiovascular stability cannot be restored. Predictive models that provide model-based, data-driven forecasts can therefore play a crucial role in supporting clinicians. Their potential impact is considerable: up to 11% of deaths in critically ill patients are attributable to delayed care 47 , underscoring the importance of timely and accurate predictions. Electronic health records (EHRs) capture a wide range of information during hospital admissions, including sensor measurements, biomarkers, and treatments. Excluding unstructured text and imaging data, these records can be viewed as collections of multivariate time series, one per patient’s stay. Unlike controlled experimental settings, clinical observations are collected opportunistically rather than on a regular grid, making them difficult to model with classical frameworks (e.g., vector autoregressive models). The resulting patterns are irregular and heterogeneous (Supplementary Figure S2), with variables measured at different times, frequencies, and subsets of patients. A common strategy to address irregular sampling is to resample the data onto a fixed grid and impute the missing values, after which standard time-series methods can be applied 30 ; 36 . While simple, this approach is computationally intensive and introduces potential biases through resampling and imputation. A more principled alternative is to work directly in continuous time, thereby avoiding these intermediate steps. Continuous-time modeling can be approached through a variety of frameworks: multi-task Gaussian processes (MTGPs) 17 ; 19 ; 52 ; 29 ; 28 ; 12 ; 13 ; 24 ; neural ODEs and related stochastic differential equation models 41 ; 16 ; 42 ; 3 ; adaptations of deep learning architectures, such as recurrent 11 or attention-based networks 54 ; 53 ; 27 ; 51 ; and, more recently, graph neural networks (GNNs) 49 ; 8 ; 50 . Although GNN-based methods offer some interpretability and, in the case of GraFITi 50 , state-of-the-art predictive performance, they generally lack principled uncertainty quantification, a key strength of MTGPs. In this work, we revisit the classical framework of process convolutions 5 ; 20 ; 1 , which define the covariance structure of a multi-task Gaussian process (MTGP) through kernel convolutions. We combine this framework with modern differentiable structure learning 55 ; 34 , enabling the discovery of interpretable dependency structures between time series in continuous time. A preliminary version of this approach was presented at the Bayesian Decision-making and Uncertainty Workshop (NeurIPS 2024) 26 . The present work extends it by introducing internal standardization, latent pathways, an online learning algorithm, and an extensive biomedical evaluation. In our formulation, the sparsity pattern of the cross-task convolution filters is represented as a directed acyclic graph (DAG), encoding ordered conditional independence relations and causal effects among time series. The corresponding adjacency matrix and variable ordering can be inferred directly from data by solving a continuous optimization problem 55 ; 34 . Compared to classical MTGPs, our approach provides both flexible probabilistic modeling and interpretable, actionable dependency structures between time series. In addition, we address the question of modeling dependencies across patients by introducing the concept of a latent pathway: a partially shared trajectory that groups of patients may follow. This assumption is broad enough to capture diverse phenomena, ranging from different patients experiencing the same underlying pathological process (e.g., urinary tract– versus lung infection–induced sepsis) to patients undergoing similar treatment strategies (e.g., progressive catecholamine withdrawal). At test time, our model infers both the latent pathway along which a patient is evolving and their position within that pathway. In contrast to previous approaches that tackled patient-level dependencies 28 ; 12 ; 13 , we integrate latent pathways directly into the covariance design. This yields calibrated uncertainty estimates while preserving interpretable dependency structures across tasks. With this study, our objectives were to design, implement, and evaluate a process convolution model, StructGP, along with an extension that incorporates latent pathways, LP-StructGP, together with their associated learning algorithms. We assessed their properties using both realistic simulations and real-world data, specifically a MIMIC-IV septic shock cohort from a previous study 23 ; 22 . For comparison with state-of-the-art deep learning methods, we further evaluated our models on the PhysioNet Challenge 44 , using the preprocessing pipeline described in 53 . Our contributions are thus twofold: (i) StructGP, which unifies process convolutions with differentiable structure learning, and (ii) LP-StructGP, which extends this framework to capture patient-level latent pathways. 2 Methods 2.1 Process convolution models We begin by recalling the process convolution formulation of Gaussian processes 38 , which provides a flexible framework for constructing structured covariance functions. Let y(\mathbf{x})=\{y(\mathbf{x}):\mathbf{x}\in\mathcal{X}\} denote a stochastic process, i.e., a collection of random variables indexed by \mathbf{x}\in\mathcal{X} . Process convolution models 5 ; 20 adopt a signal-processing perspective, where y(\mathbf{x}) is viewed as the output of a linear time-invariant (LTI) system driven by a latent noise process. An LTI system is entirely characterized by its impulse response function h(\mathbf{x}) , which represents the system’s response to a Dirac input. If the input is a Gaussian white noise process w(\xi) with covariance \mathbb{E}[w(\xi)w(\xi^{\prime})]=\delta(\xi-\xi^{\prime}) , then by the closure of Gaussian processes under linear operations, y(\mathbf{x}) is also a Gaussian process provided that h has compact support or is square-integrable: \displaystyle