Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs

Jose Geraldo Fernandes, Luiz Facury, Pedro Robles Dutenhefner & Wagner Meira Jr · 2026

Read Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs by Jose Geraldo Fernandes, Luiz Facury, Pedro Robles Dutenhefner & Wagner Meira Jr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22618.txt.

Introduction

Fernandes and three colleagues move cardiac learning from patient sameness to action-based world models. Sameness goals raise likeness between views of the same patient, which suits static anatomy but fights finding illness, since the model must suppress changes it should detect. With LeJEPA on body time-series, disease becomes a shift vector on latent state, not a static label. Reading the heart's signal state at onset, the model splits stable body features from dynamic disease forces. On MIMIC-IV-ECG, it beats supervised models on the key triage task.

Catalog record

CREATORJose Geraldo Fernandes, Luiz Facury, Pedro Robles Dutenhefner & Wagner Meira Jr
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35936
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22618

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs Jose Geraldo Fernandes, Luiz Facury, Pedro Robles Dutenhefner & Wagner Meira Jr Abstract Self-supervised learning in healthcare has largely relied on invariance-based objectives, which maximize similarity between different views of the same patient. While effective for static anatomy, this paradigm is fundamentally misaligned with clinical diagnosis, as it mathematically compels the model to suppress the transient pathological changes it is intended to detect. We propose a shift towards Action-Conditioned World Models that learn to simulate the dynamics of disease progression, or Event-Conditioned . Adapting the LeJEPA framework to physiological time-series, we define pathology not as a static label, but as a transition vector acting on a patient’s latent state. By predicting the future electrophysiological state of the heart given a disease onset, our model explicitly disentangles stable anatomical features from dynamic pathological forces. Evaluated on the MIMIC-IV-ECG dataset, our approach outperforms fully supervised baselines on the critical triage task. Crucially, we demonstrate superior sample efficiency: in low-resource regimes, our world model outperforms supervised learning by over 0.05 AUROC. These results suggest that modeling biological dynamics provides a dense supervision signal that is far more robust than static classification. Source code is available at our GitHub repository . 1 Introduction The primary goal of clinical monitoring is the detection of change. Whether observing a patient in an intensive care unit or tracking chronic conditions over years of outpatient visits, the clinical value of a diagnostic tool lies in its ability to distinguish the stable anatomical baseline of an individual from acute pathological transitions. However, the current landscape of self-supervised learning (SSL) in medical artificial intelligence is governed by a fundamental contradiction: it is built almost entirely on the principle of invariance . In standard SSL frameworks, such as SimCLR or MoCo, and their medical adaptations like PCLR ( 5 ) and MICLe ( 3 ) , the objective is to learn representations that remain stable under perturbations. In the context of longitudinal data, this often manifests as Patient-Invariance , where a model is trained to maximize the similarity between different recordings of the same individual. While effective for tasks involving static anatomical characterization or patient re-identification, we argue that this paradigm is inherently misaligned with the requirements of acute care. By forcing a model to map a healthy baseline and an acute pathological state (e.g., the onset of a paroxysmal arrhythmia) to the same point in a latent manifold, the encoder is mathematically compelled to discard the transient disease signals as noise or augmentation artifacts ( 10 ) . This creates a fundamental information bottleneck: a robust biometric model that is paradoxically blind to the very changes it is meant to monitor. Furthermore, the standard data augmentations used to provide the views for contrastive learning—such as random cropping, jittering, or scaling—often fail when applied to 1D physiological signals like the Electrocardiogram (ECG). Techniques like random cropping can be semantically destructive, potentially removing the P-wave and rendering a model unable to assess the P-R interval ( 2 ) , while jittering and scaling can inadvertently mimic serious pathologies ( 11 ) . Consequently, a model trained to be invariant to these transformations may unlearn critical clinical markers essential for diagnosis. To resolve these limitations, we propose a shift from static invariance to dynamic causality . We introduce the Action-Conditioned Cardiac World Model, a framework that formalizes the monitoring problem as a simulation of the heart’s electrophysiological state under pathological perturbations. Rather than suppressing longitudinal variations, our model explicitly treats disease onset as an action —a translational force that moves the patient’s representation through a latent manifold. By utilizing the Joint-Embedding Predictive Architecture (JEPA) ( 9 ) , we avoid the computational burden and ”hallucination” risks associated with generative pixel-reconstruction models like MeWM ( 19 ) . Instead, we predict future states directly in a geometrically regularized latent space. This approach allows the model to disentangle the stable anatomical substrate (Patient Identity) from the evolving disease physics. Our experiments on the MIMIC-IV-ECG dataset demonstrate that this dynamical systems perspective achieves parity with fully supervised models on longitudinal monitoring while significantly outperforming them on the critical task of triage for new patients. Most importantly, we show that dynamics modeling provides a denser supervision signal than classification, maintaining high performance in low-data regimes where supervised baselines suffer catastrophic degradation. Our contributions are as follows: • We propose an Action-Conditioned World Model for medical diagnosis, recontextualizing disease onset as a translational action variable. • We demonstrate that predictive dynamics serve as a superior supervision signal to standard classification, providing a 0.05 AUROC improvement in low-resource (10%) data regimes. • We show that our model overcomes the limitations of standard data augmentations by using longitudinal transitions as the primary source of supervision, resulting in more robust representations for clinical monitoring. 2 Related Work Invariance-based Self-Supervised Learning. The dominant paradigm in medical representation learning has centered on the principle of invariance. Approaches such as Patient Contrastive Learning of Representations (PCLR) ( 5 ) maximize similarity between different recordings of the same individual to learn robust anatomical features. While successful for static tasks like sex classification or age regression, this patient-invariance creates a fundamental information bottleneck for clinical monitoring. As demonstrated by the observed AFib Gap , forcing a model to map a healthy baseline and an acute pathological state (e.g., paroxysmal Atrial Fibrillation) to the same latent point compels the encoder to discard the very disease signals it is intended to detect. Similar limitations are observed in Multi-Instance Contrastive Learning (MICLe) ( 3 ) , which excels in static domains like dermatology but collapses when applied to transient pathologies. Furthermore, efforts to remove subject variability in EEG ( 13 ) often result in a loss of sensitivity to personalized anomalies, such as pre-ictal states in epilepsy. Our work diverges from this paradigm by treating patient identity not as a nuisance to be invariant to, but as a stable substrate that must be disentangled from dynamic pathological transitions. Medical World Models. The concept of ”World Models”—internal simulations that predict the consequences of actions—has recently transitioned from robotics to healthcare. Generative World Models, such as MeWM ( 19 ) , simulate tumor evolution conditioned on treatment plans but rely on high-fidelity pixel reconstruction, which is computationally expensive and prone to hallucinations that lack biological reality. More recent efforts like SurgWM ( 14 ) utilize latent dynamics to imagine surgical tissue deformation based on tool movement, demonstrating the utility of predicting in embedding space. In the context of static imaging, CheXWorld ( 20 ) treats spatial exploration as a dynamic process, using a JEPA framework to disentangle anatomy from domain variation. Our approach extends this logic to the temporal domain of ECG, recontextualizing disease onset not as a static label, but as a translational action on the patient’s latent identity. Latent Dynamics and JEPA in Time-Series. Our architecture builds upon the Joint-Embedding Predictive Architecture (JEPA) ( 9 ) , which avoids the pitfalls of both generative reconstruction and contrastive invariance. While Masked Autoencoders (MAE) approaches like 23 focus on high-frequency texture and sensor noise ( 21 ) , JEPA-style predictive objectives ( 12 ) capture semantic causal structures by predicting future latent

Read the complete text