Extending Pretrained 10-Second ECG Foundation Models to Longer Horizons

Wei Tang Jinpei Han Kangning Cui Mattia Carletti Fredrik K. Gustafsson, Shreyank N Gowda Patitapaban Palo Anshul Thakur Lei Clifton, Jean-michel Morel Raymond H. Chan David A. Clifton Xiao Gu, [-0.5em] City University of Hong Kong Imperial College London Wake Forest University · 2026

Read Extending Pretrained 10-Second ECG Foundation Models to Longer Horizons by Wei Tang Jinpei Han Kangning Cui Mattia Carletti Fredrik K. Gustafsson, Shreyank N Gowda Patitapaban Palo Anshul Thakur Lei Clifton, Jean-michel Morel Raymond H. Chan David A. Clifton Xiao Gu, [-0.5em] City University of Hong Kong Imperial College London Wake Forest University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16975.txt.

Introduction

Tang's team extends pretrained 10-second ECG foundation models to longer, variable-length heart recordings without retraining the backbone. Ten-second models transfer well across clinical uses but have no built-in way to combine information across time, and longer recordings raise structural and semantic problems. Guided by a frozen 10-second model, their light plug-in module adds compatible long-sequence processing and semantically informed temporal modelling. Tests across long-horizon tasks, data sets, and backbones beat sliding-window and pooling baselines with strong parameter efficiency.

Catalog record

CREATORWei Tang Jinpei Han Kangning Cui Mattia Carletti Fredrik K. Gustafsson, Shreyank N Gowda Patitapaban Palo Anshul Thakur Lei Clifton, Jean-michel Morel Raymond H. Chan David A. Clifton Xiao Gu, [-0.5em] City University of Hong Kong Imperial College London Wake Forest University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38247
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16975

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Extending Pretrained 10-Second ECG Foundation Models to Longer Horizons Wei Tang Jinpei Han Kangning Cui Mattia Carletti Fredrik K. Gustafsson, Shreyank N Gowda Patitapaban Palo Anshul Thakur Lei Clifton, Jean-michel Morel Raymond H. Chan David A. Clifton Xiao Gu, [-0.5em] City University of Hong Kong Imperial College London Wake Forest University Abstract Electrocardiogram (ECG) foundation models pretrained on typical diagnostic 10-second ECG segments, have demonstrated strong transferability across a range of clinical applications. However, many real-world applications produce recordings that are typically longer, and are varied in duration during inference time. These 10-second models have no built-in way to combine information across time. Extending them to longer horizons introduces two challenges: structural incompatibilities arising from input-length disparities, and semantic challenges that limit meaningful temporal aggregation. We propose a parameter-efficient framework that extends pretrained ECG foundation models to longer and variable-length ECGs without retraining the backbone. Guided by a frozen pretrained 10-second model, we introduce a lightweight plug-in module that extends the model in two complementary ways: (i) structurally compatible long-sequence processing and (ii) semantically informed temporal modeling. Experiments on multiple long-horizon ECG tasks, datasets, and foundation model backbones demonstrate that our method enables robust long-horizon extension from pretrained snapshot models, consistently outperforming sliding-window and pooling-based baselines with strong parameter efficiency. 1 Introduction The electrocardiogram (ECG) remains the gold standard for non-invasive cardiovascular diagnosis, providing a direct view of cardiac electrical activity. Advances in machine learning, particularly deep neural networks, have substantially improved automated ECG analysis, with models achieving expert-level performance on several diagnostic tasks [ 24 ] . Early deep learning approaches, however, primarily relied on supervised training for narrow, task-specific objectives. While effective in controlled settings, these models were constrained by limited labeled data and often failed to generalize across datasets, institutions, and patient populations [ 26 ] . To improve robustness and transferability, recent work has increasingly shifted toward ECG foundation models pretrained with self-supervised objectives on large-scale ECG datasets [ 17 , 6 , 20 ] . Through contrastive or generative self-supervised learning objectives, these architectures learn generic feature extractors that are robust to signal variability and improve transfer across cohorts and institutions. As a result, a single pretrained foundation model backbone paired with lightweight task-specific heads can be adapted to diverse downstream applications such as diagnosis, phenotyping, and outcome prediction [ 7 , 16 ] . Despite their progress, these ECG foundation models present a fundamental limitation: they are trained and used as fixed-length snapshot processors. They typically operate on short inputs (often 10 s) during both pretraining and inference [ 17 , 6 ] , which biases the learned representations toward local waveform morphology and short-term rhythm. As a result, they lack an explicit mechanism for aggregating information across extended recordings, modeling long-range temporal dependencies, or supporting coherent prediction across multiple horizons – when recording duration varies across monitoring scenarios. Figure 1 : Overview of the problem setting and extension strategies. ECG foundation models are typically pretrained on short, fixed-length recordings ( e.g. , 10 s), which makes direct use on long or variable-length recordings non-trivial. Naive extension strategies either run independent window-level predictions and aggregate the outputs as panel (a), or apply simple aggregation or sequential layers over window representations as panel (b). We propose a lightweight long-horizon extension for frozen 10-second ECG foundation models that supports variable-length longer recordings, by leveraging locality-aware inter-window similarity and dynamics-aware long-term learning, as illustrated in panel (c). This limitation is consequential for many clinically relevant settings. In contrast to short 12-lead diagnostic recordings, continuous monitoring is intended to capture sparse or intermittent events over longer horizons, often under reduced-lead configurations [ 14 , 21 , 9 ] . In these contexts, clinically actionable signals may be distributed unevenly over time, as in paroxysmal atrial fibrillation surveillance, sleep, or sepsis early-warning. A common workaround is sliding-window inference followed by simple aggregation ( e.g. , mean pooling) of window-level outputs (Figure 1 a). More structured variants aggregate window representations using attention or lightweight sequential modules (Figure 1 b). While practical, such strategies can be computationally costly and still model cross-window dependencies only indirectly, motivating adaptation methods that explicitly extend the model temporal horizon beyond the original snapshot setting. In this work, we show that pretrained snapshot ECG foundation models can be adapted to longer-duration and variable-length inputs without computationally expensive retraining. Our key observation is that these models can be repurposed for extended-context ECG analysis along three complementary dimensions, as illustrated in Figure 1 (left bottom panel). General ECG interpretation. Pretrained ECG foundation models already acquire substantial domain knowledge for interpreting cardiac signals through large-scale pretraining. This enables knowledge to be preserved and effectively reused when extending the models to longer temporal horizons, without relearning low-level ECG semantics. Locality-aware representation learning. Pretrained ECG foundation models are already well suited to encode short 10-second ECG windows: each segment can be meaningfully represented on its own, thus can be used as a local reference when extending the model to longer recordings. We exploit this property to preserve local semantics and align snapshot-level representations when processing long recordings. Dynamics-aware long-term learning. The representations produced by pretrained models naturally reflect relative importance across segments, offering a basis for identifying informative events within long recordings. This property allows selective reuse and robust aggregation of local representations, which is essential for modeling sparse and transient dynamics over extended time horizons. Based on these insights, we propose a parameter-efficient framework that extends frozen snapshot ECG foundation model to longer-horizon and variable-length settings. Rather than modifying or retraining the pretrained backbone, we reuse its embedded ECG knowledge and locality prior, while introducing a lightweight module to explicitly model long-term temporal dynamics. Across diverse datasets, tasks, and models, our method consistently improves long-horizon performance over conventional sliding-window and pooling strategies, demonstrating a practical and scalable path that goes beyond 10-second ECG understanding. 2 Related Work ECG foundation models. Foundation models have recently been extended from vision and language to physiological signals, with ECG serving as a prominent testbed. Most existing ECG foundation models are pretrained on diagnostic ECG recordings, which are typically short in duration ( \approx 10 s) and acquired using standard 12-lead configurations [ 17 , 6 ] . To date, most progress in this field has been driven along two complementary dimensions: scaling the volume and diversity of pretraining data [ 28 , 16 , 22 , 7 ] , and refining pretraining strategies to better exploit available supervision (self-supervised [ 25 ] , hybrid [ 36 ] , or knowledge-informed objectives [ 33 , 27 ] ). On the other hand, these models, pretrained in a diagnostic 10-second 12-lead regime, have been shown to generalize seamlessly to reduced-lead or single-lead settings [ 7 , 16 ] , which are widely used in continuous monitoring scenarios. However, they remain fundamentally limited in their ability to operate directly over longer temporal horizons, in an end-to-end manner, beyond simplistic sliding-window processing of 10 s segments. Long-term physiology modeling. Many clinically relevant decisions depend on physiological dynamics over long horizons, which are not well captured by short snapshot windows, such as ambulatory Holter monitoring and intensive care monitoring. Recent learning-based systems often apply window slicing, which partitions a

Read the complete text