EchoTracker2: Enhancing Myocardial Point Tracking by Modeling Local Motion

Md Abulkalam Azad, Vegard Holmstrøm, John Nyberg, Lasse Lovstakken, Håvard Dalen, Bjørnar Grenne, Andreas Østvik · 2026

Read EchoTracker2: Enhancing Myocardial Point Tracking by Modeling Local Motion by Md Abulkalam Azad, Vegard Holmstrøm, John Nyberg, Lasse Lovstakken, Håvard Dalen, Bjørnar Grenne, Andreas Østvik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12140.txt.

Introduction

Md Abulkalam Azad and six colleagues present EchoTracker2, tracking heart muscle points in ultrasound video. Heart motion differs from video motion: it comes from constrained tissue change, smooth in space and time, so paths stay local even under large deformation. Past two-stage coarse-to-fine designs may waste effort on coarse starts, so EchoTracker2 uses a fine stage only, enriched with local space-time context and time reasoning. It beats a domain best by 6.5 percent on position accuracy and 12.2 percent on path error, and matches expert strain measures better.

Catalog record

CREATORMd Abulkalam Azad, Vegard Holmstrøm, John Nyberg, Lasse Lovstakken, Håvard Dalen, Bjørnar Grenne, Andreas Østvik
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22978
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12140

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EchoTracker2: Enhancing Myocardial Point Tracking by Modeling Local Motion Md Abulkalam Azad, Vegard Holmstrøm, John Nyberg, Lasse Lovstakken, Håvard Dalen, Bjørnar Grenne, Andreas Østvik Abstract Myocardial point tracking (MPT) has recently emerged as a promising direction for motion estimation in echocardiography, driven by advances in general-purpose point tracking methods. However, myocardial motion fundamentally differs from motion encountered in natural videos, as it arises from physiologically constrained deformation that is spatially and temporally continuous throughout the cardiac cycle. Consequently, motion trajectories typically remain locally confined despite substantial tissue deformation. Motivated by these properties, we revisit the architectural design for MPT and find that coarse initialization in commonly used two-stage coarse-to-fine architectures may be unnecessary in this domain. In this work, we propose a fine-stage-only architecture, EchoTracker2 , which enriches pixel-precise features with local spatiotemporal context and integrates them with long-range joint temporal reasoning for robust tracking. Experimental results across in-distribution, out-of-distribution (OOD), and public synthetic datasets show that our model improves position accuracy by 6.5 % 6.5\% and reduces median trajectory error by 12.2 % 12.2\% relative to a domain-specific state-of-the-art (SOTA) model. Compared to the best general-purpose point tracking method, the improvements are 2.0 % 2.0\% and 5.3 % 5.3\% , respectively. Moreover, EchoTracker2 shows better agreement with expert-derived global longitudinal strain (GLS) and enhances test-rest reproducibility. Source code will be available at: https://github.com/riponazad/ptecho. 1 Introduction Tracking in general computer vision tasks must account for substantial variability in motion patterns arising from object movement, camera motion, occlusions and scene changes. Motion can be rigid or non-rigid, temporally inconsistent, making long-range correspondence inherently ambiguous. In contrast, myocardial motion in echocardiography is governed by physiological deformation that is spatially and temporally coherent, continuous, and constrained by anatomical structure [ 3 ] . Although ultrasound imaging presents challenges such as speckle noise, low contrast, and view-dependent artifacts, tissue motion itself follows smooth and cyclic trajectories driven by cardiac contraction and relaxation [ 9 ] . Figure 1: Motion trajectories of selected query points are shown on the first, middle, and last frames for a natural video (left, TAP-Vid DAVIS [ 7 ] ) and a cardiac video (right). As in Fig. 1 , queried points in natural videos may move abruptly in arbitrary directions with large displacements, whereas motion in echocardiographic sequences is comparatively structured and remains confined to a local spatial neighborhood across frames. Importantly, this behavior arises from biomechanical constraints of myocardial tissue rather than acquisition conditions alone [ 6 ] . Continuity of deformation across neighboring regions and periodic contraction-relaxation dynamics enforce strong spatial and temporal priors on motion trajectories throughout the cardiac cycle [ 15 ] . Consequently, while general-purpose tracking methods must accommodate unconstrained global motion, myocardial motion estimation can instead exploit these structural constraints. Motivated by this, we hypothesize that focusing solely on local motion is sufficient for robust tracking in echocardiography, while enabling improved pixel-level accuracy that is critical for downstream functional measurements such as strain. In this work, we propose EchoTracker2 , a single-stage architecture for fine-grained myocardial point tracking across a full cardiac cycle that explicitly leverages locally constrained motion. In contrast to existing coarse-to-fine approaches, such as the ones proposed by Azad et al. [ 1 ] and Chernyshov et al. [ 4 ] , our method models correspondence within a confined spatial neighborhood and integrates local spatiotemporal feature representations with joint temporal reasoning across neighboring trajectories. Experimental results demonstrate improved tracking performance and generalizability across in-distribution, OOD, and synthetic datasets. Furthermore, EchoTracker2 improves agreement and reproducibility in downstream GLS measurements compared to existing methods. 2 Methods Given a cardiac video \mathcal{V}\in\mathbb{R}^{T\times H\times W\times C} and a set of N query points \mathcal{P}=\{(x_{i}^{t_{q}},y_{i}^{t_{q}})\in\mathbb{R}^{2}\mid i=0,\dots,N-1\} selected on the myocardium from an arbitrary frame t_{q}\in\{0,\dots,T-1\} , the objective is to estimate the point trajectories \mathcal{T}=\{(x_{i}^{t},y_{i}^{t})\mid i=0,\dots,N-1\,;\,t=0\dots,T-1\} throughout the cardiac cycle. 2.1 EchoTracker2 We design EchoTracker2 to model the locally constrained deformation that characterizes myocardial motion. Unlike general-purpose tracking methods, which rely on coarse initialization for global motion to accommodate large and unpredictable displacements, myocardial trajectories are governed by continuous tissue deformation and exhibit limited inter-frame displacement. This allows correspondence estimation to be performed within a confined spatial neighborhood without requiring global correlation. Hence, we eliminate the commonly used coarse initialization, focus on learning pixel-precise local spatiotemporal representations, and refine trajectories through joint temporal reasoning across neighboring points. An overview of EchoTracker2 is shown in Fig. 2 , and its components are described below. Figure 2: The architecture of EchoTracker2 and the computational flow for tracking a single point across ultrasound frames. Within each TSM block, temporal context is aggregated from adjacent frames, progressively expanding the temporal receptive field toward deeper blocks (indicated by the transparency of feature volumes). Although shown only for the middle frame (red border), the same process applies to all frames. The final trajectories are obtained through four iterations of joint temporal refinements. Feature extraction. Following Doersch et al. [ 7 , 8 ] , we adopt the temporal shift module (TSM)-ResNet [ 12 ] to extract temporally-aware features. In prior work, TSMs are applied only to the deepest ResNet block, despite multi-scale correlation being computed across features from all blocks. This introduces a mismatch between spatial resolution and temporal context, as shallower feature maps used for correspondence estimation remain temporally independent. In the context of myocardial motion, where correspondence is estimated within a confined spatial neighborhood and trajectories evolve smoothly over time, feature representations at all scales should encode local temporal information. We therefore integrate lightweight TSM layers between each ResNet block, yielding a temporally-enhanced backbone referred to as iTSM-ResNet . Each TSM aggregates context from adjacent frames, progressively expanding the temporal receptive field to 7 frames (3 backward and 3 forward) at the deepest block, as illustrated in Fig. 2 . Let \mathcal{F}^{(0)}\in\mathbb{R}^{T\times\frac{H}{k^{(0)}}\times\frac{W}{k^{(0)}}\times d^{(0)}} denote the intermediate frame features before the first (\ell=0) ResNet block \mathcal{B}_{0} , where k^{(0)} is the spatial downsampling factor and d^{(0)} is the feature dimension. The feature extraction process of iTSM-ResNet can then be summarized as; \mathcal{F}^{(\ell+1)}=\begin{cases}\mathcal{TSM}_{\ell}\big(\mathcal{B}_{\ell}(\mathcal{F}^{(\ell)})\big),&\ell\in\{0,1,2\}\\ \mathcal{B}_{\ell}(\mathcal{F}^{(\ell)}),&\ell=3\end{cases} (1) Correlation computation. We estimate correspondence by computing feature correlation within a local spatial neighborhood. While 2D correlation is widely used, we adopt 4D correlation [ 5 ] due to its robustness to matching ambiguity, a key advantage for ultrasound imaging. As illustrated for a single point at one feature level in Fig. 2 , query features \mathcal{Q}^{\ell}\in\mathbb{R}^{N\times r\times r\times d^{(\ell)}} are bilinearly sampled for N points from the query frame within an (r\times r) window at level \ell . Corresponding frame features \mathcal{F}_{c}^{(\ell)}\in\mathbb{R}^{T\times N\times r\times r\times d^{(\ell)}} are sampled at the same spatial resolution (r\times r) along the previously estimated trajectories (in the first iteration, point locations from the query frame are propagated to all frames). All-pair cosine similarity is computed between \mathcal{Q}^{(\ell)} and \mathcal{F}_{c}^{(\ell)} to obtain high-dimensional correlation maps \mathcal{C}^{(\ell)}\in\mathbb{R}^{T\times N\times r\times r\times r\times r} . These maps are subsequently encoded into a compact representation of dimensionality D using a learnable encoder [ 5 ] and concatenated across three feature scales (\mathcal{F}^{(1)},\mathcal{F}^{(2)},\mathcal{F}^{(4)}) , yielding multi-scale correlation tokens \mathcal{C}\in\mathbb{R}^{T\times N\times 3D} . Joint Temporal refinement. Although features enriched with local spatiotemporal context are often sufficient for short-term tracking, the accuracy may degrade in the presence of

Read the complete text