Generation of realistic cardiac ultrasound sequences with ground truth motion and speckle decorrelation

Thierry Judge 1,2 , Nicolas Duchateau 1,3 , Khuram Faraz 1 , Pierre-Marc Jodoin 2 and Olivier Bernard 1 · 2025

Read Generation of realistic cardiac ultrasound sequences with ground truth motion and speckle decorrelation by Thierry Judge 1,2 , Nicolas Duchateau 1,3 , Khuram Faraz 1 , Pierre-Marc Jodoin 2 and Olivier Bernard 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05261.txt.

Introduction

Fake heart ultrasound movies can help train software, but only if they age like real scans, Thierry Judge and four co-authors note in a 2025 medical imaging paper. Speckle, the grainy pattern in ultrasound, slowly loses its match to itself over time, an effect earlier simulators ignored.

Their method starts from real patient scans and heart wall outlines, then builds meshes that shape the simulated images. A coherence map, drawn from correlations measured in the real data, lets speckle vary locally over time instead of staying fixed. Tested on scans from ninety-eight patients, the new sequences matched real decorrelation curves better than the baseline pipeline.

Catalog record

CREATORThierry Judge 1,2 , Nicolas Duchateau 1,3 , Khuram Faraz 1 , Pierre-Marc Jodoin 2 and Olivier Bernard 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-05261

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generation of realistic cardiac ultrasound sequences with ground truth motion and speckle decorrelation Thanks: This work was supported by the NSERC Canada Graduate Scholarships-Doctoral programs, the FRQNT Doctoral Training Scholarships, the French National Research Agency (LABEX PRIMES [ANR-11-LABX-0063], and ORCHID [ANR-22-CE45-0029-01] project). Thierry Judge 1,2 , Nicolas Duchateau 1,3 , Khuram Faraz 1 , Pierre-Marc Jodoin 2 and Olivier Bernard 1 Abstract Simulated ultrasound image sequences are key for training and validating machine learning algorithms for left ventricular strain estimation. Several simulation pipelines have been proposed to generate sequences with corresponding ground truth motion, but they suffer from limited realism as they do not consider speckle decorrelation. In this work, we address this limitation by proposing an improved simulation framework that explicitly accounts for speckle decorrelation. Our method builds on an existing ultrasound simulation pipeline by incorporating a dynamic model of speckle variation. Starting from real ultrasound sequences and myocardial segmentations, we generate meshes that guide image formation. Instead of applying a fixed ratio of myocardial and background scatterers, we introduce a coherence map that adapts locally over time. This map is derived from correlation values measured directly from the real ultrasound data, ensuring that simulated sequences capture the characteristic temporal changes observed in practice. We evaluated the realism of our approach using ultrasound data from 98 patients in the CAMUS database. Performance was assessed by comparing correlation curves from real and simulated images. The proposed method achieved lower mean absolute error compared to the baseline pipeline, indicating that it more faithfully reproduces the decorrelation behavior seen in clinical data. I Introduction Ultrasound imaging is a key modality in cardiac diagnosis due to its real-time capabilities, portability, and low cost. However, analyzing ultrasound data remains time-consuming and often requires expert interpretation. In recent years, deep learning has shown strong performance in segmentation tasks for ultrasound imaging, enabling automated analysis of anatomical structures. Despite this progress, deep learning has seen limited adoption in motion tracking, where speckle tracking echocardiography (STE) stands as the clinical standard. STE relies on the assumption that speckle patterns remain stable over time, allowing them to be used as natural markers for motion tracking. However, this assumption often breaks down in practice due to speckle decorrelation, a well-known phenomenon in ultrasound imaging. As a result, STE algorithms require extensive vendor-specific tuning and regularization to maintain performance. Recently, deep learning-based methods for motion estimation have advanced significantly, particularly in the fields of dense optical flow and point tracking [ 1 , 2 ] . Several adaptations of these methods for ultrasound imaging have been proposed [ 3 , 4 ] . These approaches are typically trained using either reference data from STE tools or ultrasound simulations. As STE-derived references are difficult to obtain at scale and may carry inherent biases, many works have proposed to generate realistic ultrasound simulation videos with reference motion. Evain et al. proposed generating videos with motion derived from 2D+t segmentation [ 3 ] . Burman et al. proposed using a heart model to generate realistic motion from cardiovascular mechanics [ 5 ] . A common limitation in previous studies is the lack of texture-varying realism due to the absence of speckle-decorrelation modeling. In real acquisitions, speckle patterns are not constant in time and space. Ignoring this variability can impair the performance and generalization of deep learning methods, particularly when applied to lower-quality images from routine clinical practice. To address this gap, we introduce a simulation pipeline that explicitly models spatiotemporal speckle decorrelation. Building on [ 3 ] , we adjust the decorrelation level to match that observed in clinical acquisitions, generating sequences whose speckle dynamics closely resemble real data and are therefore better suited for training and evaluating motion-estimation networks. II Method Fig. 1: Illustration of the different key elements used in strategy 1: (a) Mesh with l=36 and r=5 , (b) Static coherence map for one frame, (c) and (d) Myocardial and background scatterers for one frame. Fig. 2: Illustration of the proposed simulation pipeline. The correlation is first measured in the first image before being used to define the dynamics of the myocardial and background scatterers, creating a more realistic simulation. For clarity, only a subset of points in the mesh are illustrated in the input sequence and correlation curves. The goal of the simulation pipeline is to create simulated videos with reference motion. These simulations are based on real videos and approximations of the true motion. The output sequence looks similar in appearance to the input one, but its speckle patterns now move according to the ground truth motion introduced by the pipeline. We start by introducing the strategy used by Evain et al. [ 3 ] . II-A Strategy 1: Base simulation pipeline The input of the pipeline is a video, \mathbf{V}\in[0,1]^{T\times H\times W} , with T frames of height H and width W and a mesh M\in\mathbb{R}^{T\times l\times r\times 2} representing the decomposition of the myocardial wall segmentation and roughly corresponding to the approximate global motion of the myocardium in the video, where l and r are the number of longitudinal points and radial points in the mesh respectively (Fig. 1 (a)). From the mesh, a mask can be obtained with the bounding polygon of the mesh. The pipeline revolves around the SIMUS simulation [ 6 ] . For each frame, the input to the simulator is a set of scatterers characterized by spatial coordinates and backscatter coefficients (BSC). Each scatterer i is defined by a lateral and depth position at time t , x_{t}^{i},z_{t}^{i} , and a backscatter reflection coefficient \text{BSC}_{t}^{i} . To obtain the BSC at time t , the value is extracted from the real video with: \text{BSC}_{t}^{i}=(\mathbf{V}_{t,x_{t}^{i},z_{t}^{i}})^{\gamma}\cdot\epsilon,\quad\epsilon\sim\mathcal{N}(0,1), (1) where \gamma is the gamma compression constant and \epsilon is a random variable iid of standard normal distribution. In [ 3 ] , two types of scatterers are defined: myocardial scatterers that follow the movement of the myocardium and background scatterers that complete the image. To define the two types of scatterers, a static coherence map, \mathbf{C}^{s}\in[0,1]^{T\times H\times W} , is obtained by multiplying the myocardial mask by a probability value p\in[0,1] (Fig. 1 (b)). To ensure a smooth transition between the myocardium and background, the value decreases linearly from the mask edge to 0 in the background. Using the end-systolic (ES) frame as a reference, as most of the myocardium is usually in the sector, scatterers are distributed uniformly across the ultrasound sector with a density of 5 per square wavelength. Myocardial scatterers are selected randomly using the probability given by the coherence map at the position of each scatterer. The BSC of myocardial scatterers is fixed, and their position is updated at each time frame using their relative position in the mesh. The background scatterers have a fixed position at each time step. Their BSC value is updated for each frame with Eq. 1 . Finally, a certain number of background scatterers, defined by the coherence map, are randomly selected in the myocardium over the cardiac cycle to create a more realistic speckle pattern. An illustration of myocardial and background scatterers is shown in Figs. 1 (c) and (d) with 20\% of the scatterers visible for clarity. Given the combined list of myocardial and

Read the complete text