ECLARE: Efficient cross-planar learning for anisotropic resolution enhancement

Samuel W. Remedios, Shuwen Wei, Shuo Han, Jinwei Zhang, Aaron Carass, Kurt G. Schilling, Dzung L. Pham, Jerry L. Prince, Blake E. Dewey · 2025

Read ECLARE: Efficient cross-planar learning for anisotropic resolution enhancement by Samuel W. Remedios, Shuwen Wei, Shuo Han, Jinwei Zhang, Aaron Carass, Kurt G. Schilling, Dzung L. Pham, Jerry L. Prince, Blake E. Dewey (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11787.txt.

Introduction

Samuel Remedios and co-authors sharpen thick sliced brain scans with a self taught upscaling method in a 2025 paper. Clinics often scan the brain as stacks of two dimensional slices: fast and clear, but the gaps and thickness defeat three dimensional analysis tools. Older fixes miss at least one snag among slice shape, gaps, domain shift, and odd scaling factors.

Their method, ECLARE, learns only from the scan itself, using its own slice profile, so outside training data can never skew it. On realistic simulations with known truth, it beat interpolation and rival methods on signal recovery and later tasks. The code is open source.

Catalog record

CREATORSamuel W. Remedios, Shuwen Wei, Shuo Han, Jinwei Zhang, Aaron Carass, Kurt G. Schilling, Dzung L. Pham, Jerry L. Prince, Blake E. Dewey
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11787

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ECLARE: Efficient cross-planar learning for anisotropic resolution enhancement Samuel W. Remedios, Shuwen Wei, Shuo Han, Jinwei Zhang, Aaron Carass, Kurt G. Schilling, Dzung L. Pham, Jerry L. Prince, Blake E. Dewey Abstract Purpose: In clinical imaging, magnetic resonance (MR) image volumes are often acquired as stacks of 2D slices with decreased scan times, improved signal-to-noise ratio, and image contrasts unique to 2D MR pulse sequences. While this is sufficient for clinical evaluation, automated algorithms designed for 3D analysis perform poorly on multi-slice 2D MR volumes, especially those with thick slices and gaps between slices. Super-resolution (SR) methods aim to address this problem, but previous methods do not address all of the following: slice profile shape estimation, slice gap, domain shift, and non-integer or arbitrary upsampling factors. Approach: In this paper, we propose ECLARE (Efficient Cross-planar Learning for Anisotropic Resolution Enhancement), a self-SR method that addresses each of these factors. ECLARE uses a slice profile estimated from the multi-slice 2D MR volume, trains a network to learn the mapping from low-resolution to high-resolution in-plane patches from the same volume, performs SR with anti-aliasing, and respects the image FOV during resampling. We compared ECLARE to cubic B-spline interpolation, SMORE, and other contemporary SR methods. We used realistic and representative simulations on human head MR volumes so that quantitative performance against ground truth can be computed. Specifically, healthy T 1 T_{1} -w and people with MS T 2 T_{2} -w FLAIR datasets were used for evaluations. We used the peak signal to noise ratio and structural similarity index measure as signal recovery metrics. We additionally used two independent brain parcellation algorithms, SLANT and SynthSeg, to compute the consistency Dice similarity coefficient and the R 2 R^{2} coefficient of determination, respectively, as comparison metics. Results: For images with up to 5 mm of slice thickness and up to 1.5 mm of gap, ECLARE achieves greater mean PSNR and SSIM compared to other methods. In representative regions of interest, such as the ventricles, caudate, cerebral white matter, and cerebellar white matter, ECLARE performs comparably or better than other approaches. These trends are similar for both investigated datasets. Conclusions: The use of slice profile estimation, FOV-aware resampling, and self-SR allowed ECLARE to robustly super-resolve anisotropic images without the need of external training data. Future work will investigate the utility of ECLARE on other organs, species, modalities, and resolutions. Our code is open-source and available at https://www.github.com/sremedios/eclare . keywords inverse problem, magnetic resonance imaging, slice gap, super-resolution * S.W.R. \linkable [email protected] 1 Introduction Magnetic resonance (MR) imaging (MRI) is an essential clinical tool in diagnosis, monitoring, management, and research across many health conditions. Multi-slice 2D MRI uses slice selection [ 3 ] to acquire multiple evenly spaced 2D slices, which are stacked to create a 3D volume. In contrast, 3D MRI uses two phase encode directions to acquire 3D volumes directly [ 9 ] . Although 3D MRI has many advantages, including greater utility in downstream processing, multi-slice 2D MRI still accounts for the majority of clinical scans because it: 1) is faster to acquire; 2) offers clinically relevant tissue contrasts difficult to acquire in 3D [ 1 ] ; 3) has relaxed hardware requirements; 4) is very familiar to clinicians; and 5) can be less sensitive to motion artifacts. For these reasons, multi-slice 2D MRI are common in pragmatic clinical trials [ 35 ] and in pre-clinical imaging studies [ 45 ] . Multi-slice 2D MR neuroimages can be strikingly anisotropic. Although in-plane resolutions for 2D MRI are frequently less than 1 mm in both phase-encode and readout directions, slice thicknesses may be 3–8 mm and many acquisitions additionally have slice gaps of 0.5–2 mm. Automated processing pipelines, which are often designed and trained for isotropic image volumes, perform sub-optimally on such anisotropic volumes (even when interpolated to isotropic voxel spacing). Super-resolution (SR) aims to solve this problem by estimating high-resolution (HR) images from low-resolution (LR) acquisitions. Most contemporary work on SR for MRI focuses on deep neural networks. Convolutional neural networks (CNNs) form the backbone of many approaches [ 44 , 8 ] , including generative adversarial networks (GANs) [ 59 , 5 , 31 ] , normalizing flows [ 30 , 20 , 28 , 22 ] , and denoising diffusion probabilistic models (DDPMs) [ 53 , 50 , 52 , 4 , 16 , 54 ] . The transformer architecture [ 29 , 56 , 55 , 25 , 11 ] is also common, sometimes used alongside CNNs [ 64 , 12 , 6 , 10 ] . Figure 1: A flowchart of our proposed method. The anisotropic input volume is fed independently into each of the three steps. First, in (A) (Sec. 3.2 ), we estimate the slice excitation profile with ESPRESO [ 14 ] . Second, in (B) (Sec. 3.4 ), we extract HR in-plane 2D patches and use the PSF estimated from (A) to create paired training data. This training data is used to train the network f_{\theta} with supervised learning. Third, in (C) (Sec. 3.5 ), we extract LR through-plane 2D slices and super-resolve them with the trained network f_{\theta} from (B).The super-resolved slices are stacked and averaged, yielding the super-resolved output volume. Although many SR approaches demonstrate remarkable performance, none at present satisfy all desirable properties for SR of multi-slice 2D MRI. Most methods, for example, do not consider the slice profile and true through-plane resolution of 2D MRI. Indeed, many approaches conflate slice separation with through-plane resolution, but they are different concepts and must be handled differently. For example, methods evaluated on simulations that use LR data that is only downsampled from 3D volumes (i.e., with interpolation) and without proper simulation of slice profile and slice separation would be more properly labeled as “inpainting” or “slice imputation” rather than super-resolution. As well, many methods in the literature have been trained for super-resolution of single integer factors such as 2 and 4 [ 44 , 60 , 30 , 53 , 29 , 64 ] . Not only do these methods require retraining for each integer factor that is encountered, they also use techniques like power-of-two upsampling or pixel shuffle [ 40 ] that do not allow for non-integer factors. Finally, many methods are trained on specific MR tissue contrasts and often (in neuroimaging) on skull-stripped data, necessitating retraining and possibly re-evaluation for alternative tissue contrasts and for with-skull data. At present, there is no algorithm that handles all of these concerns for an arbitrary multi-slice 2D MR image volume. To address these concerns, we propose ECLARE (Efficient Cross-planar Learning for Anisotropic Resolution Enhancement), a deep learning algorithm to super-resolve multi-slice 2D MR volumes along the through-plane direction. ECLARE builds on a succession of self-SR approaches [ 19 , 62 , 38 , 39 ] , in which all training data is extracted from the HR in-plane slices within a LR image volume. However, ECLARE adds several crucial features to properly model slice acquisition, account for non-integer super-resolution factors, and incorporate efficient network design elements. In particular, we use ESPRESO [ 14 ] , a GAN-based algorithm previously developed by our team, to estimate the relative slice selection profile. We use this profile to model slice thickness and

Read the complete text