An Attention-Based Denoising Model for Diffusion Weighted Imaging

Prithviraj Verma, Pawan Kumar, Chandan Deshani, Prasun Chandra Tripathi · 2026

Read An Attention-Based Denoising Model for Diffusion Weighted Imaging by Prithviraj Verma, Pawan Kumar, Chandan Deshani, Prasun Chandra Tripathi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03903.txt.

Introduction

Verma and co-authors denoise diffusion-weighted MRI with a noise-aware attention model. Such scans serve whole-body cancer screening, but they take long. Shorter scans come out noisier. The magnitude step adds signal-linked Rician noise, which defeats plain filters. Their model leans on attention to restore the images.

Swin Transformer window attention supplies the context. Gated refinement works across dimensions. Noise-level conditioning lets the model adapt to each corruption strength. A residual path keeps the output tied to the input. Across noise levels from one to fifteen percent, peak signal scores stay high. Structural similarity reaches about 0.854. Behavior stays stable under severe noise. Radiologists get cleaner fast scans without new hardware.

Catalog record

CREATORPrithviraj Verma, Pawan Kumar, Chandan Deshani, Prasun Chandra Tripathi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03903

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Attention-Based Denoising Model for Diffusion Weighted Imaging Prithviraj Verma, Pawan Kumar, Chandan Deshani, Prasun Chandra Tripathi Abstract Diffusion-weighted imaging (DWI) is used for whole-body cancer screening, but it typically requires a long acquisition time. When the scan time is reduced, the image quality often suffers, leading to increased noise in the scans. Magnitude reconstruction in DWI introduces signal-dependent Rician noise, which makes denoising more challenging for conventional convolution-based methods. To address this limitation, we propose a noise-aware attention-driven denoising framework that integrates hierarchical Swin Transformer window attention with transformer-based multi-dimensional gated refinement for DWI restoration. The model incorporates explicit noise-level conditioning and residual reconstruction to enable adaptive suppression of heteroscedastic noise across a wide range of corruption levels. Experimental evaluation on corrupted DWI scans demonstrates strong restoration performance. Our model achieves a mean PSNR of 33.69 dB and SSIM of 0.8539 across noise levels from 1% to 15%, while maintaining stable behavior under severe noise conditions. These results indicate that attention-guided contextual modeling combined with channel-adaptive refinement provides a robust and generalizable solution for DWI denoising. 1 Introduction Diffusion-weighted Imaging (DWI) quantifies water molecule mobility for tissue microstructure assessment in stroke diagnosis, lesion detection, and white matter tractography. Echo-planar acquisition with high diffusion weighting produces intrinsically low signal-to-noise ratios, which degrades derived biomarkers such as apparent diffusion coefficient (ADC) and fractional anisotropy [ 4 ] . In addition, magnitude reconstruction from complex receiver channels introduces signal-dependent Rician noise characterized by intensity bias in low-SNR regions and spatially heterogeneous variance, which differs fundamentally from additive Gaussian noise assumptions commonly used in natural images [ 12 , 1 ] . Rician statistics induce rectification bias where the noise floor elevates low-intensity signals, which leads to systematic distortion in quantitative diffusion measurements and potentially affecting diagnostic interpretation. The spatially varying nature of this corruption necessitates adaptive denoising strategies capable of preserving anatomical boundaries while accounting for local signal strength [ 1 ] . Classical denoising approaches including non-local means and block-matching filtering typically adapted for MRI rely on handcrafted priors and fixed similarity assumptions that limit their robustness under complex acquisition variability and increasing computational cost [ 12 , 1 ] . Convolutional Neural Networks (CNNs) provide improved empirical performance through learned hierarchical feature representations [ 16 , 17 ] , yet their locality-constrained receptive fields restrict effective contextual reasoning when homogeneous tissue regions are heavily corrupted. Encoder–decoder architectures such as U-Net remain widely adopted in medical imaging but still depend on progressive receptive-field expansion rather than explicit global dependency modeling [ 8 ] . Recent transformer-based architectures [ 3 , 15 ] address these limitations by enabling long-range spatial dependency modeling via self-attention. The Swin Transformer [ 3 ] introduces a hierarchical shifted-window attention mechanism that reduces computational complexity while still capturing global contextual relationships among image patches. Restormer architecture introduced in [ 15 ] further extends restoration-specific transformer design through multi-dimensional transposed attention and gated depthwise convolution that enables adaptive channel–spatial feature refinement for image restoration tasks. More recent works have extended transformer-based denoising to medical imaging, demonstrating improved generalization and reconstruction fidelity in diffusion MRI and low-field MRI settings [ 9 , 18 ] . Some works have also explored hybrid and noise-aware learning strategies for MRI denoising. In particular, transformer-CNN hybrid architectures [ 10 ] with self-supervised pretraining have shown improved capability in modeling signal-dependent noise compared to conventional CNN-based approaches. Furthermore, self-supervised methods have been proposed to address the lack of clean ground-truth data in DWI. [ 7 , 13 ] . Despite increasing interest in attention-driven medical image restoration, rigorous evaluation under realistic Rician noise conditions remains limited. Existing studies often rely on Gaussian noise assumptions or single-noise training regimes that do not reflect the heteroscedastic statistics of magnitude MRI [ 14 , 5 ] in clinical settings. Furthermore, while recent self-supervised and generative approaches show promising results, many lack explicit noise-level conditioning or do not fully exploit hierarchical attention mechanisms to capture local and global dependencies under Rician noise conditions [ 7 , 13 ] . Consequently, the robustness and generalization behavior of attention-based denoisers for DWI remain insufficiently characterized. To address these challenges, this work proposes a noise-aware transformer-based denoising framework for DWI affected by signal-dependent Rician noise. The model integrates hierarchical self-attention with channel-adaptive gated refinement and explicit noise-level conditioning to enable adaptive suppression of heteroscedastic corruption across varying noise levels. This design supports structurally consistent restoration under both moderate and severe degradation conditions. The main contributions of this work are summarized as follows: 1. Attention-based restoration for DWI: A Swin Transformer–Restormer architecture combining hierarchical spatial self-attention with channel-adaptive gated refinement is developed for DWI denoising to enhance robustness and structural preservation relative to convolutional baselines. 2. Noise-aware denoising: A noise-conditioned residual learning paradigm is employed to train the proposed model across multiple Rician noise levels (1%–15%) to allow adaptive denoising behavior and systematic evaluation of cross-regime generalization. 3. Controlled comparison under Rician noise: A rigorously controlled experimental framework is introduced to isolate architectural effects in DWI denoising under signal-dependent Rician corruption to enable fair comparison between convolution-only and attention-based restoration strategies. 2 Related Work 2.1 CNN-Based Image Denoising Convolutional neural networks (CNNs) have demonstrated strong effectiveness in image denoising through hierarchical feature learning and residual reconstruction [ 11 ] . As summarized in Table 1 , DnCNN [ 16 ] showed that residual learning enables suppression of additive Gaussian noise across multiple corruption levels, while FFDNet [ 17 ] introduced explicit noise-level conditioning to improve flexibility and generalization. However, these approaches assume signal-independent Gaussian noise and therefore do not directly address the signal-dependent corruption present in magnitude MRI [ 6 ] . Encoder–decoder architectures such as U-Net provide multi-scale contextual aggregation through skip connections [ 8 , 11 ] , yet their convolution-only receptive fields remain inherently local, limiting effective global structural reasoning in severely degraded DWI. 2.2 MRI Denoising and Rician Noise Magnitude MRI noise follows Rician or non-central Chi statistics to produce intensity bias in low-signal regions and spatially heterogeneous variance [ 12 , 1 ] . Classical denoising methods such as non-local means improve structural preservation but rely on handcrafted similarity priors and incur high computational cost [ 1 ] . There are trade-offs between statistical fidelity, edge preservation and computational efficiency across spatial, transform and learning-based MRI denoising paradigms [ 6 ] . Data-driven training strategies such as Noise2Noise [ 2 ] enable learning without clean targets, yet underlying convolutional architectures typically lack explicit modeling of heterogeneous noise severity in DWI. 2.3 Transformer-Based Image Restoration Self-attention enables direct long-range spatial dependency modeling. In [ 3 ] , SwinIR introduced hierarchical shifted-window attention for efficient global contextual reasoning. On the other hand, Restormer architecture developed in [ 15 ] presents restoration-specific transformer design by exploiting multi-dimensional transposed attention and gated depthwise refinement. Despite promising results in natural images, applications to DWI under realistic Rician noise remain limited, with many studies relying on Gaussian assumptions or single-noise training regimes [ 14 , 5 ] . To address these gaps, we propose a noise-aware Swin–Restormer denoising framework adapted for DWI. The proposed model integrates hierarchical contextual attention, channel-adaptive refinement, and explicit noise-level conditioning within a residual reconstruction framework. Table 1: Representative

Read the complete text