BioAtt: Anatomical Prior Driven Low-Dose CT Denoising
Namhun Kim, Ui Hyun Cho · 2025
Read BioAtt: Anatomical Prior Driven Low-Dose CT Denoising by Namhun Kim, Ui Hyun Cho (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01662.txt.
Introduction
Namhun Kim and Ui Hyun Cho present a method for cleaning up low-dose CT scans without washing out body detail. Low-dose scans cut radiation but add noise. Many AI cleaners smooth too much, erasing fine structures that doctors need. Their 2025 framework, BioAtt, adds guidance about anatomy to the cleaning process.
The guidance comes from BiomedCLIP, a model trained on medical images and text. Its maps of likely anatomy steer the cleaner's attention toward real structures. Across several body regions, BioAtt beat plain and attention-based rivals on standard quality scores. Its attention maps showed the gains came from the anatomy guidance itself. Cleaner low-dose scans could mean safer imaging for patients.
Catalog record
| CREATOR | Namhun Kim, Ui Hyun Cho |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01662
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BioAtt: Anatomical Prior Driven Low-Dose CT Denoising Namhun Kim, Ui Hyun Cho Abstract Deep-learning based denoising methods have significantly improved Low-Dose CT (LDCT) image quality. However, existing models often over-smooth important anatomical details due to their purely data-driven attention mechanisms. To address this challenge, we propose a novel LDCT denoising framework, BioAtt . The key innovation lies in attending anatomical prior distributions extracted from the pretrained vision–language model BiomedCLIP. These priors guide the denoising model to focus on anatomically relevant regions to suppress noise while preserving clinically relevant structures. We highlight three main contributions: BioAtt outperforms baseline and attention-based models in SSIM, PSNR, and RMSE across multiple anatomical regions. The framework introduces a new architectural paradigm by embedding anatomic priors directly into spatial attention. Finally, BioAtt attention maps provide visual confirmation that the improvements stem from anatomical guidance rather than increased model complexity. K eywords Low-Dose CT \cdot Denoising \cdot Spatial-Attention \cdot Anatomical-Prior 1 Introduction Low-Dose Computed Tomography (LDCT) minimizes patient radiation exposure at the cost of obscured diagnostic details from increased noises and artifacts. Deep-learning denoising methods address this issue by learning a direct mapping from noisy images to their denoised counterparts [ 1 , 2 , 3 , 4 , 5 ] . For instance, Residual Encoder-Decoder Convolutional Neural Network ( RED-CNN ) [ 6 ] , Yuan et al. [ 7 ] , and DRCNN [ 8 ] combine autoencoder frameworks with residual connections to suppress noise while maintaining structural information. These early CNN-based approaches [ 9 , 10 , 11 ] exhibit competitive denoising performance compared to traditional techniques, such as Gaussian Filtering [ 12 ] , Weighted Nuclear Norm Minimization [ 13 ] , Sinogram Domain Filtering [ 14 ] , and BM3D Methods [ 15 ] . However, these data-driven networks tend to over-smooth important anatomical details [ 16 , 17 ] . Recent studies explore attention mechanisms and domain-specific priors to preserve anatomical details into the denoising process [ 18 , 19 , 20 , 21 ] . Attention modules play a critical role in improving denoising performance of LDCT models. Squeeze-and-Excitation ( SE ) network [ 22 ] introduced channel-wise attention to adaptively recalibrate feature responses. Sequentially, Convolutional Block Attention Module ( CBAM ) [ 23 ] applied channel and spatial attention to intermediate feature representations. In the field of LDCT denoising, SAM-Att [ 20 ] incorporated a residual attention mechanism into CNN architectures by combining upstream low-rank fine-tuning with downstream attention modules. DEMACNN [ 19 ] integrated edge extraction from both input images and intermediate feature maps with multi-scale attention and a compound loss function. This architecture outperformed RED-CNN, transformer-based models, and other state-of-the-art methods across various LDCT image datasets. Similarly, Zhang et al. [ 21 ] proposed a two-branch multi-scale residual attention network that fuses shallow and deep features to enhance texture and structure recovery in low-dose CT images. These attention-based strategies show strong potential at reducing noise while preserving intricate anatomical details. In parallel, researchers began to integrate anatomical priors and semantic information to enhance structural preservation of LDCT images. Huang et al. [ 24 ] introduced anatomical site labels as training attributes into a Wasserstein GAN for LDCT enhancement. This method enabled model to adaptively adjust to region-specific features. ASCON [ 17 ] utilized inherent anatomical semantics to guide LDCT denoising through a novel supervised contrastive learning framework that enforces anatomical consistency between output and ground truth. The network integrated multi-scale contrastive modules with self-attention-based U-Net to enhance interpretability of tissue-specific structural details. Huang et al. [ 25 ] also segmented preliminary organ or tissue segmentation as priors to direct the denoising process toward anatomically relevant regions. While these approaches improve interpretability and image quality, they introduce additional complexity by relying on extra labels or separate segmentation modules. To address these limitations, we propose BioAtt , a novel LDCT denoising framework that integrates organ-aware spatial attention module [ 26 , 27 ] into the RED-CNN architecture using anatomical prior probability distribution \mathbf{p} derived from BiomedCLIP [ 28 ] . Building on RED-CNN’s residual learning strategy, BioAtt embeds a BiomedCLIP-guided attention module within the encoder-decoder pipeline to better preserve anatomical fidelity. Our key modification lies in the organ-aware spatial attention block: BioAtt block , which is embedded within the encoder–decoder pipeline. This block receives intermediate feature vector \mathbf{x} along with anatomical prior vector \mathbf{p} to generate reweighted feature vector \mathbf{x^{\prime}} . Unlike conventional attention mechanisms that rely solely on data-driven feature patterns and lack explicit semantic context [ 29 , 30 , 21 ] , BioAtt introduces a fundamentally new architectural paradigm by embedding anatomical priors directly into its attention mechanism. The model is explicitly informed about the presence of anatomical structures from the semantically meaningful and organ-aware BioAtt block. This not only enhances interpretability but also improves denoising performance by guiding the network’s focus toward clinically relevant regions. We present three key contributions of BioAtt: (1) BioAtt outperforms not only the baseline RED-CNN but also other attention-based denoising models by achieving higher SSIM, PSNR and lower RMSE across multiple anatomical regions including lungs, liver, and kidneys. (2) BioAtt introduces a novel paradigm by embedding anatomical priors into the network’s attention mechanism derived from a pretrained vision–language model. Our method explicitly incorporates organ-aware spatial attention to yield more semantically richer feature modulation. (3) We verify that the improvement stems from anatomical guidance rather than increased model complexity. Ablation studies confirm that models incorporating BiomedCLIP-based priors consistently outperform counterparts lacking such semantic information. Also, attention maps demonstrate that BioAtt preserves organ-specific focus across layers which offers visual explainability absent in several mechanisms. 2 Methodology Figure 1: Overview of anatomical prior extraction process. Given a low-dose CT image \mathbf{I}_{p} , a set of anatomical descriptors \{t_{i}\}_{i=1}^{N} is tokenized and encoded using a pretrained text encoder. BiomedCLIP jointly embeds the image and text to compute similarity scores S_{i} , which are normalized via softmax to yield a probability distribution \mathbf{p} . Each p_{i} reflects the estimated likelihood of a specific anatomical structure in the input image. These anatomical priors guide spatial attention in the denoising network. BioAtt extends the classic RED-CNN encoder–decoder design by integrating organ-aware spatial attention modules that are guided by anatomical priors. Specifically, given an input LDCT image I_{p}\in\mathbb{R}^{1\times H\times W} , anatomical priors are first extracted using a pretrained vision–language model (Section 2.1 ). These priors are then incorporated into a spatial attention mechanism (Section 2.2 ), which generates organ-weighted attention maps to modulate intermediate feature representations. Feature maps are refined to emphasize semantically important regions while suppressing background noise and the decoder then reconstructs the denoised output \hat{Y}\in\mathbb{R}^{1\times H\times W} using deconvolution layers and residual skip connections (Section 2.3 ). 2.1 Extracting Anatomical Priors from BiomedCLIP We utilize the pretrained BiomedCLIP model f(\cdot) to extract anatomical priors from LDCT image \mathbf{I}_{p} (Figure 1 ). The objective is to compute a probability distribution \mathbf{p} over a set of anatomical descriptors \{t_{i}\}_{i=1}^{N} , thereby enhancing the denoising process with domain-specific anatomical information. First, the set of anatomical descriptors \{t_{i}\}_{i=1}^{N} is tokenized using a pretrained BertTokenizer T(\cdot) to yield \mathbb{R}^{512} sized text embeddings. Then, the BiomedCLIP model f(\cdot) processes LDCT image \mathbf{I}_{p} along with the corresponding tokenized descriptors \{\mathbf{t}_{i}\} .