Anatomy-Aware Low-Dose CT Denoising via Pretrained Vision Models and Semantic-Guided Contrastive Learning
Runze Wang, Zeli Chen, Zhiyun Song, Wei Fang, Jiajin Zhang, Danyang Tu, Yuxing Tang, Minfeng Xu, Xianghua Ye, Le Lu, Dakai Jin · 2025
Read Anatomy-Aware Low-Dose CT Denoising via Pretrained Vision Models and Semantic-Guided Contrastive Learning by Runze Wang, Zeli Chen, Zhiyun Song, Wei Fang, Jiajin Zhang, Danyang Tu, Yuxing Tang, Minfeng Xu, Xianghua Ye, Le Lu, Dakai Jin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07788.txt.
Introduction
Runze Wang, Zeli Chen, Zhiyun Song, and a team of co-authors teach a program to clean noise from low-dose CT scans without blurring the anatomy. Doctors lower the X-ray dose to protect patients, but the grainier images can hide detail, and most cleaning methods ignore what body part they are looking at.
Their method, ALDEN, borrows knowledge from large vision models trained on vast image sets. A judging network checks whether a cleaned scan looks like real tissue of the right kind, and a contrast-based step keeps each tissue's pattern true to itself while pushing artifacts away. On two scan datasets the method beat prior tools, and organs stayed correctly shaped for later outlining. The authors argue that respecting anatomy is the key to safe denoising.
Catalog record
| CREATOR | Runze Wang, Zeli Chen, Zhiyun Song, Wei Fang, Jiajin Zhang, Danyang Tu, Yuxing Tang, Minfeng Xu, Xianghua Ye, Le Lu, Dakai Jin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07788
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Anatomy-Aware Low-Dose CT Denoising via Pretrained Vision Models and Semantic-Guided Contrastive Learning Runze Wang, Zeli Chen, Zhiyun Song, Wei Fang, Jiajin Zhang, Danyang Tu, Yuxing Tang, Minfeng Xu, Xianghua Ye, Le Lu, Dakai Jin Abstract To reduce radiation exposure and improve the diagnostic efficacy of low-dose computed tomography (LDCT), numerous deep learning-based denoising methods have been developed to mitigate noise and artifacts. However, most of these approaches ignore the anatomical semantics of human tissues, which may potentially result in suboptimal denoising outcomes. To address this problem, we propose ALDEN, an anatomy-aware LDCT denoising method that integrates semantic features of pretrained vision models (PVMs) with adversarial and contrastive learning. Specifically, we introduce an anatomy-aware discriminator that dynamically fuses hierarchical semantic features from reference normal-dose CT (NDCT) via cross-attention mechanisms, enabling tissue-specific realism evaluation in the discriminator. In addition, we propose a semantic-guided contrastive learning module that enforces anatomical consistency by contrasting PVM-derived features from LDCT, denoised CT and NDCT, preserving tissue-specific patterns through positive pairs and suppressing artifacts via dual negative pairs. Extensive experiments conducted on two LDCT denoising datasets reveal that ALDEN achieves the state-of-the-art performance, offering superior anatomy preservation and substantially reducing over-smoothing issue of previous work. Further validation on a downstream multi-organ segmentation task (encompassing 117 anatomical structures) affirms the model’s ability to maintain anatomical awareness. 1 Introduction Low-dose computed tomography (LDCT) has become an important and popular diagnostic tool for reducing radiation exposure risks; however, its clinical utility is hindered by the amplified noise and artifacts that degrade anatomical fidelity. Deep learning advances of convolutional neural networks [ 6 , 31 ] , transformer [ 21 ] , and diffusion models [ 8 ] , have improved LDCT denoising, these methods share a common limitation: pixel-level constraints (e.g., L1/MSE losses) prioritize global error reduction at the expense of local anatomical plausibility, often resulting in oversmooth textures that obscure small tissues and subtle pathologies [ 29 ] . Generative adversarial networks (GANs) offer an alternative by learning data distributions rather than pixel-wise mappings [ 9 , 23 , 22 ] . However, conventional GAN-based LDCT denoising methods [ 11 , 25 ] often do not capture the important relationship between noise characteristics and anatomical semantics, as noise levels in CT images differ depending on tissue type [ 18 , 6 ] . Recent work also highlights the need for image understanding in restoration to improve the explainability and clinical application of medical imaging [ 20 , 14 , 6 , 5 ] . This calls for a shift towards fine-grained anatomy-aware denoising, where semantic consistency is crucial for effective texture restoration. Integrating anatomical semantics into denoising models presents challenges since conventional task-specific segmentation networks [ 27 , 10 ] require costly and precise anatomical annotations, limiting generalizability across a large number of diverse anatomies. Progresses in foundation models [ 19 , 28 ] demonstrate that pretrained vision models (PVMs) pretrained on large-scale datasets possess exceptional transfer learning capability for semantic understanding. PVMs offer two key advantages: (1) their exposure to millions of natural images allows the development of rich hierarchical feature representations that capture universal texture and structure patterns, which can be adapted to the medical image domain [ 2 , 32 , 1 , 17 ] ; and (2) unlike segmentation networks requiring predefined anatomical labels, PVMs generate semantic features without explicit supervision, enabling the discovery of latent anatomical relationships essential for fine-grained denoising. Inspired by this, we present ALDEN ( A natomy-aware L DCT DEN oising framework), which integrates PVMs within a GAN architecture for enhanced anatomy-aware restoration. ALDEN features an anatomy-aware discriminator that utilizes hierarchical semantic features extracted from reference NDCT via PVMs, guiding adversarial learning to concentrate on tissue-specific semantics. This differentiates it from previous GAN-based LDCT denoising methods that evaluate all anatomical structures uniformly. Additionally, we propose a semantically guided contrastive paradigm that uses PVM-extracted features to enforce anatomy-aware consistency. Positive pairs align features from corresponding anatomical regions in denoised CT and NDCT, while negative pairs include features from denoised CT and LDCT at the same location to emphasize noise, and from denoised CT and NDCT at mismatched locations to penalize anatomical misalignment. The InfoNCE loss [ 4 ] is utilized to minimize the distances between positive pairs and maximize the separation from negative pairs. Our contributions are summarized as follows. 1) We first propose the integration of PVMs into LDCT denoising, uniquely combining PVMs with adversarial and contrastive learning approaches. 2) We introduce an anatomy-aware discriminator that dynamically incorporates hierarchical semantic features from NDCT to enable a fine-grained semantic-aware LDCT denoising. 3) We present a semantically guided contrastive learning module to maintain anatomical consistency through positive pairs while reducing noise and artifacts with dual negative pairs. 4) Extensive experiments on two LDCT denoising datasets demonstrate that ALDEN achieves the state-of-the-art denoising performance, delivering enhanced texture preservation and avoiding over-smoothing. Further validation on a downstream multi-organ segmentation task with 117 anatomical structures demonstrates the effectiveness of our anatomy-aware denoising approach. 2 Methodology 2.1 Overview of ALDEN Conventional GAN-based LDCT denoising frameworks [ 11 , 25 ] employ a generator-discriminator architecture to enhance perceptual quality. Let X\sim P_{X} denote LDCT inputs and Y\sim P_{Y} their NDCT counterparts. The generator (i.e., denoising network) G produces denoised outputs \hat{Y}=G(X) , optimized through two objectives: 1) Pixel fidelity via pixl-wise supervised loss. Here, L_{1} loss is employed, which is expressed as \mathcal{L}_{1}=\|\hat{Y}-Y\|_{1} . 2) Distribution alignment via adversarial learning. The discriminator D differentiates between real NDCT images Y and generated/denoised outputs \hat{Y} . Simultaneously, the generator G is encouraged to produce realistic denoised CT \hat{Y} that can effectively compete with the discriminator. The G and D form a two-player minimax game, optimized through adversarial loss defined as \mathcal{L}_{adv}=\mathbb{E}_{Y\sim P_{Y}}[\log D(Y)]+\mathbb{E}_{X\sim P_{X}}[\log(1-D(G(X)))] . As illustrated in Fig. 1 (left), our ALDEN framework extends the traditional GAN-based LDCT denoising model by introducing two key components: the Anatomy-Aware Discriminator (AAD) and Semantic-guided Contrastive Learning (SCL). The AAD leverages NDCT-derived semantic features extracted from PVMs as conditional input. Let \Psi represent the PVMs, the goal is to align conditional distributions: P(\hat{Y}|\Psi(Y))\approx P(Y|\Psi(Y)) , facilitating detailed anatomy-aware texture restoration. In contrast, conventional discriminators operate only on marginal distributions: P(\hat{Y})\approx P(Y) , potentially overlooking essential semantic content. The SCL component utilizes features extracted by PVMs to enforce anatomy-aware consistency through contrastive learning. It achieves this by forming positive pairs to preserve tissue-specific patterns and dual negative pairs to suppress noise and artifacts. More details on AAD can be found in Section 2.2 , while the formalization of SCL is presented in Section 2.3 . Figure 1: Overview of the proposed ALDEN ( A natomy-aware L DCT DEN oising) framework, which integrates the Anatomy-Aware Discriminator (AAD) for fine-grained texture restoration and Semantic-guided Contrastive Learning (SCL) for enhanced noise suppression. 2.2 Anatomy-Aware Discriminator The AAD aims to achieve fine-grained semantic-aware denoising through adversarial learning. Inspired by [ 14 ] , we propose an Attention-based Feature Fusion (AFF) module that integrates hierarchical semantic priors from the reference NDCT Y using PVMs. As shown in Fig. 1 (left), our multi-level AFF operates across the feature hierarchies of both the PVM and the discriminator, providing progressive semantic guidance. To enhance the quality of semantic priors, we also explore