Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation
Yuting Lu, Ziliang Wang, Weixin Xu, Wei Zhang, Yongqiang Zhao, Yang Yu, Xiaohong Zhang · 2025
Read Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation by Yuting Lu, Ziliang Wang, Weixin Xu, Wei Zhang, Yongqiang Zhao, Yang Yu, Xiaohong Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16162.txt.
Introduction
Yuting Lu, Ziliang Wang, and five co-authors propose a training method that keeps medical image segmentation stable under distribution shifts and attacks. Clinical models must not collapse when scans differ from training data, but the standard fix, adversarial training, trades clean accuracy for robustness and is costly to tune. Their method instead injects small zero-mean noise at multiple layers during training.
That noise teaches a frequency-bias prior that steers internal representations away from noise-sensitive directions. A selective wavelet reconstruction step then suppresses noise-sensitive frequency bands, enhances directional structures and shape cues, and stabilizes boundary responses in the input or feature branch. The backbone-agnostic framework adds little inference cost and improved clean and robust scores on CT and ultrasound data.
Catalog record
| CREATOR | Yuting Lu, Ziliang Wang, Weixin Xu, Wei Zhang, Yongqiang Zhao, Yang Yu, Xiaohong Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-16162
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation Yuting Lu, Ziliang Wang, Weixin Xu, Wei Zhang, Yongqiang Zhao, Yang Yu, Xiaohong Zhang Abstract Clinical deployment requires segmentation models to stay stable under distribution shifts and perturbations. The mainstream solution is adversarial training (AT) to improve robustness; however, AT often brings a clean–robustness trade-off and high training/tuning cost, which limits scalability and maintainability in medical imaging. We propose Layer-wise Noise-Guided Selective Wavelet Reconstruction (LNG-SWR) . During training, we inject small, zero-mean noise at multiple layers to learn a frequency-bias prior that steers representations away from noise-sensitive directions. We then apply prior-guided selective wavelet reconstruction on the input/feature branch to achieve frequency adaptation: suppress noise-sensitive bands, enhance directional structures and shape cues, and stabilize boundary responses while maintaining spectral consistency. The framework is backbone-agnostic and adds low additional inference overhead. It can serve as a plug-in enhancement to AT and also improves robustness without AT. On CT and ultrasound datasets, under a unified protocol with PGD- L ∞ / L 2 L_{\infty}/L_{2} and SSAH, LNG-SWR delivers consistent gains on clean Dice/IoU and significantly reduces the performance drop under strong attacks; combining LNG-SWR with AT yields additive gains. When combined with adversarial training, robustness improves further without sacrificing clean accuracy, indicating an engineering-friendly and scalable path to robust segmentation. These results indicate that LNG-SWR provides a simple, effective, and engineering-friendly path to robust medical image segmentation in both adversarial and standard training regimes. I Introduction Medical Medical image segmentation plays a pivotal role in clinical diagnostics, including tumor detection, disease diagnosis, and treatment planning [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . Recent advancements in deep learning have significantly improved segmentation accuracy, but they exhibit vulnerability to adversarial attacks [ 8 , 9 ] , as illustrated in Fig. 1 (A). Studies have shown that even small perturbations in input data can lead to substantial errors in segmentation, this vulnerability poses potential risks of data manipulation, thereby threatening the integrity of medical data and the reliability of deep learning algorithms in critical medical applications. A B C D Fig. 1 : Training dynamics and frequency allocation under clean/attacked inputs and general/adversarial training. (A) Dice with/without attack (shaded area: attack-induced drop). (B) Frequency ratio evolution in general training. (C–D) Frequency ratio in general vs. adversarial training. Colors and labels are aligned with the main text; green denotes adversarial/AT-related curves. A mainstream route to robustness is adversarial training (AT), which mixes adversarial and clean samples during optimization [ 10 , 11 ] . While AT can harden models against attacks, it also alters the frequency allocation learned under standard training (Fig. 1 B), driving a drift in spectral attention when the network is repeatedly exposed to adversarial perturbations (Fig. 1 D). This drift stems from distribution and frequency mismatches between adversarial and natural inputs (highlighted in the late-stage view of Fig. 1 C) and can be amplified by dataset-specific spectral characteristics [ 12 ] . Concretely, when attacks erode low-frequency content, the model is pushed toward high-frequency cues, weakening global structure; conversely, when attacks target high-frequency details, the model shifts to low-frequency components and neglects edges and fine boundaries. Regardless of direction, such training-induced spectral bias often degrades accuracy on clean images and adds nontrivial training and tuning overhead. To address this challenge, we introduce Layer-wise Noise-Guided Selective Wavelet Reconstruction (LNG-SWR) , a dual-domain framework that couples training-time prior formation with input/feature-level execution. During training, we inject small zero-mean noise at multiple layers to learn a frequency-bias prior that steers representations away from noise-sensitive directions. Guided by this prior, we then perform selective wavelet reconstruction on the input/feature branch: preserve the low-frequency band, suppress the diagonal high-frequency band, and re-weight the horizontal/vertical bands before inverse reconstruction. This prior-guided gating delivers frequency adaptation—attenuating noise-sensitive components and enhancing directional structures and shape cues—thereby stabilizing boundary responses and maintaining spectral consistency. The design is backbone-agnostic and lightweight: layer-wise noise operates only at training time, and the wavelet module adds low inference overhead. As a result, LNG-SWR can serve as a plug-in enhancement to adversarial training, while also improving robustness under standard (non-adversarial) training. Comprehensive experiments conducted on three distinct medical image segmentation datasets provide strong evidence of our proposed model’s superior performance compared to baseline models. Contributions of this paper are outlined below: 1. We propose LNG-SWR, a network that follows a “train-time guidance, test-time execution” paradigm: small layer-wise noise shapes a prior during training, and selective wavelet reconstruction enforces it at inference. The design is plug-and-play, backbone-agnostic, and low-overhead, improving robustness without sacrificing clean accuracy. 2. We introduce a layer-wise noise–guided selective wavelet reconstruction mechanism that performs band-wise preservation, suppression, and re-weighting in the wavelet domain to achieve more precise structure and boundary reconstruction. We also provide a systematic study that clarifies the roles of different frequency components in medical image segmentation. 3. We establish a unified robustness protocol on CT (LIDC-IDRI) and ultrasound (TN-SCUI) with PGD- L_{\infty}/L_{2} and SSAH. LNG-SWR shows consistent clean Dice/IoU improvements and reduced performance drop under attacks, with additive gains when combined with AT on LIDC-IDRI. II Related Works II-A Medical Image Segmentation Deep convolutional architectures remain the mainstream for medical image segmentation. FCNs [ 13 ] established end-to-end dense prediction, while U - Net [ 14 ] introduced an encoder–decoder with skip connections that recover spatial detail from coarse semantic features. Variants strengthen multi-scale representation and optimization under limited data: MultiResU - Net [ 15 ] couples multi-resolution blocks with residual links; M 2 SNet [ 16 ] replaces single-scale units with intra-layer multi-scale units to enlarge the receptive field; MShNet [ 17 ] integrates a pyramid-style fusion module to aggregate context at different scales. Recent CNN pipelines continue to report strong accuracy across modalities and tasks [ 18 , 19 , 20 , 21 ] , benefiting from design choices such as dilated convolutions, depthwise separable kernels, attention gates, and lightweight decoders. Despite progress, several characteristics of medical images remain challenging. Lesions can be small and have weak or fuzzy boundaries; class imbalance is severe; volumetric data are anisotropic and often low-contrast; and domain shifts arise from scanners, protocols, and institutions. To mitigate these factors, prior work explores boundary-aware losses, shape or topology constraints, multi-stage/cascade decoders, and 2D–3D hybrids that mix slice-wise efficiency with volumetric context. Frequency-aware components and explicit multi-scale fusion are also used to stabilize contours and suppress noise-sensitive responses. However, most designs are optimized for clean inputs and can be brittle under perturbations or adversarial noise, motivating architectures that control frequency responses and improve robustness with low overhead. II-B Adversarial Attacks and Robustness Adversarial example generation has been studied extensively. Optimization-based methods include the box-constrained L - BFGS formulation [ 22 ] and the C&W attack [ 23 ] . Gradient-based methods span FGSM [ 11 ] , its iterative variants BIM [ 24 ] and PGD [ 10 ] , and segmentation-oriented attacks such as SegPGD [ 25 ] . Frequency-aware attacks aim to control spectral properties of perturbations, e.g., spectrum simulation [ 26 ] and high-frequency–focused strategies with low-frequency constraints [ 27 ] ; universal frequency-tuned perturbations have also been explored [ 28 ]