AnatoMaskGAN: GNN-Driven Slice Feature Fusion and Noise Augmentation for Medical Semantic Image Synthesis
Zonglin Wu, Yule Xue, Qianxiang Hu, Yaoyao Feng, Yuqi Ma, Shanxiong Chen* · 2025
Read AnatoMaskGAN: GNN-Driven Slice Feature Fusion and Noise Augmentation for Medical Semantic Image Synthesis by Zonglin Wu, Yule Xue, Qianxiang Hu, Yaoyao Feng, Yuqi Ma, Shanxiong Chen* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11375.txt.
Introduction
Synthetic medical images can enlarge training sets, but slice-by-slice fakes often disagree with their neighbors in a scan. Zonglin Wu and co-authors enforce that agreement in a 2025 paper with a generator that reasons across slices.
A graph network fuses features from neighboring slices, weighting the strongly related ones, so anatomy flows continuously through the volume. A three-dimensional noise strategy varies structure while keeping that flow. A texture classifier then polishes gray levels so tissue looks right. On two public scan collections the method topped prior scores for fidelity and likeness. Removing any of the three parts hurt results, confirming each earns its place. Better fakes mean better training data where real scans are scarce.
Catalog record
| CREATOR | Zonglin Wu, Yule Xue, Qianxiang Hu, Yaoyao Feng, Yuqi Ma, Shanxiong Chen* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-11375
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AnatoMaskGAN: GNN-Driven Slice Feature Fusion and Noise Augmentation for Medical Semantic Image Synthesis Zonglin Wu, Yule Xue, Qianxiang Hu, Yaoyao Feng, Yuqi Ma, Shanxiong Chen* Abstract Medical semantic-mask synthesis boosts data augmentation and analysis, yet most GAN-based approaches still produce one-to-one images and lack spatial consistency in complex scans. To address this, we propose AnatoMaskGAN, a novel synthesis framework that embeds slice-related spatial features to precisely aggregate inter-slice contextual dependencies, introduces diverse image-augmentation strategies, and optimizes deep feature learning to improve performance on complex medical images. Specifically, we design a GNN-based strongly correlated slice-feature fusion module to model spatial relationships between slices and integrate contextual information from neighboring slices, thereby capturing anatomical details more comprehensively; we introduce a three-dimensional spatial noise-injection strategy that weights and fuses spatial features with noise to enhance modeling of structural diversity; and we incorporate a grayscale-texture classifier to optimize grayscale distribution and texture representation during generation. Extensive experiments on the public L2R-OASIS and L2R-Abdomen CT datasets show that AnatoMaskGAN raises PSNR on L2R-OASIS to 26.50 dB (0.43 dB higher than the current state of the art) and achieves an SSIM of 0.8602 on L2R-Abdomen CT—a 0.48 percentage-point gain over the best model, demonstrating its superiority in reconstruction accuracy and perceptual quality. Ablation studies that successively remove the slice-feature fusion module, spatial 3-D noise-injection strategy, and grayscale-texture classifier reveal that each component contributes significantly to PSNR, SSIM, and LPIPS, further confirming the independent value of each core design in enhancing reconstruction accuracy and perceptual quality. I Introduction Medical imaging underpins diagnosis, monitoring, treatment planning, and education by revealing internal anatomy and pathology [ 1 ] . Deep learning has boosted segmentation, classification, and computer-aided diagnosis, yet it hinges on large, expertly annotated datasets. Equipment costs, privacy rules, and labor-intensive labeling keep data supply far below demand, constraining model generalization and accuracy—a major bottleneck for medical AI [ 2 ] . Thus, developing effective data-expansion and augmentation methods under limited-data conditions has become a pressing research focus. To tackle these challenges, researchers increasingly use semantic-mask–conditioned medical image generation [ 2 ] . Detailed masks of anatomy and lesions steer models to create realistic, semantically correct images, enriching data diversity and authenticity while sharply cutting acquisition and annotation costs, thereby supporting data augmentation and computer-aided diagnosis [ 3 , 4 ] . In semantic-mask synthesis, Generative Adversarial Networks (GANs) [ 5 ] have become a research focus because of their unique one-to-many inference pattern, highly controllable latent space, and ability to generate high-resolution images from small samples. Specifically, a GAN can produce multiple stylistically different medical images in a single forward pass lasting only milliseconds, greatly improving data-expansion efficiency. The latent-space properties support fine control and linear interpolation of semantic masks, enabling precise reconstruction of local anatomical details and lesion characteristics. Moreover, GANs possess strong feature-extraction and representation capabilities, allowing them to capture sub-millimeter structural details and lesion features even in small-sample settings, showing clear potential over other generation techniques. Applying GANs to medical semantic-mask synthesis therefore promises revolutionary advances in healthcare. Nevertheless, most existing GAN-based methods still use a one-to-one mapping—each semantic mask yields a single 2D image slice (i.e., a cross-sectional scan of a 3D volume). When applied to high-dimensional, multi-slice medical data, this simple mapping cannot enforce spatial consistency between adjacent slices or leverage anatomical priors (pre-learned knowledge of typical organ shapes and relationships). As a result, generated images often suffer from poor structural coherence, imprecise boundaries, and missing fine details. In particular, without effective contextual fusion across slices and explicit anatomical constraints, tissue regions can become discontinuous, details may vanish, and textures appear inconsistent. Moreover, traditional GANs typically inject only a single noise vector, limiting their ability to capture variability in structure and texture—thus hindering both generalization and clinical usefulness. To systematically address these problems and improve semantic-mask synthesis for complex medical images, we propose a novel framework—AnatoMaskGAN. First, we design an innovative graph-neural-network (GNN) slice-feature fusion module, which constructs a spatial adjacency graph between slices and uses a GNN to efficiently aggregate contextual information from neighboring slices. This builds rich spatial dependencies, more accurately capturing continuity of anatomical structures and lesion regions, and markedly enhancing spatial coherence and anatomical consistency in the generated images. Second, we introduce a spatial three-dimensional noise-injection strategy that fuses weighted random noise in the spatial domain, strengthening the model’s ability to represent diverse anatomical structures and tissue textures and improving generalization. Finally, to optimize visual-perception quality, we add a grayscale-texture classifier that explicitly constrains the learning of grayscale distributions and texture features, bringing generated images closer to real medical images in grayscale detail and textural realism. On L2R-OASIS (brain MRI), AnatoMaskGAN raises PSNR to 26.50 dB—0.43 dB above the state-of-the-art—while on L2R-Abdomen CT it lifts SSIM to 0.8602, a 0.48 % gain. Ablations show that slice-feature fusion, 3-D noise injection, and the gray-level/texture classifier each add essential, complementary boosts across PSNR, SSIM, and LPIPS. In summary, our contributions are threefold: • GNN-based slice-feature fusion: deep modeling of spatial context significantly improves anatomical continuity. • 3-D spatial noise injection: enhances generalization to complex structures and diverse textures. • Grayscale-texture classifier: boosts photorealism and fine-grained texture fidelity in the synthesized images. II RELATED WORK In recent years, the explosive growth of deep-learning techniques has propelled remarkable progress in medical-image analysis. Yet the field’s unique constraints—strict data privacy, the difficulty and expense of expert annotation, and high acquisition costs—mean that medical-imaging datasets remain limited in both scale and diversity, curbing the real-world clinical performance of deep-learning models. To mitigate data scarcity, researchers have increasingly turned to generative-adversarial-network (GAN)–based augmentation. After Goodfellow et al. introduced the GAN framework [ 5 ] , it was rapidly adopted for medical-image data expansion, including cross-modal image translation [ 6 , 7 , 8 ] and intra-modal augmentation [ 9 , 10 , 11 ] , showing encouraging gains in data enrichment and diagnostic support. Early GANs used basic adversarial losses and weak structural constraints, so their outputs often had blurred boundaries and anatomically implausible distortions. Conditional GANs [ 12 ] addressed this by conditioning on semantic masks—pix2pix [ 13 ] , for instance, guides the generator with a segmentation map—while SPADE [ 14 ] improved granularity by injecting map-derived modulation parameters into each normalization layer, giving every semantic region its own activations. Although SPADE now underpins many models and excels at both natural- and medical-image synthesis, its locally focused modulation still struggles to capture long-range dependencies, leaving complex layouts prone to semantic gaps and fuzzy edges. Building on SPADE, Hao Tang et al. proposed the Dual-Attention GAN (DAGAN) [ 15 ] , introducing spatial- and channel-attention modules to capture long-range dependencies and region-specific features, thereby producing higher-quality, semantically consistent images. Although DAGAN preserves global structures in complex semantic maps, it remains highly dependent on the geometric layout of the mask and still models appearance correlations between semantic regions only weakly. To address this, Yi Wang et al. presented SCGAN [ 16 ] , which adds convolutional normalization to obtain features with both semantic correlation and spatial variability, enhancing coherence and diversity across semantic regions. SCGAN boosts generation quality while retaining controllability, but its reliance on multiple perceptual losses leads to complex training and high computational