SRA-Seg: Synthetic to Real Alignment for Semi-Supervised Medical Image Segmentation

OFM Riaz Rahman Aranya, Kevin Desai · 2026

Read SRA-Seg: Synthetic to Real Alignment for Semi-Supervised Medical Image Segmentation by OFM Riaz Rahman Aranya, Kevin Desai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02944.txt.

Introduction

OFM Riaz Rahman Aranya and 1 co-author try to make synthetic medical images actually useful in a 2026 paper. Synthetic scans look realistic, yet training on them often fails to improve segmentation, the task of outlining structures in an image. The reason is a feature gap between synthetic and real images that standard methods cannot bridge.

Their framework, SRA-Seg, pulls synthetic features toward their nearest real counterparts. It uses embeddings from a frozen vision model to define that pull. Soft edge blending smooths anatomical transitions, and a teacher model labels the synthetic images. With only a tenth of the real data labeled, results matched methods using real unlabeled data on two benchmarks.

Catalog record

CREATOROFM Riaz Rahman Aranya, Kevin Desai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02944

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SRA-Seg: Synthetic to Real Alignment for Semi-Supervised Medical Image Segmentation OFM Riaz Rahman Aranya, Kevin Desai Abstract Synthetic data, an appealing alternative to extensive expert-annotated data for medical image segmentation, consistently fails to improve segmentation performance despite its visual realism. The reason being that synthetic and real medical images exist in different semantic feature spaces, creating a domain gap that current semi-supervised learning methods cannot bridge. We propose SRA-Seg, a framework explicitly designed to align synthetic and real feature distributions for medical image segmentation. SRA-Seg introduces a similarity-alignment (SA) loss using frozen DINOv2 embeddings to pull synthetic representations toward their nearest real counterparts in semantic space. We employ soft edge blending to create smooth anatomical transitions and continuous labels, eliminating the hard boundaries from traditional copy-paste augmentation. The framework generates pseudo-labels for synthetic images via an EMA teacher model and applies soft-segmentation losses that respect uncertainty in mixed regions. Our experiments demonstrate strong results: using only 10% labeled real data and 90% synthetic unlabeled data, SRA-Seg achieves 89.34% Dice on ACDC and 84.42% on FIVES, significantly outperforming existing semi-supervised methods and matching the performance of methods using real unlabeled data. Code is available at https://github.com/UTSA-VIRLab/SRA-Seg 1 Introduction Using deep learning for medical image segmentation typically requires large, carefully annotated datasets to achieve state-of-the-art performance [ 21 ] . Unlike general computer vision, acquiring extensive ground truth in medical imaging is inherently complex, time-consuming, and resource-intensive, requiring specialized professional expertise. This scarcity directly impacts model accuracy, as performance typically scales with dataset size. To address this data bottleneck, synthetic data generation has emerged as a promising data augmentation strategy [ 12 ] . However, a significant challenge persists, which is the inherent domain gap between synthetic and real medical images. Directly mixing synthetic and real images during training can cause models to fail on new test data because synthetic images, despite visual plausibility, can introduce artifacts, hallucinations, or lack the intricate, clinically relevant anatomical details crucial for robust segmentation in real-world scenarios [ 6 ] . (a) (b) (c) (d) Figure 1 : Kernel Density Estimation (KDE) graphs showcasing domain mismatch between labeled (green line) and unlabeled (blue line) data for “Right Ventricle” class of the ACDC dataset [ 2 ] . (a) UNet [ 26 ] with Real Unlabeled Data (b) UNet [ 26 ] with Synthetic Unlabeled Data (c) BCP [ 1 ] with Synthetic Unlabeled Data (d) Proposed SRA-Seg with Synthetic Unlabeled Data. This domain gap problem exists in both synthetic and real-world datasets, especially when data is aggregated from various sources. It causes significant distributional disparities between labeled and unlabeled samples, making model training more challenging. As shown in Figure 1(a) , a kernel density estimation plot of a baseline UNet [ 26 ] on the Right Ventricle class of the ACDC dataset [ 2 ] clearly reveals this inherent domain shift. The challenge intensifies when synthetic data is integrated into semi-supervised learning (SSL) frameworks. Studies like SinGAN-Seg [ 31 ] and recent work with diffusion models [ 27 , 13 ] consistently highlight that while synthetic images may appear visually convincing, they often lack the nuanced, intricate features of genuine medical images, leading to reduced generalization capabilities [ 13 , 10 ] . For instance, Figure 1(b) demonstrates an increased domain gap between real labeled data and corresponding synthetic unlabeled data generated for the ACDC dataset using StyleGAN2-ADA [ 16 ] . Generative Adversarial Networks (GANs) [ 7 ] have revolutionized synthetic data generation, but their practical utility for medical image segmentation remains limited by a persistent domain gap [ 15 , 20 ] . CycleGAN [ 38 ] excels at domain-to-domain translation, while SinGAN-Seg [ 31 ] addresses data scarcity by generating multiple samples from a single input. StyleGAN2-ADA [ 16 ] addresses overfitting on small medical datasets by dynamically adjusting augmentations, unlike StyleGAN [ 17 ] which struggled with it. StyleGAN2-ADA’s ability to produce high-quality synthetic images with fewer real training samples makes it particularly well-suited for medical image generation. However, the synthetic-real domain gap remains a significant challenge in SSL, exacerbated by substantial disparities between labeled and unlabeled data, especially when the unlabeled data includes synthetic samples. This disparity leads to substantial empirical mismatches [ 18 , 20 ] . While the Bidirectional Copy-Paste (BCP) method [ 1 ] successfully reduces the distributional gap between real labeled and real unlabeled datasets, it is not optimized for scenarios involving synthetic data, as illustrated by its inefficacy in bridging this gap in Figure 1(c) . Proposed Approach: We propose SRA-Seg that effectively integrates high-quality synthetic images as unlabeled data within semi-supervised learning. Our method introduces a Similarity-Alignment (SA) loss to explicitly align synthetic feature distributions with their closest real counterparts, effectively bridging the synthetic-to-real domain gap, as shown in Figure 1(d) . Through this principled alignment strategy, SRA-Seg achieves superior segmentation performance, demonstrating that synthetic data can match or exceed the utility of real unlabeled data when properly aligned. In summary, our contributions are: • A framework explicitly designed to bridge the synthetic-to-real domain gap for semi-supervised medical image segmentation. • A similarity-alignment (SA) loss using frozen DINOv2 embeddings to pull synthetic features toward real counterparts. • Soft edge blending for smooth anatomical transitions, replacing hard copy-paste boundaries. • EMA-based one-hot pseudo-label generation enabling effective use of synthetic images in SSL. 2 Related Work Many conventional SSL methods, like self-training and Mean Teacher frameworks [ 30 ] , mostly use pseudo-labeling and consistency losses. While methods like SASSNet [ 19 ] , UA-MT [ 35 ] , and UMCT [ 34 ] incorporate geometric constraints and uncertainty awareness to better leverage unlabeled data, they often treat labeled and unlabeled samples independently, missing valuable inter-domain information and struggling to effectively integrate synthetic data. Similarly, data augmentation strategies like CutMix [ 36 ] enhance data diversity, but still face performance limitations when pseudo-labels provide imprecise supervision. Recent advances in semi-supervised medical segmentation show improved performance but still lack synthetic data handling capabilities. CrossMatch [ 37 ] combines perturbation strategies with knowledge distillation. DiffRect [ 22 ] leverages latent diffusion models for pseudo-label refinement. ADB [ 5 ] introduces adaptive displacement fields that adjust based on local image characteristics, and CGS [ 32 ] proposes a collaborative framework for multi-target segmentation. BCP [ 1 ] creates mixed samples through copy-paste operations, enforcing bidirectional consistency. While these methods excel with real data, none provide mechanisms to handle synthetic data or adapt to the distribution gaps between real and generated samples. Domain adaptation methods have been extensively studied to address distribution shifts in medical imaging [ 20 ] . Classical approaches like adversarial domain adaptation [ 15 ] and recent methods including dual-level alignment [ 18 ] and diffusion-based adaptation [ 13 ] show promise but typically require domain labels and struggle with continuous quality variations present in synthetic data. Disentanglement learning approaches [ 9 , 11 , 3 ] attempt to separate domain-invariant content from domain-specific style. Recent theoretical work [ 23 ] demonstrated that unsupervised disentanglement is fundamentally impossible without strong inductive biases, requiring extensive hyperparameter tuning that doesn’t generalize across datasets. Furthermore, medical imaging studies [ 24 ] confirm that pathological changes simultaneously affect appearance and structure,

Read the complete text