DDFP: Data-dependent Frequency Prompt for Source Free Domain Adaptation of Medical Image Segmentation
Siqi Yin, Shaolei Liu, Manning Wang · 2025
Read DDFP: Data-dependent Frequency Prompt for Source Free Domain Adaptation of Medical Image Segmentation by Siqi Yin, Shaolei Liu, Manning Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09927.txt.
Introduction
Siqi Yin, Shaolei Liu, and Manning Wang adapt medical image segmentation to new sites without source data in a 2025 paper. Hospitals often cannot share the labeled scans a model was trained on, due to privacy rules. So adaptation must start from the trained model alone plus unlabeled target scans, a setting where style transfer and self training tricks still leave weak images and labels.
Their framework adds a preadaptation stage that builds a better starting model for the target site. A data dependent frequency prompt then helps close the style gap while training only part of the model, which saves effort under thin supervision. The design targets cleaner pseudo labels and steadier gains.
Catalog record
| CREATOR | Siqi Yin, Shaolei Liu, Manning Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-09927
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DDFP: Data-dependent Frequency Prompt for Source Free Domain Adaptation of Medical Image Segmentation Siqi Yin, Shaolei Liu, Manning Wang Abstract Domain adaptation addresses the challenge of model performance degradation caused by domain gaps. In the typical setup for unsupervised domain adaptation, labeled data from a source domain and unlabeled data from a target domain are used to train a target model. However, access to labeled source domain data, particularly in medical datasets, can be restricted due to privacy policies. As a result, research has increasingly shifted to source-free domain adaptation (SFDA), which requires only a pretrained model from the source domain and unlabeled data from the target domain data for adaptation. Existing SFDA methods often rely on domain-specific image style translation and self-supervision techniques to bridge the domain gap and train the target domain model. However, the quality of domain-specific style-translated images and pseudo-labels produced by these methods still leaves room for improvement. Moreover, training the entire model during adaptation can be inefficient under limited supervision. In this paper, we propose a novel SFDA framework to address these challenges. Specifically, to effectively mitigate the impact of domain gap in the initial training phase, we introduce preadaptation to generate a preadapted model, which serves as an initialization of target model and allows for the generation of high-quality enhanced pseudo-labels without introducing extra parameters. Additionally, we propose a data-dependent frequency prompt to more effectively translate target domain images into a source-like style. To further enhance adaptation, we employ a style-related layer fine-tuning strategy, specifically designed for SFDA, to train the target model using the prompted target domain images and pseudo-labels. Extensive experiments on cross-modality abdominal and cardiac SFDA segmentation tasks demonstrate that our proposed method outperforms existing state-of-the-art methods. Our code is available online. keywords Semantic segmentation ,Domain adaptation ,Medical image ,Prompt learning † † corresponding: Corresponding author 1 Introduction Deep learning has become widely used in the field of medical image analysis, and its promising performance largely relies on the availability of sufficient labeled data for model training. However, data collection and labeling are labor-intensive and time-consuming, especially for medical image segmentation tasks that require expert annotators for dense annotation. A common solution is to train a model using labeled data from a source domain and then transfer the learned knowledge to a new dataset (target domain), which is often unlabeled [ 5 ] . However, data distributions can differ significantly between domains due to factors such as acquisition protocols and data modalities, creating a domain gap. When a model trained on the source domain is directly applied to the target domain, this gap commonly leads to severe performance degradation [ 19 ] . To address this, domain adaptation (DA) has been proposed to improve model performance under domain shifts. As one of the most commonly used settings, unsupervised domain adaptation (UDA) has been extensively studied and shown success in medical tasks such as object detection [ 41 , 9 ] , classification [ 8 , 15 , 31 ] and segmentation [ 2 , 12 , 3 , 24 , 45 , 14 , 23 , 46 , 26 ] . These UDA methods generally require labeled data from the source domain and unlabeled data from the target domain data for target model training. However, this approach becomes impractical when access to source domain is restricted, for example, due to privacy concerns in medical datasets [ 43 ] . To alleviate the dependence on source domain data during the adaptation process, the source-free DA (SFDA) scheme is proposed. In this approach, only unlabeled target domain data and a pretrained source domain model (referred to as the “source model”) are used to train the target domain model (referred to as the “target model”). In semantic segmentation tasks, SFDA methods typically rely on two strategies: data generation [ 13 , 42 , 38 , 11 , 25 ] and model fine-tuning [ 13 , 42 , 11 , 47 , 4 , 1 ] , as shown in Fig. 1 (a). The data-generation strategy translates target domain images to a source-like style, reducing the domain gap and either directly improving the source model’s performance on the target data [ 38 ] or assisting the training of the target model [ 42 , 13 , 11 , 25 ] . Recently, prompt learning has been introduced in SFDA for image style translation, applying a trainable prompt in either the frequency [ 38 ] or spatial domain [ 13 ] to align target domain images with the source domain style. Meanwhile, the model fine-tuning strategy initializes the target model using the pretrained source model and fine-tunes it using self-supervised techniques, such as pseudo-labeling [ 42 , 13 , 4 ] . Figure 1: Comparison between (a) the previous source-free domain adaptation framework and (b) the proposed DDFP framework. The DDFP framework reduces the domain gap throughout both the initial and subsequent training phases by utilizing a preadapted model, data-dependent frequency prompt learning, and pseudo-labeling strategies. Despite promising results from existing SFDA methods, there are three key challenges that hinder further progress. Problem 1. Current prompt learning-based style translation methods apply a same prompt across the entire target domain [ 38 , 13 ] , ignoring intradomain variations. Problem 2. In the early stages of training, the domain gap between the target domain data and the source model remains large. Directly using the source model to initialize the target model and generate pseudo-labels can lead to mismatches between the data and the model, negatively impacting both model performance and pseudo-label quality. Problem 3. SFDA methods that fine-tune the entire target model [ 13 , 47 , 4 , 42 ] or layers before the final classifier [ 47 ] often face inefficiencies. Research has shown that features from shallow and deep layers correspond to style and content information, respectively [ 30 , 42 ] , with the domain gap primarily involving low-level stylistic differences [ 6 ] . Fine-tuning the entire model may not be necessary, especially when supervision is limited in SFDA scenarios. To address the aforementioned challenges, we propose a novel framework utilizing data-dependent frequency prompt (DDFP), as illustrated in Fig. 1 (b). Our approach tackles the domain gap at both the initial and subsequence states of training by employing model preadaptation, prompt learning, and pseudo-labeling, thereby improving the efficacy of model transfer across domains. In the initial stage, where the domain gap is large and unaddressed by prior training, we focus on mitigating the gap from the model perspective. Specifically, we calibrate the batch normalization (BN) statistic of the source model to derive a preadapted model that is better aligned with the target domain distribution than the original source model. This strategy offers two key advantages. Initializing the target model with the preadapted model reduces the domain gap between the model and target domain data during the early training stages. Besides, using the preadapted model to generate pseudo-labels for the target domain images improves pseudo-label quality, thus enhancing the final performance of the target model (addressing Problem 2). During the target model training, we address the domain gap at the image level by applying data-dependent style transfer, combined with pseudo-labeling to train