FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysis

Haoxuan Che, Yifei Wu, Haibo Jin, Yong Xia, Hao Chen · 2025

Read FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysis by Haoxuan Che, Yifei Wu, Haibo Jin, Yong Xia, Hao Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13967.txt.

Introduction

Haoxuan Che, Yifei Wu, Haibo Jin, Yong Xia, and Hao Chen wrote this machine learning paper, published in 2025. It trains medical image models across hospitals that cannot share their scans, in a way that still works on scans from new places.

In federated learning, each hospital trains locally and only model updates travel. The hard part is handling the style gap between hospitals' images. Older methods remix the traits of known sites, which may never mimic a truly new site. The authors' framework instead invents fresh image styles by pushing generated pictures away from the originals at the feature level, then trains the task model to close that gap. They also note that sites contribute unevenly to the shared model's toughness. The paper builds on that observation to balance the training.

Catalog record

CREATORHaoxuan Che, Yifei Wu, Haibo Jin, Yong Xia, Hao Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-13967

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedDAG: Federated Domain Adversarial Generation Towards Generalizable Medical Image Analysis Haoxuan Che, Yifei Wu, Haibo Jin, Yong Xia, Hao Chen Abstract Federated domain generalization aims to train a global model from multiple source domains and ensure its generalization ability to unseen target domains. Due to the target domain being with unknown domain shifts, attempting to approximate these gaps by source domains may be the key to improving model generalization capability. Existing works mainly focus on sharing and recombining local domain-specific attributes to increase data diversity and simulate potential domain shifts. However, these methods may be insufficient since only the local attribute recombination can be hard to touch the out-of-distribution of global data. In this paper, we propose a simple-yet-efficient framework named Federated Domain Adversarial Generation (FedDAG). It aims to simulate the domain shift and improve the model generalization by adversarially generating novel domains different from local and global source domains. Specifically, it generates novel-style images by maximizing the instance-level feature discrepancy between original and generated images and trains a generalizable task model by minimizing their feature discrepancy. Further, we observed that FedDAG could cause different performance improvements for local models. It may be due to inherent data isolation and heterogeneity among clients, exacerbating the imbalance in their generalization contributions to the global model. Ignoring this imbalance can lead the global model’s generalization ability to be sub-optimal, further limiting the novel domain generation procedure. Thus, to mitigate this imbalance, FedDAG hierarchically aggregates local models at the within-client and across-client levels by using the sharpness concept to evaluate client model generalization contributions. Extensive experiments across four medical benchmarks demonstrate FedDAG’s ability to enhance generalization in federated medical scenarios. Fig. 1: The potential solutions of approximating domain shifts in federated scenarios: (a) sharing and recombining local domain-specific attributes and (b) adversarial novel domain generation. I Introduction With the continuous advancement of medical research and clinical practice, the medical field generates substantial data [ 1 , 2 ] . However, these data are often scattered across different healthcare institutions. Due to legal and regulatory restrictions, centralizing these data for training is probably infeasible [ 3 , 4 ] . Federated Learning (FL) [ 5 ] enables multiple clients to collaborate on training models without data centralizing or sharing, ensuring that patient privacy is protected throughout the process. However, the existing methods of FL are sensitive to domain shifts, which occur when the target domain has a different data distribution than the source domains [ 6 ] . Neglecting the influence of domain shifts may limit the applications of FL models in real-world scenarios [ 7 ] . For instance, when a healthcare institution outside the federation aims to use the model trained by multiple other institutions inside the federation, the model often performs poorly due to the significant domain shifts [ 8 , 9 , 10 ] . Recently, Federated Domain Generalization (FedDG) has emerged as a new focus [ 8 ] . Unlike the setting of Domain Generalization (DG), FedDG aims to train a model from multiple source domains without data centralization and enable the model to generalize well on the unseen target domains [ 8 ] . To achieve this generalization objective, various pioneered methods have been proposed [ 8 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 ] . For example, some existing methods primarily focus on model structure and aggregation strategies, aiming to effectively improve the generalization ability of the global model [ 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 ] . Although these methods typically exhibit good generalization ability on known source domains, their performance on unseen target domains is often sub-optimal when significant domain shift occurs [ 28 ] . Other methods focus on increasing data diversity and simulating potential domain gaps by sharing and recombining local domain-specific attributes from different clients [ 8 , 11 , 12 , 13 , 14 ] , such as the distribution of images and features. However, these domain attributes contain local private information. Although it is challenging to reconstruct the training data from such attributes, their leakage remains prohibited due to regulatory constraints [ 4 ] . Moreover, recombining local domain attributes merely expands the local data yet still within the global distribution rather than touching the out-of-distribution of global data, as shown in Fig. 1 (a). This implies the difficulty for these methods to approximate the domain shifts, which limits their generalization capability on unseen target domains. Novel domain generation is a promising solution to approximate the domain shifts and improve the model generalization ability to unseen target domains [ 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 ] . These methods can generate novel-style images with significant visual differences compared to source domains, through domain-level adversarial generation or the diffusion model with domain-related prompts. The distribution of these generated images could differ from not only the local data distribution but also the global data distribution, as shown in Fig. 1 (b). They expand the training data distribution, which can reflect domain shifts between target and source domains. Therefore, effectively leveraging these generated images can improve model generalization capability. However, introducing novel domain generation into federated medical scenarios is non-trivial and faces challenges from two aspects. As for medical scenarios , the gaps among the different clients are more ambiguous than natural scenarios [ 39 , 40 , 41 ] . Thus, it may be insufficient to perform effective novel domain generation by the conventional learning paradigm, i.e. , adversarial generating via domain labels or domain-related prompts [ 29 , 30 ] . Moreover, constraining the semantics is essential, which are susceptible in the generated process. Uncontrolled generation may lead to the loss of some key semantics, significantly affecting the generalization performance of the model [ 42 , 43 , 44 , 45 ] . As for federated scenarios , conducting novel domain generation on different clients can cause divergent performance improvements of client models, due to the data isolation and heterogeneity [ 46 ] . It can exacerbate the generalization contribution imbalance of local models to the global model, neglecting such imbalance may lead the model generalization to be sub-optimal [ 18 ] . As can be imagined, the sub-optimal model can limit generation effectiveness since it plays an important role in the adversarial generation paradigm. This paper proposes Federated Domain Adversarial Generation (FedDAG), a simple-yet-efficient framework to address the above challenges and improve the model generalization ability by adversarially generating data different from global data distribution. Specifically, it performs adversarial generation on each client locally, aiming to generate novel-style images with similar semantics but different visual styles. To encourage the generation of images with novel styles beyond the global rather than merely local distribution, FedDAG shares generators from different clients. Besides, to tackle the challenges raised by medical scenarios, FedDAG generates images by performing instance-level adversarial learning, bypassing the challenges caused by ambiguous labels in the medical

Read the complete text