Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning

Zhongwei Wang, Tong Wu, Zhiyong Chen, Liang Qian, Yin Xu, Meixia Tao · 2025

Read Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning by Zhongwei Wang, Tong Wu, Zhiyong Chen, Liang Qian, Yin Xu, Meixia Tao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02219.txt.

Introduction

Zhongwei Wang and five co-authors synthesize data to help federated learning in a 2025 paper. Federated semi supervised learning trains across clients holding mostly unlabeled data. Each client's data also skew toward different classes. Their fix generates the missing pieces with a diffusion model.

A federated classifier first pseudo labels the unlabeled local data. Carefully filtered pseudo labels join real ones to train the diffusion model together. Clients then generate samples for classes they lack. The synthetic sets pull local distributions toward the global one. On a standard image benchmark with ten percent labels, accuracy jumped from about thirty eight to fifty two percent. Varied skew settings showed the same benefit. Shared generation, not shared data, bridges the clients' gaps.

Catalog record

CREATORZhongwei Wang, Tong Wu, Zhiyong Chen, Liang Qian, Yin Xu, Meixia Tao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-02219

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning Zhongwei Wang, Tong Wu, Zhiyong Chen, Liang Qian, Yin Xu, Meixia Tao Abstract Federated semi-supervised learning (FSSL) is primarily challenged by two factors: the scarcity of labeled data across clients and the non-independent and identically distribution (non-IID) nature of data among clients. In this paper, we propose a novel approach, diffusion model-based data synthesis aided FSSL (DDSA-FSSL), which utilizes a diffusion model (DM) to generate synthetic data, bridging the gap between heterogeneous local data distributions and the global data distribution. In DDSA-FSSL, clients address the challenge of the scarcity of labeled data by employing a federated learning-trained classifier to perform pseudo labeling for unlabeled data. The DM is then collaboratively trained using both labeled and precision-optimized pseudo-labeled data, enabling clients to generate synthetic samples for classes that are absent in their labeled datasets. This process allows clients to generate more comprehensive synthetic datasets aligned with the global distribution. Extensive experiments conducted on multiple datasets and varying non-IID distributions demonstrate the effectiveness of DDSA-FSSL, e.g., it improves accuracy from 38.46% to 52.14% on CIFAR-10 datasets with 10% labeled data. I Introduction Federated Learning (FL) allows multiple clients to collaboratively train machine learning models without the need to share raw data directly. It not only protects data privacy but also enhances the utilization of diverse and distributed data resources across different locations, thereby emerging as a pivotal technology for edge artificial intelligence applications [ 1 ] . The main challenge in FL is the substantial heterogeneity in data distribution across clients, commonly referred to as non-independent and identically distributed (non-IID) data [ 2 ] . This disparity can cause divergence between the global and local models, known as client drift [ 3 ] . Additionally, the scarcity of labeled data presents another obstacle, as obtaining large amounts of labeled data is often time-consuming and expensive in many domains, whereas unlabeled data is typically more readily available [ 4 ] . To address these challenges, researchers have turned to Federated Semi-Supervised Learning (FSSL). FSSL combines the advantages of semi-supervised learning, which can leverage unlabeled data, with the collaborative framework of FL. SemiFed [ 4 ] incorporates consistency regularization and pseudo-labeling techniques, utilizing consensus among multiple client models to generate high-quality pseudo-labels, showing effectiveness in heterogeneous data distribution. FedMatch [ 5 ] explores two scenarios: labels-at-client and labels-at-server, by introducing inter-client consistency loss and parameter decomposition, outperforming simple combinations of FL and semi-supervised learning in both cases. FedDure [ 6 ] presents an FSSL framework with dual regulators to manage non-IID data across and within clients. Another approach is to use deep learning-based data augmentation techniques to aided FL. The synthetic data aided FL (SDA-FL) [ 7 ] framework shares synthetic data generated by locally pre-trained generative adversarial networks (GANs), utilizing an iterative pseudo labeling mechanism to improve consistency across local updates and enhance global aggregation performance in both supervised and semi-supervised cases. In [ 8 ] , a global generator is collaboratively trained within the FL framework to produce synthetic data. FedDISC [ 9 ] introduces pre-trained diffusion models (DMs) [ 10 ] into FL, utilizing prototypes and domain-specific representations to generate high-quality synthetic datasets. FSSL and SDA-FL offer distinct approaches to addressing the challenges of heterogeneous data distribution and limited labeled data, providing valuable insights from two different perspectives. However, directly combining FSSL with SDA-FL poses new challenges. Existing SDA-FL methods often rely on pre-trained large generative models [ 9 ] , which may not be suitable due to potential domain mismatches between the pre-trained models and the specific tasks. Additionally, training generative models capable of producing high-quality data [ 8 ] in FSSL is particularly difficult because of the scarcity of labeled data for model training and validation. Motivated by the observation, we propose a novel approach called Diffusion Model-based Data Synthesis Aided Federated Semi-Supervised Learning (DDSA-FSSL) to address the challenges in FL. Specifically, to overcome the challenge of data scarcity, a global classifier is employed for pseudo-labeling amounts of unlabeled data, and a precision-driven optimization process is applied to refine these pseudo-labeled samples, enhancing their quality and reliability. Instead of using pre-trained generative models, a global DM is collaboratively trained using both the labeled data and optimized pseudo-labeled data, thus avoiding domain mismatch issues. The DM enables clients to generate synthetic data for absent classes in their local datasets, effectively addressing the challenge of heterogeneous data distribution. Experimental results show that DDSA-FSSL significantly enhances classification accuracy compared to existing methods. For example, with 10% labeled CIFAR-10 data under dual heterogeneity, it raises accuracy from 38.46% to 47.72% using 10% synthetic data, and to 53.01% with 90% synthetic data. Fig. 1: Overview of the proposed DDSA-FSSL. In the first step, each client performs federated training of a global classifier using labeled data. In the second step, the global classifier performs pseudo-labeling for the unlabeled data at each client, followed by a precision-driven optimization process guided by the global confusion matrix \mathcal{M}_{g}^{t} to refine and select high-quality pseudo-labeled samples. In the third step, clients collaboratively train the DMs using both the labeled and optimized pseudo-labeled data. In the fourth step, the DMs are employed by clients to generate specific synthetic data, based on discrepancies between local and global data distributions. Finally, clients conduct federated training of the classifier using both labeled and synthetic data. II System Model We consider a FSSL scenario with heterogeneous data distributions, specifically focusing on the labels-at-clients setting [ 5 ] . As shown in Fig. 1 , the system consists of K clients, each with their own local data, and one base station (BS) with a central server that coordinates the FL process without having direct access to the client’s data. FL seeks to train a global classifier by coordinating these clients, each of which trains a local model using its own data. The central server then applies a federated aggregation algorithm to obtain the global parameters \theta_{g} . For FSSL, each client’s dataset consists of a labeled subset D_{k}^{l}=\{x_{k,i}^{l},y_{k,i}\}_{i=1}^{|D_{k}^{l}|}=\bigcup_{c=1}^{C}(D_{k,c}^{l}) and an unlabeled subset D_{k}^{u}=\{x_{k,i}^{u}\}_{i=1}^{|D_{k}^{u}|}=\bigcup_{c=1}^{C}(D_{k,c}^{u}) , where x_{k,i}^{l} represents a labeled sample from client k , y_{k,i} is its corresponding label, and C denotes the total number of classes. In real-world applications, the assumption that all data is fully annotated is unrealistic due to the significant effort and cost associated with data labeling [ 5 ] . Consequently, the ratio of labeled data, denoted as \lambda=|D_{k}^{l}|/\left(|D_{k}^{l}|+|D_{k}^{u}|\right) , is typically small. In heterogeneous data distribution scenarios, both the labeled and unlabeled datasets on each client may only contain samples from a subset of classes, with few or no samples from other classes. Moreover, the distributions of labeled and unlabeled data across different clients are also heterogeneous [ 6 ] . This scarcity of labels and the heterogeneity of data distributions [ 11 , 6 ] can result in significant performance degradation in FL. To address this challenge, we consider that each client is equipped with a local conditional latent diffusion model (c-LDM). Unlike existing methods that rely on unsupervised GANs [ 7 ] , which cannot generate samples for specific classes, c-LDM not only allows precise control over the synthesis of data for targeted classes, but also provides more stable

Read the complete text