FedGMI: Generative Model-Driven Federated Learning for Probabilistic Mixture Inference
Qijun Hou 2 , Yuchen Shi 2 , Pingyi Fan 1 2 , and Khaled B. Letaief 4 · 2026
Read FedGMI: Generative Model-Driven Federated Learning for Probabilistic Mixture Inference by Qijun Hou 2 , Yuchen Shi 2 , Pingyi Fan 1 2 , and Khaled B. Letaief 4 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08760.txt.
Introduction
Qijun Hou, Yuchen Shi, Pingyi Fan, and Khaled Letaief work on joint training where clients keep their data at home. Each client's data is a mix of a few shared hidden types. Grouping like clients helps, but groups still hold mixed types inside. Full custom fits for each client waste what clients share. Their FedGMI plan usesVAE style models to learn the shared types. It then works out each client's mix.
The plan gives custom fits with joint gains kept. Tests show it finds the hidden types cleanly. It also finds each mix with care. It holds up when the talk budget is tight. Joint training gains a sound mid path, between one fit for all and one fit per client.
Catalog record
| CREATOR | Qijun Hou 2 , Yuchen Shi 2 , Pingyi Fan 1 2 , and Khaled B. Letaief 4 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08760
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FedGMI: Generative Model-Driven Federated Learning for Probabilistic Mixture Inference 1 Pingyi Fan is the corresponding author, e-mail: [email protected]. This work was supported by the National Key Research and Development Program of China (Grant NO.2021YFA1000500(4)). 4 Khaled B. Letaief was supported in part by Hong Kong Research Grants Council under the Areas of Excellence scheme grant AoE/E-601/22-R. Qijun Hou 2 , Yuchen Shi 2 , Pingyi Fan 1 2 , and Khaled B. Letaief 4 Abstract Federated Learning (FL) facilitates collaborative model training across decentralized clients while preserving data privacy by avoiding raw data exchange. Despite its potential, FL performance is often compromised by data heterogeneity across clients. To address this, Clustered Federated Learning (CFL) groups clients with similar data distributions to improve model performance, but constrained by intra-cluster heterogeneity. Conversely, Personalized Federated Learning (PFL) tailors models to individual clients, but usually neglects the underlying structural similarities among clients. In this work, we investigate a probabilistic mixture (PM) scenario, where each client’s local data distribution is modeled as a convex combination of several shared inherent distributions. To effectively model this structure, we propose FedGMI, a framework that utilizes Variational Autoencoders (VAEs) as generative density estimators to represent these inherent distributions and infer the mixture components of clients’ local data distributions. This approach enables structured personalization without sacrificing the benefits of collaborative learning. Extensive experiments demonstrate that FedGMI effectively characterizes and discriminate the inherent distributions, as well as accurately estimates mixture proportions. Furthermore, FedGMI maintains robust performance even under communication cost constraints. † † impactstatement: Federated Learning (FL) enables collaborative training across clients, preserving data privacy. However, heterogeneous data distributions influence the model performance significantly. Existing methods, such as Clustered FL and Personalized FL, struggle with intra-cluster variability and fail to capture client similarities. FedGMI introduces a generative model-driven approach using Variational Autoencoders (VAEs) to represent inherent data distributions and estimate client-specific mixtures. This enables structured personalization while leveraging collaborative learning. FedGMI’s effectiveness under low communication costs enhances scalability and deployability on resource-constrained edge devices. Applications span healthcare (diverse patient data across hospitals), smart devices (personalized user patterns), and finance (regional fraud detection and prevention). I Introduction Federated Learning (FL) is an emerging machine learning paradigm that facilitates collaborative intelligence across decentralized data sources while preserving data privacy and security. Unlike traditional machine learning approaches, which aggregate data in a centralized server, FL enables clients (mobile devices, edge servers, etc.) to collaboratively optimize a shared model without exposing their local data. Since FedAvg [ 9 ] provided a functional framework of model aggregation, FL has garnered substantial attention. The rise of edge computing and the growing concerns about data privacy have further accelerated the adoption of FL in real-world scenarios. Despite its potential, the practical use of FL is often limited by data heterogeneity, as the data distributions across clients are typically non-independent and identically distributed (non-IID). Non-IID data can lead to issues such as biased model updates, diminished generalization, and slower convergence. A single global model not only suffers from performance degradation in the presence of non-IID data, but also fails to capture the underlying structural relationships among clients. To address this, Clustered-FL (CFL) [ 13 ] [ 4 ] clusters homogeneous clients based on their data distributions and trains models for each cluster to make training more stable. Personalized-FL (PFL) [ 3 ] focuses on fine-tuning models for each individual client. However, there is a clear trade-off: While CFL focuses on common properties across clients within the same cluster, it may overlook the unique characteristics and preferences of individual clients within a cluster. Conversely, PFL focuses on single clients but often neglects the structural similarities or homogeneity across clients. In essence, Clustering and Personalization represent two complementary perspectives on modeling the relationships among client distributions: the former exploits similarities, while the latter preserves individual differences. PFL can build on clustering to tailor models for client-specific model adaptation. A growing body of work further blurs the distinction between these two paradigms, leveraging probabilistic models to more precisely measure the relationships among client distributions. Studies suggest that real-world data is likely to follow a mixture paradigm, where each client’s local distribution is a combination of several shared inherent distributions [ 8 ] [ 2 ] [ 12 ] [ 19 ] . We refer to this data composition scenario as Probabilistic Mixture ( PM ), formally defined as Assumption. 1 . A clear example can be found in federated image classification on handwritten digits (e.g., MNIST). The underlying inherent distributions could be distinct fundamental writing styles, such as ’slanted’, ’neat’, or ’broad’. The local data of a single client could be a mixture of these styles. Our work aims to leverage this mixture property to integrate the strengths of CFL and PFL. Through learning these shared inherent distributions and estimating each client’s specific mixture proportions, we provides insights into both the structural similarities and the unique characteristics of each client. Conventional approaches for measuring inter-client similarity rely on fit the distributions of their data (original data or features) to parametric models (e.g., Gaussian , Bernoulli ). However, explicitly modeling complex, high-dimensional modalities, such as images, remains intractable and limits the applicability of these approaches. To address this, generative models, such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs), have gained considerable attention in FL due to their capacity to represent complex data distributions. By leveraging their ability to estimate probability density and distribution divergence (e.g., KL-divergence ), generative models provide a more flexible way to analyze client data relationships. In this paper, we propose FedGMI, a mixture-aware Federated Learning (FL) framework designed to enhance model performance by identifying and adapting to the underlying data structures in the PM situation. FedGMI utilizes VAEs to represent heterogeneous data distributions and employs a modified Maximum A Posteriori (MAP) criterion to partition local data samples. Unlike standard FL, FedGMI jointly optimizes: ( i ) VAE-based generative models representing inherent distributions, ( ii ) Distribution-Expert Classifiers (e.g., CNNs) for each inherent distribution, and ( iii ) estimation of each client’s mixture proportions. FedGMI is tested on multiple common datasets. The results validate that FedGMI effectively learns distinctive inherent distributions and estimates the mixture structure of client data distributions. The remainder of this paper is organized as follows: Section II provides a review of related works on generative models in Federated Learning, with emphasis on probabilistic mixture approaches. In Section III , we present our proposed method, FedGMI, along with its corresponding algorithm, which leverages Variational Autoencoders (VAEs) to partition local data. Section IV provides the theoretical foundation by establishing the convergence properties of our method. In Section V , we conduct experiments on the benchmark datasets to assess the effectiveness and performance of our approach. The paper concludes with a summary of findings and potential directions for future research. II Related Work Since the concept of FedAvg was proposed in [ 9 ] , FL has been studied as a framework of collaborative learning with privacy protection. Extensive research has focused on the performance degradation of FL caused by data heterogeneity [ 6 ] [ 17 ] . While most FL frameworks are designed to be task-agnostic, their efficacy is typically demonstrated on supervised learning tasks,