Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learning

Yanbiao Ma, Wei Dai, Wenke Huang, Jiayi Chen · 2025

Read Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learning by Yanbiao Ma, Wei Dai, Wenke Huang, Jiayi Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06457.txt.

Introduction

Yanbiao Ma and co-authors tackle uneven data in federated learning in a 2025 paper. In this setup, many sites train one shared model without pooling their raw data, to guard privacy. When each site's data differ in labels or style, local training pulls in unlike directions and the shared model suffers.

Their method, called GGEUR, sums up the shape of the whole data cloud without exposing raw records. Each site then makes new samples that match that global shape, so local data look more like the whole. For data drawn from many domains, class centers help mimic the global spread. Wide tests showed clear gains over older methods when label gaps, domain gaps, or both were strong.

Catalog record

CREATORYanbiao Ma, Wei Dai, Wenke Huang, Jiayi Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-06457

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Geometric Knowledge-Guided Localized Global Distribution Alignment for Federated Learning Yanbiao Ma, Wei Dai, Wenke Huang, Jiayi Chen Abstract Data heterogeneity in federated learning, characterized by a significant misalignment between local and global distributions, leads to divergent local optimization directions and hinders global model training. Existing studies mainly focus on optimizing local updates or global aggregation, but these indirect approaches demonstrate instability when handling highly heterogeneous data distributions, especially in scenarios where label skew and domain skew coexist. To address this, we propose a geometry-guided data generation method that centers on simulating the global embedding distribution locally. We first introduce the concept of the geometric shape of an embedding distribution and then address the challenge of obtaining global geometric shapes under privacy constraints. Subsequently, we propose GGEUR, which leverages global geometric shapes to guide the generation of new samples, enabling a closer approximation to the ideal global distribution. In single-domain scenarios, we augment samples based on global geometric shapes to enhance model generalization; in multi-domain scenarios, we further employ class prototypes to simulate the global distribution across domains. Extensive experimental results demonstrate that our method significantly enhances the performance of existing approaches in handling highly heterogeneous data, including scenarios with label skew, domain skew, and their coexistence. Code published at: https://github.com/WeiDai-David/2025CVPR_GGEUR 1 Introduction Figure 1 : The distribution of local data on clients is imbalanced. The “bird” category has a large number of samples, allowing its local distribution to effectively represent the global distribution. In contrast, the “truck” category has insufficient samples, resulting in a significant disparity between the local and global distributions. Federated Learning (FL) enables multiple clients to collaboratively train a global model without sharing raw data, effectively addressing key concerns related to data privacy and security [ 19 , 53 , 13 ] . However, data heterogeneity remains one of the primary challenges in FL, especially in the presence of label skew and domain skew across clients [ 12 , 15 , 17 , 28 , 29 ] . Such distributional differences lead to variations in the local optimization directions for each client, which can be particularly pronounced when data is sourced from multiple domains [ 5 , 33 , 59 , 66 , 42 ] . This cross-client distribution shift not only slows down global model convergence but also undermines the model’s generalization capability across clients [ 13 , 5 , 62 , 30 ] . Existing research addressing data heterogeneity in federated learning primarily focuses on two categories of methods [ 13 ] . The first is server-side optimization strategies, which aim to enhance model convergence by adjusting the global aggregation process [ 57 , 2 , 52 , 61 , 54 , 3 , 32 , 44 , 11 , 64 ] . The second category includes client-side regularization [ 42 , 12 , 1 , 7 , 23 , 22 ] and data augmentation methods [ 67 , 68 ] , which attempt to align local model optimization through guidance from the global model and loss function adjustments or directly apply data augmentation techniques like Mixup in the local setting [ 63 ] . However, these approaches do not directly tackle the core issue of data heterogeneity, namely, the significant misalignment between local data distributions on clients and the global data distribution. They often rely on indirect means to optimize the alignment between local and global models, which typically incurs high computational costs and depends heavily on the selection of auxiliary datasets, resulting in limited stability [ 13 ] . Motivated by these challenges, we propose a core idea: if clients can locally simulate an ideal global distribution, it may be possible to alleviate the divergence in local optimization directions, even without data sharing. In other words, through guided data augmentation, we can reduce the inconsistency between local and global distributions, fundamentally mitigating data heterogeneity issues in federated learning. How can we simulate a global distribution locally? Taking CIFAR-10 as an example, Figure 1 illustrates the label distribution in a random client, revealing severe imbalances. Certain categories, such as “truck,” are underrepresented, making it difficult to form an effective global representation. Given privacy constraints, simulating a global distribution locally becomes a significant challenge [ 13 ] . As shown in the blue distribution in Figure 1 , augmenting samples along the blue arrow direction, rather than the pink arrow, is more likely to simulate the global distribution. Thus, identifying appropriate augmentation directions and ranges becomes our key objective to overcome this challenge. Figure 2 : Example of “bird” category: in a single-domain scenario, only the local global distribution is simulated; in a multi-domain scenario, the global distribution from other data domains is also simulated on a client. In the single-domain scenario, some clients may possess a large number of “truck” images, while others have only a few. The aggregate set of “truck” images across all clients constitutes the global distribution for that category. We introduce the concept of geometric shapes to describe the orientation and range of data distributions (see Section 2 ). For instance, the global distribution of “truck” in Figure 1 spans primarily from the bottom left to the top right. If we could quantify the global geometric shape of the ”truck” and disseminate it to clients, they could use it to guide new sample generation locally. However, privacy constraints prohibit us from aggregating all client samples to quantify this global geometric shape. To address this, we propose using local covariance matrices from multiple clients on the server side to approximate the global covariance matrix, enabling quantification of the global geometric shape (see Section 3.1 ). To mitigate inaccuracies in local covariance matrix estimation due to high dimensionality and sparsity in image space [ 36 ] , we employ the CLIP [ 47 ] to extract embedding distributions from local client data and carry out the approximation process in the embedding space. After obtaining the global geometric shape for each category, we propose a method called Global Geometry-Guided Embedding Uncertainty Representation ( GGEUR ) to generate new samples on clients, simulating an ideal global distribution in the embedding space. Each client then only needs to train an MLP as a local classifier on the augmented data. In multi-domain scenarios, we observe that the geometric shapes of the embedding distributions for the same category across different domains exhibit similarity (see Figure 6 and Section 3.2 ). This makes it feasible to approximate the global geometric shape using local geometric shapes across all clients, even in multi-domain settings. In multi-domain scenarios, however, the global distribution for each category comprises distributions from all domains, necessitating that clients also simulate embeddings from other domains. Although the embedding distributions of the same category across different domains are geometrically similar, they occupy different spatial positions. Thus, unlike the single-domain scenario, we propose distributing category prototypes from other domains as shared knowledge to clients and applying GGEUR to these prototypes to generate new samples that simulate distributions from other domains (see Section 3.2 ). Figure 2 illustrates the difference between single-domain and multi-domain scenarios. Our approach, serving as a preprocessing step in FL, is easily integrated with other methods. Extensive evaluation across scenarios with label skew, domain skew, and

Read the complete text