Enhancing Federated Quadruplet Learning: Stochastic Client Selection and Embedding Stability Analysis

Özgü Göksu, Nicolas Pugeault · 2026

Read Enhancing Federated Quadruplet Learning: Stochastic Client Selection and Embedding Stability Analysis by Özgü Göksu, Nicolas Pugeault (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07888.txt.

Introduction

Ozgu Goksu and Nicolas Pugeault improve federated metric learning, where many clients train a shared embedding model without pooling their data. Mixed, uneven client data skews the learned embeddings during merging and drags down its reach. Their method, FedQuad, is built on quadruplet losses that pull same-class examples together and push different-class examples apart.

A random client selection scheme and an analysis of embedding stability come with the loss design. On CIFAR-10, CIFAR-100, and Tiny-ImageNet under varied non-identical data settings and client counts, FedQuad steadily beat existing baselines. The authors also compare metric learning approaches in central and federated settings more broadly, showing how they counter representation collapse when client data spreads diverge.

Catalog record

CREATORÖzgü Göksu, Nicolas Pugeault
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07888

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Federated Quadruplet Learning: Stochastic Client Selection and Embedding Stability Analysis Özgü Göksu, Nicolas Pugeault Abstract Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across clients, particularly under limited data availability and class imbalance. To address this challenge, we propose FedQuad, a novel method that explicitly enforces minimising intra-class representations while enabling inter-class splits across clients. By jointly minimising distances between positive pairs and maximising distances between negative pairs, the proposed approach mitigates representation misalignment introduced during model aggregation. We evaluate our method on CIFAR-10, CIFAR-100, and Tiny-ImageNet under diverse non-IID settings and varying numbers of clients, demonstrating consistent improvements over existing baselines. Additionally, we provide a comprehensive analysis of metric learning-based approaches in both centralised and federated environments, highlighting their effectiveness in alleviating representation collapse under heterogeneous data distributions. Keywords: Federated Learning, Quadruplets, Representation Learning, Metric learning, Stochastic Client Selection. 1 Introduction As neural network architectures continue to grow in depth and complexity, their training increasingly relies on large-scale and diverse datasets. While deep models achieve remarkable performance on benchmarks such as ImageNet [ 2 ] , and LAION [ 1 ] , such data is usually inaccessible in practice (a large number of samples causes huge memory space). In many real-world scenarios, data is inherently distributed across multiple entities, including academic institutions, research laboratories, and private organisations. Class A Class B Existing Methods Proposed Method Class D Class C Class D Class C Class A Class B Class F Class E Class F Class E Data Label A B C D E F Client1 Client2 Client3 Figure 1 : The Representational Collapse Problem in Federated Learning. Under extreme data heterogeneity (e.g., Client 1: \{a,b\} , Client 2: \{c,d\} , Client 3: \{e,f\} ), local models optimise feature spaces without knowledge of global class boundaries. While local embeddings remain well-separated, the absence of shared negative samples results in conflicting coordinate systems. Upon model aggregation, these discrepancies cause the global embedding space to collapse, destroying inter-class division and discriminative structure. Data decentralisation presents a significant challenge for the deployment and scalability of deep learning models, as raw data cannot always be centralised due to accessibility, privacy, or regulatory constraints. Privacy concerns are particularly sensitive, as many organisations are hesitant to share local datasets, or storing in one server, for confidentiality reasons. To address these issues, Federated Learning (FL) has emerged as a promising paradigm, enabling collaborative model training without exposing sensitive raw data [ 3 , 4 ] . The pioneering FedAvg algorithm [ 5 ] operates by maintaining local datasets on clients while transmitting only model updates to a central server. This approach preserves data in clients server while allowing collaborative learning across distributed nodes. FL has proven essential for high-impact applications, including medical imaging, remote sensing, and large-scale image classification, where both accessibility and decentralisation are critical, [ 6 ] , [ 7 ] . Statistical heterogeneity of local client data remains a key challenge in federated learning. In practice, client datasets are rarely identically distributed (non-IID), exhibiting variations in class proportions, sample sizes, and feature distributions. Such heterogeneity complicates the training of a global model that generalises effectively across all clients. Therefore, the performance of FL algorithms can degrade substantially under limited local data or severe class imbalance, both of which are common in real-world scenarios. A major consequence of this heterogeneity is representational collapse , where the feature space loses discriminative capacity, and embeddings from different classes or clients become indistinguishable. As illustrated in Figure 1 , divergent local training leads to inconsistent feature representations across clients. Aggregation of these misaligned representations at the central server can cause the global model to collapse, resulting in overlapping or trivial embeddings that impair generalisation and weaken representational robustness. Several approaches have been proposed to mitigate data heterogeneity during local training in federated learning [ 8 ] , [ 9 ] , [ 10 ] . FedProx [ 11 ] augments the local objective with a proximal term that penalises deviations between local and global model parameters, ensuring smoother and more stable updates. SCAFFOLD [ 12 ] addresses client drift by introducing control variates to correct gradient dissimilarities across clients. These methods highlight that incorporating global model knowledge can improve the robustness of local representations. Beyond regularisation-based techniques, contrastive learning has emerged as a powerful strategy for leveraging global knowledge in FL [ 13 ] . MOON [ 14 ] mitigates data heterogeneity by maximising agreement between local and global model embeddings, showing how global knowledge enhances local robustness. Similarly, FedRCL [ 15 ] enforces inter-class variance in the feature space, ensuring that data points of the same class remain well-clustered. This separation preserves representational diversity, enabling more effective learning and improved generalisation. While aligning local and global representations is critical for effective federated learning, overly aggressive alignment can lead to representational collapse, where intra-class diversity within client models is reduced. This collapse undermines the model’s ability to capture subtle variations within the same class, ultimately degrading both local and global performance. Addressing this issue requires a careful balance between intra-class minimal variance and maximum inter-class variance, ensuring that learned representations remain both discriminative and diverse across clients. This motivates the following key question: “How can we preserve both intra-class and inter-class relationships to prevent representational collapse in global and local models under heterogeneous data?” We propose FedQuad 1 1 1 This article is an extended version of our conference paper published at FLTA 2025 [ 39 ] , with additional experiments, non-IID analyses, and ablation studies. , a metric learning-based federated learning approach designed to mitigate representational collapse under heterogeneous data. Unlike conventional contrastive or triplet-based methods [ 18 , 19 ] , FedQuad explicitly models relative distances between samples using stochastic quadruplets, consisting of an anchor, a positive (same class), a negative (different class), and a harder negative (also from a different class). The proposed loss simultaneously minimises the distance between the anchor and positive while maximising distances to both negatives. This encourages a feature space where intra-class samples are tightly clustered, and inter-class samples remain well-separated. By preserving both intra-class diversity and inter-class discriminability, FedQuad generates robust representations that are resilient to aggregation-induced degradation, directly addressing the core challenges of representational collapse in federated learning. To summarise, our major contributions are as follows: • We propose a novel metric learning-based federated learning framework to address representational collapse under heterogeneous client data. • We analyse the impact of intra-class and inter-class variance, highlighting their roles in preserving discriminative representations across clients. • We introduce a quadruplet-based loss function that effectively mitigates representational collapse in both local and global models. • We design an offline stochastic quadruplet sampling strategy per client, tailored for imbalanced and non-IID data distributions, ensuring robust and diverse training. • We demonstrate the effectiveness of our method under scenarios with a large number of clients, using random client selection and minimal participation per round. Traditional quadruplet loss [ 20 ] primarily minimises the distance between the anchor and positive sample, providing only a weak push against negative samples. Typically, it enforces a margin for

Read the complete text