S-VOTE: Similarity-based Voting for Client Selection in Decentralized Federated Learning

Pedro Miguel Sánchez Sánchez 1,2,* , Enrique Tomás Martínez Beltrán 1 , Chao Feng 3 Gérôme Bovet 4 , Gregorio Martínez Pérez 1 , Alberto Huertas Celdrán 1,3 · 2025

Read S-VOTE: Similarity-based Voting for Client Selection in Decentralized Federated Learning by Pedro Miguel Sánchez Sánchez 1,2,* , Enrique Tomás Martínez Beltrán 1 , Chao Feng 3 Gérôme Bovet 4 , Gregorio Martínez Pérez 1 , Alberto Huertas Celdrán 1,3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19279.txt.

Introduction

Pedro Sanchez Sanchez and co-authors present a 2025 paper on training AI without a central server. In decentralized federated learning, devices train a shared model by passing updates peer to peer. No server means no single point of failure. The costs are uneven data across devices, heavy traffic, and wasted compute. Their method, called S-VOTE, picks which clients train by a similarity vote.

Voting favors clients whose data add the most to the group model. A flexible local plan lets idle clients join without a big cost jump. Wide tests on benchmark data check the gains. Edge AI teams get a way to spend compute where it counts. Hospitals, banks, and phone fleets all train under privacy rules that bar central data pools. Smarter client choice can lift model quality while keeping that privacy intact.

Catalog record

CREATORPedro Miguel Sánchez Sánchez 1,2,* , Enrique Tomás Martínez Beltrán 1 , Chao Feng 3 Gérôme Bovet 4 , Gregorio Martínez Pérez 1 , Alberto Huertas Celdrán 1,3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-19279

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

S-VOTE: Similarity-based Voting for Client Selection in Decentralized Federated Learning Pedro Miguel Sánchez Sánchez 1,2,* , Enrique Tomás Martínez Beltrán 1 , Chao Feng 3 Gérôme Bovet 4 , Gregorio Martínez Pérez 1 , Alberto Huertas Celdrán 1,3 Abstract Decentralized Federated Learning (DFL) enables collaborative, privacy-preserving model training without relying on a central server. This decentralized approach reduces bottlenecks and eliminates single points of failure, enhancing scalability and resilience. However, DFL also introduces challenges such as suboptimal models with non-IID data distributions, increased communication overhead, and resource usage. Thus, this work proposes S-VOTE, a voting-based client selection mechanism that optimizes resource usage and enhances model performance in federations with non-IID data conditions. S-VOTE considers an adaptive strategy for spontaneous local training that addresses participation imbalance, allowing underutilized clients to contribute without significantly increasing resource costs. Extensive experiments on benchmark datasets demonstrate the S-VOTE effectiveness. More in detail, it achieves lower communication costs by up to 21%, 4-6% faster convergence, and improves local performance by 9-17% compared to baseline methods in some configurations, all while achieving a 14-24% energy consumption reduction. These results highlight the potential of S-VOTE to address DFL challenges in heterogeneous environments. TABLE I: Comparison of Related Work with the Proposed Approach Work Year Approach Dataset Distribution Results [ 1 ] 2022 Expectation-maximization method for client utility evaluation and selection CIFAR10/100, Office-Home Non-IID Pathological \approx 10-15% improvement over baseline aggregations and local training [ 2 ] 2022 Computational network alignment to reduce resource overhead LIBSVM Database IID Faster model convergence and \approx 1-2% baseline improvement [ 3 ] 2024 Greedy algorithm-based personalized DFL CIFACR10, CINIC10, FEMNIST Non-IID Dir(0.1) and Pathological \approx 3-8% accuracy improvement over local training, baseline FedAvg and other literature methods [ 4 ] 2024 Sparse training with dynamic aggregation for efficient personalized DFL CIFAR10/100, HAM10000 Non-IID Dir (0.3, 0.5) and Pathological \approx 10% accuracy improvement over literature aggregation methods. x5 reduction on computation time [ 5 ] 2024 Neighbor selection based on coresets in DFL FEMNIST, CIFAR10/100 Non-IID Dir (0.1, 0.5) and Pathological \approx 5-10% improvement over other literature methods such as [ 1 ] This work 2025 Similarity and voting-based client selection with adaptive training MNIST, FashionMNIST, EMNIST, CIFAR10 Non-IID Dir(0.1, 0.5) 9-17% accuracy improvement, 11-21% reduction in communication costs, and 14-24% lower energy consumption I Introduction In an era of increasing data privacy concerns, traditional centralized machine learning approaches pose significant risks by requiring raw data to be collected and stored in centralized servers, making it vulnerable to breaches and misuse. In this context, Federated learning (FL) has emerged as a promising solution, enabling collaborative model training across distributed clients without sharing raw data [ 6 ] . However, most FL systems rely on a central server for coordination, which introduces bottlenecks, single points of failure, and trust issues [ 7 ] . Decentralized Federated Learning (DFL) addresses these limitations by adopting a peer-to-peer approach, eliminating the need for a central server [ 8 ] . By leveraging direct client communication, DFL reduces reliance on centralized infrastructures, enhancing resilience, scalability, and privacy. Despite its advantages, DFL introduces several challenges that hinder its efficiency. More in detail, the two main concerns studied in this paper are i) the impact of non-IID data, leading to biased or suboptimal global models [ 9 ] , and ii) the increased communication overhead and resource usage [ 10 ] . However, these are not the only ones since the absence of a central authority makes it harder to detect and isolate malicious clients manipulating updates to degrade performance or compromise privacy [ 11 ] . Therefore, addressing these issues is essential to improve resource efficiency, handle data heterogeneity, and ensure trust in decentralized systems. Several strategies have been proposed to mitigate the challenges posed by DFL. From the communication overhead perspective, techniques such as model quantization and distillation are commonly used to enable a more efficient exchange of information between clients [ 12 ] . From the non-IID data distribution angle, partial aggregation based on model similarity has also been explored. Among these approaches, client selection mechanisms have shown significant promise [ 13 ] . They allow clients to selectively participate in training rounds based on relevance, reducing resource usage and improving convergence. However, most solutions focus on client selection from the server perspective in centralized FL, selecting which clients should train in the next round. For DFL, client selection is particularly effective in non-IID scenarios, where these mechanisms enhance local adaptation while preserving the ability to generalize to unseen data classes [ 14 ] . Among these methods, voting-based training on most selected clients offers an extra on resource usage and performance optimization. Client selection in DFL presents several challenges related to performance optimization and resource efficiency. One key issue is the trade-off between communication overhead and model quality. While voting mechanisms can improve model convergence by focusing on relevant clients, the frequent exchange of updates and votes among neighbors increases resource consumption, particularly in large-scale networks. Additionally, achieving optimal client selection in highly non-IID settings remains challenging. Clients with rare or unique data distributions may be underrepresented, limiting the model ability to generalize effectively. Furthermore, there is a need to design voting strategies that balance resource usage and local model performance, ensuring efficient training without sacrificing accuracy or diversity. Addressing these challenges is essential to fully realize the potential of voting-based mechanisms in enhancing DFL [ 13 ] . To improve the previous challenges, this work introduces S-VOTE, a voting-based client selection mechanism to optimize resource usage and improve performance in non-IID scenarios. S-VOTE leverages model similarity for targeted aggregation, ensuring efficient collaboration among relevant clients while reducing unnecessary communication and energy consumption. Additionally, it incorporates an adaptive strategy for spontaneous local training in underutilized clients, addressing participation imbalance without compromising resource efficiency. S-VOTE has been validated through a pool of experiments, demonstrating enhanced convergence, reduced communication and energy overhead, and robust generalization to unseen data. In more detail, S-VOTE achieves up to 21% improvement in communication efficiency, 4-6% faster convergence, and 9-17% higher accuracy in some configurations compared to baseline methods, while also reducing energy consumption by 14-24%. The paper is organized as follows. Section II reviews related work on client selection in DFL. Section III details the proposed voting-based client selection mechanism. Section IV presents experimental results, comparing the approach with existing methods. Section IV-B discusses the results and limitations, while Section V concludes the paper and suggests future research directions. II Related Work This section reviews the literature in DFL and client selection strategies. It highlights existing methods for optimizing client participation in performance and resource usage, focusing on voting-based approaches. TABLE I summarizes and compares the main related work. Several works have reviewed the issue of client selection in FL [ 13 , 15 , 16 ] . Optimization-based approaches treat the selection process as an optimization task to find the optimal set of clients. However, these methods are slow and impractical in real deployments as they may lead to scalability problems in large scenarios. Importance-based methods prioritize clients according to their influence or relative performance increase. Techniques in this category can use metrics such as reputation or system computational capabilities, but

Read the complete text