Centralized vs Decentralized Federated Learning: A trade-off performance analysis

Chaimaa MEDJADJI, Guilain LEDUC, Sylvain KUBLER, Yves Le Traon · 2026

Read Centralized vs Decentralized Federated Learning: A trade-off performance analysis by Chaimaa MEDJADJI, Guilain LEDUC, Sylvain KUBLER, Yves Le Traon (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16089.txt.

Introduction

Medjadji and three colleagues run head-to-head tests of centralized, decentralized, and semi-decentralized federated learning. Federated learning trains models on edge devices with no raw data pooled in one place, which suits privacy and rule limits. Few past studies had tested all three layouts side by side. With the Fedstellar simulator, MNIST data, and a small perceptron classifier, they weigh what each layout does well, where it falls short, and what it trades away.

Catalog record

CREATORChaimaa MEDJADJI, Guilain LEDUC, Sylvain KUBLER, Yves Le Traon
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27409
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16089

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Centralized vs Decentralized Federated Learning: A trade-off performance analysis Chaimaa MEDJADJI, Guilain LEDUC, Sylvain KUBLER, Yves Le Traon Abstract Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed edge devices while preserving data privacy especially with the huge increase amount of data due to the adoption of technologies which contributes to the growing number of IoT devices. Storing this amount of data centrally is challenging due to issues like limited communication, privacy, and regulations. FL can be Centralized (CFL), Decentralized (DFL), and Semi-decentralized (SDFL). Choosing the right FL architecture depends on the application’s needs. However, very few research studies have experimentally compared these three types of architectures to not only understand the respective strengths and limitations, but also trade-offs between different performance indicators. This paper overcome this lack of analysis, conducting experimental analyses using the Fedstellar simulator, MNIST dataset, and MLP classifier. I Introduction The rise of emerging application scenarios, such as augmented and virtual reality, autonomous driving, and Digital Twin, has triggered a substantial surge in the number of Internet of Things (IoT) devices. The International Data Corporation (IDC) estimates that 55.7 billion IoT devices will be connected by 2025, generating almost 80B zettabytes (ZB) of data. This data explosion will contribute to a total global data storage exceeding 175 ZB. Artificial Intelligence (AI), particularly Machine Learning (ML), is well-positioned to the immense volumes of data anticipated in the coming years. However, data from a multitude of IoT devices are often stored in distributed architectures for diverse scenarios such as smart grids, remote health monitoring, or the Internet of Vehicles. Challenges such as limited communication resources, data privacy concerns, and country-specific regulations render the centralized collection of data impractical or inefficient, as traditionally practiced in ML. In 2016, Google emerged Federated Learning (FL) [ 13 ] as a solution to this challenge, enabling clients – referred to as participants or nodes of a federation – to collaboratively train models without the need to share raw training data. FL can be categorized into three types of architectures, namely: Centralized (CFL), Decentralized (DFL), and a combinaison of the two known as Semi-decentralized (SDFL). The choice of using one type of architecture or another is highly dependent on the application requirements and constraints. However, there are other aspects to take into consideration as well, such as how a given FL architecture impacts on the application performance. A recent survey [ 5 ] has emphasized the intricate nature of DFL and the multitude of Key Performance Indicators (KPIs) – over 40 – to be taken into account when evaluating (D)FL platforms. While research studies have focused on the architectural design of CFL, DFL and SDFL, very little research, if any, has focused on experimentally comparing these architectures. Understanding how CFL, DFL, and SDFL perform across various KPIs is crucial, as it can reveal potential trade-offs or synergies among them. This paper presents the initial experimental analyses in this context. Section II provides the necessary background about CFL, DFL and SDFL. Section III gives insight into the methodology underlying our experimental analyses. Section IV presents the results of our experiments conducted with the Fedstellar simulator, MNIST dataset, and MLP classifier MNIST data. The conclusion is provided in section V . II Related works Section II-A provides a comprehensive overview of various FL architectures, including CFL, DFL, and SDFL. In Section II-B , the discussion delves into the expanding body of literature regarding DFL and SDFL, along with investigations that compare these architectures with CFL. \psset xunit=1mm,yunit=1mm,runit=1mm {pspicture} (0,0)(35,27) (a) Centralized FL \psset xunit=1mm,yunit=1mm,runit=1mm {pspicture} (0,0)(45,27) (b) Decentralized FL \psset xunit=1mm,yunit=1mm,runit=1mm {pspicture} (0,0)(30,27) (c) Semi-Decentralized FL Fig. 1: Federated Learning Architectures II-A Federated Learning (FL) architecture types FL is a ML setting to synthesize global models from local models trained on the edge. FL was first developed by Google in 2016 [ 13 ] for their Gboard application, to learn new words and phrases. FL is a decentralized training approach where an iterative process computes model training updates at the edge, aggregating these updates to produce the global update to be applied to the model. This core concept of aggregating model updates was key in allowing for a single global model to be produced from edge training. To build this global model, an aggregation mechanism is implemented to merge in a consistent manner the set of local models produced at some iteration. The most well-known aggregation algorithm, popular for its simplicity and efficiency, is called federated averaging (FedAvg). FedAvg computes the parameter-wise arithmetic mean across the local models. Currently, most of the FL applications rely on a CFL architecture, as illustrated in Fig. 1(a) . CFL has gained a significant attention from academia and industry [ 16 ] . Lim et al. [ 17 ] mentioned that researchers mainly focused on CFL applications in mobile networks across various end-user scenarios : the application of FL in broader contexts involving heterogeneous IoT devices ( [ 18 ] ), security and privacy concerns ( [ 19 ] ), proposition of secure protocols between servers and participants ( [ 20 ] ). Furthermore, other studies, such as [ 22 ] , explored the applicability of CFL in specific medical scenarios, emphasizing privacy-preserving mechanisms for sensitive data. Witt et al. [ 23 ] detailed commonly used frameworks in CFL applications. CFL offers certain conveniences, but also comes with its own set of disadvantages. Li et al. [ 1 ] highlight the main challenges faced by CFL caused mainly by the server as third trust party and single point of failure. These challenges include the increase of data transmissions, especially when dealing with multiple participating nodes. Li et al. [ 1 ] also point out the problem of reliance on a central server that can introduce communication bottlenecks and increased network traffic when faced with a large number of participants, leading to higher latency and reduced efficiency [ 2 ] . As another problem of CFL, the security of the application can be impacted if the central server is maliciously compromised [ 3 ] . To overcome the above-mentioned limitations, DFL was introduced in 2018 by Lalitha et al. [ 4 ] . DFL is based on the decentralized aggregation of model parameters among neighboring participants, eliminating the necessity for a central server, as depicted in Fig. 1(b) . It ensures collaborative learning by leveraging local computation and exchanging model parameters between nodes. Its operation revolves around swiftly transmitting updates computed locally by each node to the broader network. These local transmissions enable adjacent nodes to enhance their models, culminating in the creation of a more intelligent and privacy-preserving collaborative model. In contrast to the previous approaches of FL, the SDFL architecture [ 30 ] is a hybrid of both architectures CFL and DFL, as illustrated in Fig. 1(c) . It maintain the aggregator role which rotates randomly among participants at each round of the learning process. II-B CFL vs. DFL: current state of affairs In contrast to CFL, DFL and SDFL were first employed to prevent communication bottleneck situations, which can quickly occur in CFL and result in performance issues [ 29 ] . As of today, most research on DFL and SDFL

Read the complete text