On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3817925 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Neural networks CCS: Computing methodologies Regularization CCS: Computing methodologies Massively parallel algorithms CCS: Computing methodologies Self-organization CCS: Computing methodologies Mobile agents

Jiahui Bai, Hai Dong, A. K. Qin · 2026

Read On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3817925 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Neural networks CCS: Computing methodologies Regularization CCS: Computing methodologies Massively parallel algorithms CCS: Computing methodologies Self-organization CCS: Computing methodologies Mobile agents by Jiahui Bai, Hai Dong, A. K. Qin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26162.txt.

Introduction

Jiahui Bai, Hai Dong, and Qin propose PushCen-ADFL (2026), a decentralized federated learning scheme in which devices train together without central coordination. Clients swap compact centroid messages. They use push-sum mixing that preserves averages to cancel aggregation bias. They anchor local updates with centroid regularization to fight drift from skewed data and stale arrivals. On vision tasks, the scheme lifts accuracy under data heterogeneity by up to six percent while cutting per-push cost by more than eighty percent.

Catalog record

CREATORJiahui Bai, Hai Dong, A. K. Qin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117815
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.26162

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3817925 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Neural networks CCS: Computing methodologies Regularization CCS: Computing methodologies Massively parallel algorithms CCS: Computing methodologies Self-organization CCS: Computing methodologies Mobile agents Jiahui Bai, Hai Dong, A. K. Qin Abstract . Asynchronous decentralized federated learning (ADFL) eliminates central coordination and global synchronization, making it attractive for large-scale and heterogeneous systems. However, frequent peer-to-peer communication, asynchronous updates on directed topologies, and non-IID data jointly lead to excessive communication overhead, biased aggregation and severe model drift. We propose PushCen-ADFL, a communication-efficient ADFL framework that enables stable training under asymmetric communication and delayed client participation. PushCen-ADFL couples communication, aggregation, and local stabilization in a shared centroid representation space, forming a closed loop between compression and optimization. Clients exchange centroid-form messages, apply average-preserving push-sum mixing to correct aggregation bias, and use a lightweight centroid regularization anchored in the same centroid space to mitigate drift under heterogeneity and staleness. A bounded, sender-deduplicated buffer further improves robustness under irregular asynchronous arrivals. Experiments on vision datasets demonstrate that PushCen-ADFL improves accuracy under data heterogeneity by up to 6% while reducing per-push communication cost by more than 80%, achieving a favorable accuracy-communication trade-off. † † cc-license: by 1. Introduction Federated Learning (FL) has emerged as a privacy-preserving distributed machine learning paradigm that enables collaborative model training when data cannot be centrally shared ( 31 ; 21 ; 32 ) . By performing training on local devices and exchanging only model updates, FL allows distributed data resources to be effectively utilized without direct access to raw data and has demonstrated significant potential in applications such as mobile intelligence, the Internet of Things and cross-organizational collaboration ( 22 ; 29 ) . However, most existing federated learning frameworks adopt a centralized and synchronous training paradigm, where a central server collects model updates from all clients and aggregates them in each training round. While such designs perform well under ideal network conditions, they face multiple challenges in real-world systems. First, the central server introduces a single point of bottleneck and failure, which limits scalability due to constraints on communication bandwidth, computation capacity and reliability in large-scale deployments ( 6 ) . Second, synchronous training requires strict temporal alignment of clients at round boundaries, making the system vulnerable to device heterogeneity and system variability and leading to the well-known straggler problem that significantly degrades training efficiency ( 18 ; 12 ) . Finally, centralized architectures are often difficult to deploy in cross-organizational or cross-domain scenarios and conflict with the growing demand for trustless and autonomous systems ( 6 ; 40 ) . To overcome these limitations, Decentralized Federated Learning (DFL) has attracted increasing attention. In DFL, clients exchange model information only with their neighboring nodes without relying on a central server, thereby improving system robustness and scalability ( 37 ; 40 ) . Nevertheless, most existing decentralized approaches still rely on synchronous update mechanisms, assuming that clients remain aligned across logical training rounds, an assumption that is difficult to satisfy in dynamic network environments ( 4 ; 26 ) . Consequently, Asynchronous Decentralized Federated Learning (ADFL) has been recognized as a more practical training paradigm for real-world deployments ( 26 ; 8 ) . ADFL allows clients to perform local updates and communications at different times without global synchronization, while supporting model collaboration solely through neighbor-to-neighbor communication ( 28 ; 11 ) . This setting naturally accommodates device heterogeneity, network variability and partial participation and enables clients to join the training process at arbitrary times ( 36 ; 1 ) . As a result, ADFL is well suited for edge computing, peer-to-peer networks and large-scale distributed systems, offering significant advantages in terms of system throughput, fault tolerance and deployment flexibility. Despite these advantages, such a highly flexible training paradigm also introduces new challenges. Specifically, ADFL systems often face three fundamental difficulties simultaneously. First, since clients communicate only with their neighbors and model exchanges may occur frequently, directly transmitting full model parameters incurs prohibitive communication overhead, which is difficult to sustain in bandwidth-constrained or large-scale systems ( 31 ; 5 ) . Compared to centralized settings, decentralized architectures lack unified communication scheduling and aggregation, making communication efficiency a more prominent concern ( 40 ; 17 ) . Second, asynchronous updates combined with asymmetric communication topologies can lead to biased aggregation ( 14 ; 2 ) . In practice, clients may push models at different times and communication links can be unbalanced, under which naive neighbor averaging fails to guarantee unbiased consensus ( 11 ; 9 ) . Finally, the widely observed statistical heterogeneity (non-IID data) across clients is further amplified in asynchronous decentralized environments ( 26 ; 28 ; 30 ) . Local updates computed on non-identically distributed data tend to induce significant model drift, while asynchronous communication may delay or mismatch these updates, exacerbating training instability and degrading final performance ( 38 ; 27 ) . These challenges are not independent. Communication constraints necessitate compression. Compression can amplify client drift under non-IID data. Asynchrony further delays and skews these updates. Together, these effects exacerbate aggregation bias in decentralized training. Accordingly, the central research question addressed in this work is: How can we jointly design compression, de-biased aggregation, and local-update stabilization for accurate and stable ADFL under asymmetric communication and non-IID data? To address this research question, we propose a new ADFL framework, termed PushCen-ADFL (Push-Sum Centroid Asynchronous Decentralized Federated Learning). The proposed framework is built around lightweight centroid structures and integrates centroid-based compression with push-sum aggregation, where both aggregation and local optimization are constrained in the same centroid representation space, enabling communication-efficient and stable federated training without relying on a central server or global synchronization. Our main contributions are summarized as follows: • We propose PushCen-ADFL, an asynchronous framework that unifies centroid-based communication, push-sum de-biasing and buffered neighbor aggregation into a single decentralized training pipeline, where both aggregation and local optimization operate in the same centroid representation space. • We design an average-preserving push-sum aggregation with mass splitting and a deduplicated bounded buffer, mitigating bias from asymmetric information flow and preventing stale messages from dominating aggregation. • We develop a centroid-aligned proximal regularizer that stabilizes local updates in the same compressed centroid space used for communication. This alignment mitigates non-IID data distributions by contracting local trajectories toward a shared compressed reference. • We provide a convergence analysis for PushCen-ADFL and validate it on CIFAR-10, CIFAR-100 and Tiny-ImageNet, improving accuracy by up to 6% over communication-efficient baselines, while reducing per-push transmitted payload by more than 80% less than full-model communication. 2. Related Work 2.1. Asynchronous Decentralized FL A representative direction is to design wait-free or fully asynchronous communication mechanisms to mitigate stragglers. SWIFT proposes a wait-free decentralized FL algorithm that allows each client to proceed without synchronization barriers, while maintaining standard iteration complexity guarantees ( 4 ) . Complementarily, A 2 CiD 2 studies asynchronous decentralized deep learning from an

Read the complete text