Asynchronous Secure Federated Learning with Byzantine aggregators

Antonella Del Pozzo, Achille Desreumaux, Mathieu Gestin · 2026

Read Asynchronous Secure Federated Learning with Byzantine aggregators by Antonella Del Pozzo, Achille Desreumaux, Mathieu Gestin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04930.txt.

Introduction

Antonella Del Pozzo and 4 co-authors set out a new way to add up model updates in federated learning in a 2026 paper. In federated learning, phones or sites train a shared model and send in updates. The server must add those updates up in a way that leaks none of them. Old schemes assume all hands act at the same pace, lean on heavy peer-to-peer chats, and fail if the server stalls or drops notes.

Their scheme works when notes can arrive at any time, with any lag. It also holds up when the server itself acts in bad faith and breaks the rules in any way it likes. Dropping the need for lockstep pace and a trusted server brings safe federated learning far closer to how real fleets of phones and sites truly act.

Catalog record

CREATORAntonella Del Pozzo, Achille Desreumaux, Mathieu Gestin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04930

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Asynchronous Secure Federated Learning with Byzantine aggregators Antonella Del Pozzo, Achille Desreumaux, Mathieu Gestin Abstract Privacy-preserving federated averaging is a central approach for protecting client privacy in federated learning. In this paper, we study this problem in an asynchronous communications setting and with malicious aggregators. We propose a new solution to provide federated averaging in this model while protecting the client’s data privacy through secure aggregation and differential privacy. Our solution maintains the same performance as the state of the art across all metrics, and it even improves performance in some specific metrics. Namely, our solution allows for less noise in individual updates than existing solutions, and it provides training certification by design. The main contributions of this paper are threefold. First, unlike existing single- or multi-server solutions, we consider malicious (Byzantine) aggregation servers that may manipulate the model to leak clients’ data or halt computation. To tolerate this threat, we replicate the aggregators, allowing a fraction of them to be corrupted, and employ verification techniques that enable clients to verify the integrity of the resulting aggregated model. Second, we propose a new privacy preservation protocol for protocols in asynchronous communication models with Byzantine aggregators. In this protocol, clients mask their values and add Gaussian noise to their models. In contrast with previous works, we use the replicated servers to unmasks the models, while ensuring the liveness of training even if aggregators misbehave. Additionally, we ensure that Byzantine aggregators cannot censor clients thanks to an assignation algorithm. Third, the asynchronous communication model introduces new challenges not present in existing approaches. In such a setting, faster clients may contribute more frequently, potentially reducing their privacy and biasing the training. To address this, we introduce an inclusion mechanism that ensures uniform client participation and balanced privacy budgets. Interestingly, the solution presented in this paper does not rely on agreement between aggregators. Thus, we circumvent the known impossibility of consensus in asynchronous settings where processes might crash. Additionally, this feature increases availability, as a consensus-based algorithm only progresses in periods of low latency. Finally, we evaluate our solution on MNIST and compare it to the state-of-the-art. The result of the experimentation demonstrates that server replication preserves reliability and integrity without significantly affecting performance or privacy guarantees. 1 Introduction Federated Learning (FL) is a paradigm where multiple clients collaboratively train a machine learning model while keeping their data local. A central aggregator collects, at each training round, the local model updates, called gradients , to compute a global model that is then redistributed to clients for the next round. Training proceeds through successive rounds until convergence. The main advantage of FL lies in preserving data privacy, since raw data never leave the clients. However, recent studies have revealed that gradient reconstruction attacks [ 41 , 43 , 42 ] , where an adversary corrupts the central aggregator or intercepts gradients exchanged in the network, can reconstruct original data samples used during training. To mitigate such privacy risks, several approaches have been proposed, including local differential privacy [ 1 ] , homomorphic encryption [ 12 , 39 ] , and secure aggregation [ 7 ] . Each of these techniques, however, comes with important limitations. Local differential privacy injects noise into gradients, but when applied at the granularity of individual updates, the amount of noise required to ensure meaningful privacy substantially degrades global model accuracy. Homomorphic encryption enables computation over encrypted gradients, yet its computational and communication overhead remains prohibitive for large-scale models or resource-constrained clients. Secure aggregation avoids these costs because masking is lightweight and ciphertexts retain the size of the input. Still, most secure aggregation protocols [ 7 , 4 , 36 ] require extensive peer-to-peer coordination among clients, increasing per-client message complexity and creating mutual dependencies. Approaches that reduce this communication burden continue to rely on server-side computations that constitute a single point of failure [ 37 ] . Indeed, to the best of our knowledge, existing secure aggregation protocols do not account for aggregators that may experience availability faults and halt the protocol at arbitrary points. A further limitation concerns network assumptions. Many protocols assume synchrony—i.e., bounded message delays—or do not explicitly model the network. In contrast, realistic deployments must operate in asynchronous settings, where message delays may be arbitrary, possibly under adversarial influence. In such settings, slow or straggling clients may be systematically excluded from the aggregation, while fast clients may become disproportionately represented, potentially biasing the aggregated model (especially in the presence of non-i.i.d. data) or exposing fast clients to increased privacy risks. In this paper, we present a new secure aggregation protocol that extends the current state of the art to operate in asynchronous networks and to tolerate fully Byzantine aggregators. Here, fully means that aggregators may deviate in truly arbitrary ways: not only by attempting to illicitly reveal private information or corrupting the aggregated model (as in standard secure aggregation), but also by halting during protocol execution or selectively omitting messages. Our approach leverages a distributed architecture in which clients are partitioned into clusters, and each cluster is verifiably assigned to a specific proxy aggregator, called a coordinator . Each client prepares its model update by masking it using lightweight Learning With Errors (LWE) techniques [ 36 ] and generating shares of the mask, one for each aggregator. Each client then encrypts these shares under the aggregators’ public keys and sends the encrypted shares to its coordinator, which redistributes them to the corresponding aggregators. The aggregators then collaboratively perform verifiable secure aggregation using the received shares: each coordinator securely computes the aggregated model for its cluster, assisted by the shares previously distributed to other aggregators. In addition, each client contributes a small differential privacy (DP) noise component that remains after aggregation and provides privacy guarantees for the aggregated model. In our design, clients do not communicate with each other, and the communication overhead is proportional only to the number of aggregators—a quantity we expect to be significantly smaller than the number of clients. A key aspect of our solution is the verifiable shuffling of clusters: at every round, clients are randomly reassigned to coordinators. This prevents any client from being systematically paired with a Byzantine coordinator that might drop its updates or omit returning the aggregated model. Moreover, because each cluster has a single coordinator that serializes the input shares for that cluster, there is no need to run a Byzantine Fault-Tolerant (BFT) consensus protocol [ 8 , 13 ] , which would otherwise be required when client shares are sent directly to multiple potentially Byzantine aggregators [ 5 ] . Avoiding BFT consensus is essential both to prevent high communication overhead and to ensure that our protocol operates correctly in an asynchronous network. Importantly, periodic shuffling is also key to convergence: by reassigning clients to different aggregators at each round, updates are gradually mixed across clusters, allowing the global model to align even though aggregators do not run consensus to produce a unique model at each round. The second key aspect of our solution is the inclusion of straggling clients . Our inclusion mechanism at the aggregator side increases the likelihood of choosing clients that have been silent in previous rounds, ensuring that every participant is

Read the complete text