CLIP: Client-Side Invariant Pruning for Mitigating Stragglers in Secure Federated Learning
Anthony DiMaggio, Raghav Sharma, Gururaj Saileshwar · 2025
Read CLIP: Client-Side Invariant Pruning for Mitigating Stragglers in Secure Federated Learning by Anthony DiMaggio, Raghav Sharma, Gururaj Saileshwar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16694.txt.
Introduction
Anthony DiMaggio, Raghav Sharma, and Gururaj Saileshwar address slow clients in secure federated learning. In federated learning, many devices train a shared model without sending raw data away. Secure versions protect the shared updates, but weak or slow devices, called stragglers, hold back everyone else.
Their method, CLIP, prunes neurons on each client in a way that keeps shared structure intact, and adds pruning that responds to network limits. Across the CIFAR10, Shakespeare, and FEMNIST data sets, training ran thirteen to thirty-four percent faster. Accuracy changed only slightly, from a small gain to a small loss. The authors call CLIP the first straggler fix built for secure aggregation.
Catalog record
| CREATOR | Anthony DiMaggio, Raghav Sharma, Gururaj Saileshwar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16694
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CLIP: Client-Side Invariant Pruning for Mitigating Stragglers in Secure Federated Learning Anthony DiMaggio, Raghav Sharma, Gururaj Saileshwar Abstract Secure federated learning (FL) preserves data privacy during distributed model training. However, deploying such frameworks across heterogeneous devices results in performance bottlenecks, due to straggler clients with limited computational or network capabilities, slowing training for all participating clients. This paper introduces the first straggler mitigation technique for secure aggregation with deep neural networks. We propose CLIP, a client-side invariant neuron pruning technique coupled with network-aware pruning, that addresses compute and network bottlenecks due to stragglers during training with minimal accuracy loss. Our technique accelerates secure FL training by 13% to 34% across multiple datasets (CIFAR10, Shakespeare, FEMNIST) with an accuracy impact of between 1.3% improvement to 2.6% reduction. 1 Introduction Federated Learning (FL) enables a decentralized approach to training machine learning models on edge devices, allowing multiple clients to update a global model without sharing local datasets. In each training round, clients compute gradients locally, which are aggregated by a central server and used to update a global model, which is re-distributed to participants for the next training round FedLearning . Need for Secure Aggregation. While FL improves privacy by keeping client data local, model updates sent to the server can still leak sensitive information through model inversion attacks zhu2019deep ; geiping2020inverting , which show that the server can recover approximate representations of the client’s training data by observing the individual client gradients. Secure federated learning mitigates these privacy leaks using secure aggregation (SecAgg) BonawitzSecAgg ; BonawitzCCS2017SecAgg ; SecAgg+ . SecAgg ensures that the server only observes the aggregated update, not individual updates, through secure multi-party computation (MPC) protocols that mask individual contributions, thus protecting against model inversion attacks. While SecAgg enhances privacy, it suffers from performance bottlenecks due to device heterogeneity in the distributed setting. Straggler Problem. A central challenge in decentralized FL systems is device heterogeneity. Mobile clients vary significantly in their computational power and network bandwidth, creating “stragglers” or slower devices that delay training for all clients. This is because the server waits for all clients to provide their updates, before aggregating them and sending the clients the updated model. Thus, faster clients are held back by stragglers in FL, slowing down training time for all clients reisizadeh2020stragglerresilientfederatedlearningleveraging . Unfortunately, prior straggler mitigation techniques for FL are incompatible with secure aggregation. Figure 1 : (a) Secure aggregation in federated learning preserves privacy of client training data; however stragglers with slow compute or network bandwidth increase training time. (b) State-of-the-art server-side solutions for straggler mitigation are incompatible with secure aggregation and do not provide privacy. (c) Our solution enables client-side invariant neuron pruning and network-aware pruning that improves training speed while maintaining accuracy and privacy. Challenge-1: Lack of Straggler Mitigation in Secure FL. Prior works wang2023fluid ; reisizadeh2020stragglerresilientfederatedlearningleveraging ; Distreal propose pruning the models for straggler clients, to reduce their computational effort and equalize their training time with non-stragglers. Compared to leaving out the straggler’s contributions, this approach achieves higher accuracy and fairness. State-of-the-art techniques, such as FLuID wang2023fluid , intelligently prune invariant neurons at the server-side to minimize accuracy impact of pruning. Unfortunately, such approaches require the server to access individual client updates from non-stragglers to identify invariant neurons in them, which is incompatible with secure aggregation, as the server only has access to the aggregate. Simpler client-side pruning techniques, such as Random Dropout RandomDropout ; Distreal , unfortunately impact accuracy significantly. This leaves secure federated learning without effective straggler mitigation techniques that balance training time, accuracy, and privacy. Challenge-2: Network Stragglers in Secure FL. Pruning in non-secure FL wang2023fluid ; RandomDropout ; Distreal also mitigates network bottlenecks by reducing the size of gradient vectors transferred over the network by straggler clients. However, in secure FL, the secure multi-party computation protocols used in SecAgg require all clients to transmit gradient vectors of identical size to ensure proper cancellation of encryption masks during aggregation. This constraint prevents the naive use of pruning techniques for reducing network overhead. Consequently, while pruning can mitigate compute stragglers, it cannot address the bottlenecks due to network-based stragglers in secure FL. This paper introduces the first straggler mitigation technique for secure federated learning, addressing both compute and network-related challenges. Our approach extends server-side pruning techniques such as invariant dropout wang2023fluid to a client-side solution compatible with secure aggregation (SecAgg). This reduces training time for clients, while preserving model accuracy and client privacy. To securely address network stragglers, we identify that reducing model update sizes compromises privacy in Secure FL and hence preserve fixed-size updates by padding smaller updates from stragglers. Instead, we propose network-aware pruning—a technique that aggressively prunes models to reduce client training time and compensate for longer communication times. To mitigate accuracy loss from over-pruning, our method ensures stability in pruned neurons across training rounds and dynamically adjusts pruning randomness as training progresses. Together, this approach mitigates both compute and network bottlenecks, with accuracy impact of between 1.3% improvement to 2.6% reduction. Overall, this paper makes the following contributions: 1. Analysis of the Impact of Stragglers in Secure FL. We provide the first systematic analysis of secure FL training times in the presence of stragglers, quantifying the effects of both compute and network stragglers on the SecAgg protocol BonawitzCCS2017SecAgg ; SecAgg+ . 2. Client-Side Invariant Neuron Pruning. We propose the first client-side invariant neuron dropout technique in federated learning that is compatible with Secure Aggregation. This achieves reductions in training time for compute stragglers, reducing training time without sacrificing privacy or accuracy. 3. Network-Aware Pruning for Stragglers. To account for network stragglers, we propose more aggressive pruning to reduce client training time and compensate for the increasing network communication time. This reduces training time for network stragglers, without sacrificing privacy. We evaluate our solution in a Secure FL setting with up to 50 clients, with the majority of non-straggler clients running at 3GHz CPU frequency with a 5G network connection, and a minority of the clients as stragglers with a 4G connection running at 2GHz CPU frequency. Our technique accelerates secure FL training by 13% to 34% across multiple datasets (CIFAR10, Shakespeare, FEMNIST) addressing straggler overheads securely without impacting privacy, with accuracy impact of no more than 2.6%. 2 Related Work 2.1 Secure Aggregation Federated learning (FL) enables clients to train models locally and share gradients with a server, which aggregates them using Federated Average mcmahan2017FedAvg ; FedLearning . However, keeping data local is not sufficient for privacy; sharing plaintext gradients with the server also exposes client training data to model inversion attacks zhu2019deep ; zhao2020idlg ; geiping2020inverting ; yin2021see ; huang2021evaluating where an attacker can recover a client’s private training data from its gradients. Secure aggregation protocols address this using secure multi-party computation protocols (MPC) by masking individual updates with random values that cancel during aggregation, ensuring only the aggregated sum is revealed to the server BonawitzSecAgg ; BonawitzCCS2017SecAgg ; SecAgg+ .For each training round, the key steps in these protocols apart from the client fit include: (1) securely exchanging keys between clients, (2) generating the random mask vectors using the keys, (3) training the model and masking the gradients and transmitting them to the server, (4) the unmasking step at the