FedRTS: Federated Robust Pruning via Combinatorial Thompson Sampling

Hong Huang, JinHai Yang, Yuan Chen, Jiaxun Ye, Dapeng Wu · 2025

Read FedRTS: Federated Robust Pruning via Combinatorial Thompson Sampling by Hong Huang, JinHai Yang, Yuan Chen, Jiaxun Ye, Dapeng Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19122.txt.

Introduction

Hong Huang and co-authors present FedRTS, a 2025 method for keeping federated learning models sparse without making them fragile. In federated learning, many devices train one model together. Pruning, holding most weights at zero, cuts the computing and communication load. Existing pruning schemes adjust the sparse pattern greedily, which destabilizes training when data differs across devices.

FedRTS replaces snap decisions with Thompson sampling, a probabilistic method that weighs evidence over time. Its adjustment step favors stable, farsighted information over the noisy last round. The goal is a sparse model that stays robust when clients drop in and out and their data clashes. Tests across vision and language tasks reached leading performance, the authors report. Sparsity is how federated learning fits small devices; doing it without brittleness decides whether the savings survive the real world.

Catalog record

CREATORHong Huang, JinHai Yang, Yuan Chen, Jiaxun Ye, Dapeng Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-19122

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedRTS: Federated Robust Pruning via Combinatorial Thompson Sampling Hong Huang, JinHai Yang, Yuan Chen, Jiaxun Ye, Dapeng Wu Abstract Federated Learning (FL) enables collaborative model training across distributed clients without data sharing, but its high computational and communication demands strain resource-constrained devices. While existing methods use dynamic pruning to improve efficiency by periodically adjusting sparse model topologies while maintaining sparsity, these approaches suffer from issues such as greedy adjustments , unstable topologies , and communication inefficiency , resulting in less robust models and suboptimal performance under data heterogeneity and partial client availability. To address these challenges, we propose Fed erated R obust pruning via combinatorial T hompson S ampling (FedRTS), a novel framework designed to develop robust sparse models. FedRTS enhances robustness and performance through its Thompson Sampling-based Adjustment (TSAdj) mechanism, which uses probabilistic decisions informed by stable and farsighted information, instead of deterministic decisions reliant on unstable and myopic information in previous methods. Extensive experiments demonstrate that FedRTS achieves state-of-the-art performance in computer vision and natural language processing tasks while reducing communication costs, particularly excelling in scenarios with heterogeneous data distributions and partial client participation. Our codes are available at: https://github.com/Little0o0/FedRTS . 1 Introduction Figure 1: Illustration of topology adjustment in existing baselines 2 2 2 Baseline’s workflow: https://github.com/Little0o0/FedRTS/image/workflow.mp4 and FedRTS. Left: Existing baselines adjust model topology based on myopic and unstable aggregated weights and gradients via deterministic magnitude pruning and reactivating, resulting in greedy adjustment and high communication overhead. Right: FedRTS introduces Thompson Sampling-based Adjustment (TSAdj) to adjust the topology based on farsighted and stable probability distributions, achieving a robust topology and low communication overhead. Federated learning (FL) [ 27 , 24 , 19 ] enables edge devices with private local data to collaboratively train a model without sharing data. However, substantial computational and communication demands for training deep learning models often exceed the resource limitations of edge devices in cross-device FL scenarios. Although neural network pruning [ 9 , 33 , 26 ] offers a promising solution by removing redundant parameters, traditional pruning methods depend on resource-intensive dense model training, rendering them impractical for privacy-preserved and resource-constrained FL environments. To address these challenges, recent federated pruning frameworks [ 1 , 39 , 49 , 18 , 14 , 13 , 35 ] have adopted dynamic sparse training techniques [ 8 , 40 , 16 ] within FL. These frameworks employ a two-loop training process: in the inner loop, model weights are updated through standard FL rounds with fixed model topology; in the outer loop, the server adjusts the model topology by pruning and reactivating parameters [ 8 ] , as illustrated in Fig. 1 (left). This iterative process generates a specialized sparse model without dense model training, significantly reducing computational costs. Despite these advancements, existing frameworks [ 1 , 39 , 49 , 18 , 14 , 13 , 35 ] suffer from three critical challenges in model topology adjustment, as illustrated in Fig. 1 (left). (1) Greedy adjustment: Current methods rely on myopic, aggregated information from a small subset of participating clients, ignoring data from the majority of unseen clients and prior knowledge. This leads to greedy adjustments and reduced robustness [ 19 ] . (2) Unstable topology: Deterministic adjustments based solely on aggregated information are prone to instability due to heterogeneous data distributions, resulting in unstable model topologies. (3) Communication inefficiency: Transmitting extensive auxiliary data ( e.g., full-size gradients) for topology updates imposes high communication costs. These limitations hinder the ability of current methods to handle client availability, data heterogeneity, and communication costs effectively, ultimately leading to suboptimal performance and inefficient resource utilization. To address these challenges, we reframe federated pruning as a combinatorial multi-armed bandit (CMAB) [ 2 ] problem and identify the above issues located in myopic observation and deterministic decision. Building on this insight, we propose Fed erated R ubust pruning via combinatorial T hompson S ampling (FedRTS), a novel framework designed to derive robust sparse models for cross-device FL, as illustrated in Fig. 2 . FedRTS introduces the Thompson Sampling-based Adjustment (TSAdj) mechanism, depicted in Fig. 1 (right), to address the shortcomings of existing methods. First, TSAdj leverages farsighted probability distributions (including prior information from unseen clients) to mitigate the impact of partial client participation. Second, it uses probabilistic decisions based on stable, comprehensive information for topology adjustment. Third, FedRTS reduces communication overhead by requiring clients to upload only top-gradient indices instead of dense gradients. We evaluate FedRTS on computer vision and natural language processing datasets, demonstrating its effectiveness in handling client availability and data heterogeneity. FedRTS achieves higher accuracy, better generalization, and lower communication costs compared to state-of-the-art (SOTA) methods. For instance, on the CIFAR-10 dataset with the ResNet18 model, FedRTS achieves either a 5.1% accuracy improvement or a 33.3% reduction in communication costs compared to SOTA frameworks. To our knowledge, this paper is the first work to analyze federated pruning through a CMAB lens and apply combinatorial Thompson sampling to stabilize topology adjustments in FL. 2 Preliminary and Challenges 2.1 Federated Dynamic Pruning In federated pruning, \mathcal{N} resource-constrained clients collaboratively train a sparse model using their local datasets D_{n},n\in\{1,2,...,\mathcal{N}\} . Given the target density d^{\prime} , the objective is to solve the following optimization problem: \min_{W,m}\sum_{n=1}^{\mathcal{N}}p_{n}f_{n}(W,m,D_{n}),\quad\mathrm{s.t.}\kern 5.0ptd\leq d^{\prime}, (1) where W represents the model weights, m\in\{0,1\}^{\langle W\rangle} denotes the sparse model topology (also called mask), f_{n}(\cdot) is the objective function for client n , d is the density of the topology m , and p_{n} is set as the proportion of the dataset size of client n , typically set as p_{n}=\langle D_{n}\rangle/\sum^{\mathcal{N}}_{i=1}\langle D_{i}\rangle . 3 3 3 In this paper, \langle\cdot\rangle is the cardinal number of the set. To solve the problem in Eq. 1 under the target density constraint d^{\prime} , existing federated pruning frameworks [ 1 , 39 , 49 , 18 , 14 , 13 , 35 ] apply dynamic sparse training techniques [ 8 , 40 , 16 ] . These frameworks iteratively adjust sparse on-device models during training while maintaining the density level d\leq d^{\prime} . The process begins with a sparse model initialized via random pruning and follows a two-loop training procedure: In the inner loop, the model topology m remains fixed, and the model weights W are updated through traditional FL rounds. After \Delta T inner loops, as illustrated in Fig. 1 (left), the framework enters the outer loop, where clients upload additional data (specifically, the gradients of the pruned weights) to the server. The server then adjusts the model topology by pruning and reactivating [ 8 ] based on the aggregated weights and gradients. 2.2 CMAB-Based Problem Formulation The Combinatorial Multi-Armed Bandit (CMAB) [ 2 , 47 , 20 ] is a sequential decision-making framework where an agent selects combinations of arms (called super arms) with unknown reward distributions. The objective is to maximize cumulative rewards by balancing the exploration of uncertain arms and the exploitation of high-performing ones. We formulate the topology adjustment as a CMAB problem, where each link m_{i} in the model topology serves as an arm. In each outer loop t , the server selects an action S_{t} , which includes K arms, where K=d\langle m\rangle . Selected arms i\in S_{t} are activated, while others i\notin

Read the complete text