A Full Compression Pipeline for Green Federated Learning in Communication-Constrained Environments
Elouan Colybes 1 , Shirin Salehi 1 , and Anke Schmeink 1 · 2026
Read A Full Compression Pipeline for Green Federated Learning in Communication-Constrained Environments by Elouan Colybes 1 , Shirin Salehi 1 , and Anke Schmeink 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11146.txt.
Introduction
Colybes and two colleagues introduce a Full Compression Pipeline for green federated learning (FL) in constrained settings. FL enables joint training across spread clients without sharing raw data, preserving privacy. It often suffers heavy communication and compute overhead, limiting scale. It joins pruning, quantization, and Huffman encoding into one framework. By compressing local models and payloads, it greatly reduces transfer costs while keeping accuracy high. In one scenario, training runs more than 60 percent faster with only a 2 percent scores drop.
Catalog record
| CREATOR | Elouan Colybes 1 , Shirin Salehi 1 , and Anke Schmeink 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29202 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11146
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Full Compression Pipeline for Green Federated Learning in Communication-Constrained Environments Elouan Colybes 1 , Shirin Salehi 1 , and Anke Schmeink 1 Abstract Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, thereby preserving privacy. However, FL often suffers from significant communication and computational overhead, limiting its scalability and sustainability. In this work, we introduce a Full Compression Pipeline (FCP) for FL in communication-constrained environments. FCP integrates three complementary deep compression techniques—pruning, quantization, and Huffman encoding—into a unified end-to-end framework. By compressing local models and communication payloads, FCP substantially reduces transmission costs and resource consumption while maintaining competitive accuracy. To quantify its impact, we develop an evaluation framework that captures both communication and computation overheads as a unified model cost, allowing a holistic assessment of efficiency trade-offs. The pipeline is evaluated in an independent and identically distributed (IID) and non-IID data setting. In one representative scenario, training a ResNet-12 model on the CIFAR-10 dataset with ten clients and a 2 Mbps bandwidth, the FCP achieves more than 11 × \times reduction in model size, with only a 2% drop in accuracy compared to the uncompressed baseline. This results in an FL training that is more than 60% faster. [email protected], {shirin.salehi, anke.schmeink}@inda.rwth-aachen.de I Introduction Recent advances in artificial intelligence (AI), particularly large language models (LLM), have transformed the perception and applications of AI across domains. This progress, enabled by increasing computational power, has led to unprecedented model complexity but also to significant energy demands and environmental concerns. The emerging paradigm of green AI advocates for efficient, sustainable learning systems [ 11 , 10 ] , contrasting with red AI, which prioritizes performance regardless of computational cost. Within machine learning (ML), federated learning (FL) [ 8 ] offers a distributed training paradigm where clients collaboratively train a global model without sharing raw data, enhancing privacy. However, despite these benefits, FL still suffers from significant communication and computational overhead due to frequent model updates. To address these challenges, we propose integrating deep compression techniques [ 4 ] —pruning, quantization, and Huffman encoding—into an end-to-end Full Compression Pipeline (FCP) for FL. FCP aims to improve communication efficiency, scalability, and sustainability while maintaining accuracy, aligning with green AI principles. The main goals of this paper are: (1) develop a flexible FL simulation framework supporting compression techniques; (2) provide an analytical characterization of the proposed FCP, including compression ratio, compression loss, and complexity analysis; (3) design a comprehensive FL evaluation framework to gauge computation and communication overheads as a unified model cost; and (4) demonstrate FCP’s generalizability across datasets and data distributions. The remainder of this paper reviews related work (Sec. II), describes the system setup (Sec. III), details the FCP (Sec. IV), presents results (Sec. V), and concludes (Sec. VI). II Related Works Communication efficiency remains a major bottleneck in FL due to frequent model exchanges over constrained networks. Shahid et al. [ 13 ] highlight that bandwidth limits, device heterogeneity, and non-IID data hinder scalability, and survey mitigation strategies such as client selection, local updates, compression, and decentralization. Grativol et al. [ 9 ] integrate pruning and quantization-aware training (QAT) into the FL pipeline, but only as separate components to achieve a reduction in message size with small accuracy loss. Similarly, FedZip [ 6 ] combines Top- z sparsification, k -means quantization, and encoding to reduce the communication costs. ResFed [ 14 ] transmits compressed residuals predicted by local and server models, to yield communication savings while maintaining accuracy. CMFL [ 16 ] filters non-aligned client updates to improve efficiency, and FedCompress [ 15 ] employs adaptive clustering and server-side distillation for reduction. While existing approaches promote lightweight communication, they typically lack analytical evaluation of compression techniques in terms of compression ratio, accuracy loss, and computational complexity. Moreover, they often overlook the additional overhead introduced by these methods. In contrast, we introduce a unified cost model that analytically captures their joint impact on FL performance. Fig. 1 : Our full compression pipeline to reduce communication overhead in federated learning III System setup We consider a server tasked with training a global model using the FL paradigm. The server coordinates a set of clients C , each holding private local data. At each communication round i , the server selects a subset S\subset C , sends them the current global model, and receives their locally updated parameters w_{s}^{(i)} . The server then aggregates these updates using the Federated Averaging (FedAvg) algorithm [ 7 ] to refine the global model through weighted averaging. Clients, simulating edge devices, perform local training and evaluation before transmitting their compressed updates to the central server. In our setup, we apply deep compression techniques after local training and before model upload, while maintaining full control over optimization hyperparameters such as learning rate, batch size, and momentum. In FL, compression can be applied upstream (client-to-server), downstream (server-to-client), or bidirectionally [ 12 ] , though most approaches focus on the first two [ 6 ] . Upstream compression reduces server-side bottlenecks by minimizing update transmission, whereas downstream compression adds decoding overhead and may propagate errors to clients. Hence, we apply compression only upstream to balance efficiency and model integrity. IV Proposed full compression pipeline for FL The goal of the proposed FCP is to minimize communication costs in FL while maintaining model fidelity. To achieve this, we adapt established compression techniques—pruning, quantization, and Huffman encoding, in the same order as introduced by Han et al. [ 4 ] —to the federated setting by integrating them sequentially within a single, layer-wise pass. Executing them in this order present multiple advantages, as detailed later. Performing all compression steps per layer in one loop improves computational efficiency compared to applying each method independently across all layers. We then derive explicit expressions for the communication compression ratio, analytical bounds on accuracy degradation due to compression noise, and a per-layer complexity characterization for client-side operations. The FCP pipeline is illustrated in Fig. 1 and Algorithm 1 . IV-A Compression Pipeline IV-A 1 Pruning We adopt unstructured, model-wise pruning, which removes individual weights with small magnitudes across the entire model. Our ablation studies indicate that this approach achieves a favorable trade-off between model sparsity and accuracy retention compared to structured or layer-wise pruning. Specifically, we set a global pruning threshold \lambda as the \gamma -quantile of all weight magnitudes, so that the smallest \gamma fraction of weights—those contributing least to the model output—are removed. This reduces memory usage and computational cost without significantly affecting model performance. Formally, let \mathcal{W}=\{w_{1},w_{2},\ldots,w_{N}\} denote the set of all model weights, and let \mathcal{W}_{\mathrm{np}}=\{w_{i}\in\mathcal{W}\mid|w_{i}|\geq\lambda\} be the set of non-pruned weights, so that |\mathcal{W}_{\mathrm{np}}|=(1-\gamma)N . IV-A 2 Post-training quantization (PTQ) We adopt codebook quantization (CQ) [ 4 ] , a k -means-based method that clusters the reduced set of non-pruned weights \mathcal{W}_{\text{np}}=\{w_{1},\dots,w_{|\mathcal{W}_{\text{np}}|}\} into k clusters \mathcal{C}=\{c_{1},\dots,c_{k}\} , with each cluster sharing a common value. Weights are not shared across layers. The clustering minimizes the within-cluster sum of squares: \underset{\mathcal{C}}{\operatorname{argmin}}\sum_{i=1}^{k}\sum_{w\in c_{i}}|w-c_{i}|^{2} . The number of clusters is typically set by a bit parameter q so that k=2^{q} . The set of non-pruned and quantized weights is then \mathcal{W}_{\text{npq}} , having the same size as \mathcal{W}_{\text{np}} , and \forall~w\in\mathcal{W}_{\text{npq}},\exists~i\in\{1,k\},~w=c_{i} . Based