FedX: Adaptive Model Decomposition and Quantization for IoT Federated Learning

*Phung Lai, *Xiaopeng Jiang, NhatHai Phan, Cristian Borcea, Khang Tran, An Chen, Vijaya Datta Mayyuri, Ruoming Jin · 2025

Read FedX: Adaptive Model Decomposition and Quantization for IoT Federated Learning by *Phung Lai, *Xiaopeng Jiang, NhatHai Phan, Cristian Borcea, Khang Tran, An Chen, Vijaya Datta Mayyuri, Ruoming Jin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12849.txt.

Introduction

Phung Lai and co-authors present FedX, a 2025 system for federated learning on fleets of small internet of things devices. Federated learning trains one shared model across many devices without moving their private data. The catch is hardware: phones and sensors vary wildly in power, and full models are too heavy for the weakest.

FedX splits the global model into sub networks of different sizes. A weak device gets a smaller slice, but with more bits kept per weight, so its accuracy stays up. A strong device takes a bigger slice at coarser precision. The server does the quantization work, sparing the devices. Each device trains only what it can afford, and the pieces still combine into one model. Balancing utility against overhead this way lets health trackers and asset sensors join training that would otherwise exclude them.

Catalog record

CREATOR*Phung Lai, *Xiaopeng Jiang, NhatHai Phan, Cristian Borcea, Khang Tran, An Chen, Vijaya Datta Mayyuri, Ruoming Jin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-12849

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedX: Adaptive Model Decomposition and Quantization for IoT Federated Learning *Phung Lai, *Xiaopeng Jiang, NhatHai Phan, Cristian Borcea, Khang Tran, An Chen, Vijaya Datta Mayyuri, Ruoming Jin Abstract Federated Learning (FL) allows collaborative training among multiple devices without data sharing, thus enabling privacy-sensitive applications on mobile or Internet of Things (IoT) devices, such as mobile health and asset tracking. However, designing an FL system with good model utility that works with low computation/communication overhead on heterogeneous, resource-constrained mobile/IoT devices is challenging. To address this problem, this paper proposes FedX , a novel adaptive model decomposition and quantization FL system for IoT. To balance utility with resource constraints on IoT devices, FedX decomposes a global FL model into different sub-networks with adaptive numbers of quantized bits for different devices. The key idea is that a device with fewer resources receives a smaller sub-network for lower overhead but utilizes a larger number of quantized bits for higher model utility, and vice versa. The quantization operations in FedX are done at the server to reduce the computational load on devices. FedX iteratively minimizes the losses in the devices’ local data and in the server’s public data using quantized sub-networks under a regularization term, and thus it maximizes the benefits of combining FL with model quantization through knowledge sharing among the server and devices in a cost-effective training process. Extensive experiments show that FedX significantly improves quantization times by up to 8.43 × \times , on-device computation time by 1.5 × \times , and total end-to-end training time by 1.36 × \times , compared with baseline FL systems. We guarantee the global model convergence theoretically and validate local model convergence empirically, highlighting FedX’s optimization efficiency. § § footnotetext: * Equal contribution I Introduction In Federated Learning (FL), a global model is trained by aggregating local model’s gradients across devices, while ensuring user privacy by not sharing local data [ 1 ] . This feature makes FL suitable for building intelligent mobile/IoT systems and enhancing model generalization/utility, compared with individual local models. Examples include mobile health, where users employ heterogeneous IoT devices (i.e., phone, smart watches, mHealth sensors) to monitor health information and human activities [ 2 ] , and fleet tracking, where businesses use different IoT devices to track assets or vehicles [ 3 ] . In these systems, the devices exhibit heterogeneity, but collaborate to achieve the same system goals by performing identical tasks. The hardware heterogeneity of IoT devices in terms of computation, communication, and storage raises a main challenge for FL systems: How to balance model utility with computation and communication overhead, given heterogeneous and limited on-device resources? Achieving high model utility may require resource-intensive models and multi-round communication, straining resource-constrained devices. Large models can be too slow, difficult to execute, or consume too much battery power, while small models on all devices may overlook that some devices can handle the larger models that perform better. Model compression and distillation address computation and communication overhead on resource-constrained devices. Quantization-based compression approaches [ 4 , 5 ] reduce communication load by reducing parameter or gradient precision. Other compression methods are sparsification, pruning, reduction, and sampling [ 6 , 7 ] . However, these techniques often sacrifice utility or focus on communication reduction at the expense of computation. In model distillation [ 8 ] , different devices with heterogeneous resources initially train their model using public data, then retrain locally using their private data. To mitigate the reliance on public data, some works [ 9 , 10 ] leverage quantization on devices and conduct model shrinking or knowledge distillation to align utility of the local model with that of the global model. While effective, these techniques can impose significant computational overhead on clients. In addition, knowledge distillation, tiering, and split learning-based FL [ 11 , 12 , 8 ] focus on individual devices without globally balancing utility, computation, and communication. Therefore, there is a crucial need for an efficient and effective FL for heterogeneous and resource-constrained IoT devices. Contributions. This paper proposes FedX , an adaptive model decomposition and quantization FL system for IoT. To balance model utility with resource constraints on IoT devices, FedX decomposes a global FL model into different sub-networks with different quantization levels for different devices. The key idea to achieve this balance is that a device with fewer resources receives a smaller sub-network for lower overhead, but utilizes a larger number of quantized bits for higher model utility, and vice-versa. The sub-networks used by the devices are nested within each other; that is, a smaller sub-network is always contained inside a larger sub-network. This approach fosters knowledge sharing among IoT devices, since on-device training and updating any sub-network will improve other sub-networks through the model aggregation in the federated training. Quantization operations in FedX are done at the server to reduce the computation load on IoT devices, notably without affecting their model utility. FedX starts from a global model trained on publicly available data and fine-tunes it to align it with the local data distributions of IoT devices, which frequently differ from the global model’s distribution. During this process, reducing the disparity between the global models before and after fine-tuning is crucial to ensure that the fine-tuned global model effectively learns the distinctive distribution present in the server’s data while retaining the knowledge acquired from the data distributions of the IoT devices. To ensure minimal disparity between the global models before and after fine-tuning, we add a regularization minimizing the difference between the global models during fine-tuning. The features of FedX maximize the benefits of combining FL with model quantization by enabling knowledge sharing among the server and the devices in a cost-effective training process. Extensive experiments on image classification and human activity recognition show that FedX outperforms state-of-the-art adaptive quantization approaches for FL [ 4 , 10 ] by 1.90\%-12.28\% in accuracy. In addition, using NVidia Jetson Nano, Qualcomm QCS605 AI kit, and Raspberry Pi 5, FedX shows significant improvement in quantization time by 8.43\times , on-device computation time by 1.5\times , and total end-to-end training time by 1.36\times , compared with baseline FL systems. II Background II-A Federated Learning Federated Learning (FL) is a multi-round protocol where a server sends a global model \theta^{t} to a random subset of M^{t} devices at each training round t . These devices train the model locally and send updates back. The server aggregates the updates using a function \mathcal{G}:R^{|M^{t}|\times n}\rightarrow R^{n} ( n is the size of \theta^{t} ), producing the aggregated model \theta^{t+1}=\mathcal{G}(\{\theta_{u}^{t+1}\}_{u\in M^{t}}) . FedAvg is a common aggregation method in FL [ 13 ] . II-B Quantization-based Compression Quantization-based compression approaches in FL typically speeds up model convergence and minimizes communication [ 14 , 5 , 10 ] . In FedX, we consider stochastic fixed-point quantization, i.e., QSGD [ 14 , 4 ] . The quantization function, denoted as \mathbb{Q}(\cdot,q) with q\geq 1 , represents quantized bits, corresponding to the number of bits used for each value. Technically, q is associated with 2^{q} levels of quantization. Each value is quantized in a manner that maintains its expected value while minimizing variance. The quantizer \mathbb{Q}(\theta,q) quantizes the vector \theta element-wise, returning the sign of \theta and \|\theta\|_{2}

Read the complete text