OFL: Opportunistic Federated Learning for Resource-Heterogeneous and Privacy-Aware Devices

Yunlong Mao, Mingyang Niu, Ziqin Dang, Chengxi Li, Hanning Xia, Yuejuan Zhu, Haoyu Bian, Yuan Zhang, Jingyu Hua, Sheng Zhong · 2025

Read OFL: Opportunistic Federated Learning for Resource-Heterogeneous and Privacy-Aware Devices by Yunlong Mao, Mingyang Niu, Ziqin Dang, Chengxi Li, Hanning Xia, Yuejuan Zhu, Haoyu Bian, Yuan Zhang, Jingyu Hua, Sheng Zhong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15015.txt.

Introduction

Yunlong Mao and nine co-authors present a federated learning frame for phones and like devices with weak power and strong privacy needs. In such learning, models train on device data without the data leaving home. Past safe tools are slow, so speed and safety are oft split.

Their frame groups devices, updates in a loose timed way, and adds noise plus coded sums for privacy. It also spots poison attacks while sums stay coded. Bench tests beat past tools on speed, safety, and score. One frame can thus serve both needs at once.

Catalog record

CREATORYunlong Mao, Mingyang Niu, Ziqin Dang, Chengxi Li, Hanning Xia, Yuejuan Zhu, Haoyu Bian, Yuan Zhang, Jingyu Hua, Sheng Zhong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15015

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OFL: Opportunistic Federated Learning for Resource-Heterogeneous and Privacy-Aware Devices Yunlong Mao, Mingyang Niu, Ziqin Dang, Chengxi Li, Hanning Xia, Yuejuan Zhu, Haoyu Bian, Yuan Zhang, Jingyu Hua, Sheng Zhong Abstract . Efficient and secure federated learning (FL) is a critical challenge for resource-limited devices, especially mobile devices. Existing secure FL solutions commonly incur significant overhead, leading to a contradiction between efficiency and security. As a result, these two concerns are typically addressed separately. This paper proposes Opportunistic Federated Learning (OFL), a novel FL framework designed explicitly for resource-heterogenous and privacy-aware FL devices, solving efficiency and security problems jointly. OFL optimizes resource utilization and adaptability across diverse devices by adopting a novel hierarchical and asynchronous aggregation strategy. OFL provides strong security by introducing a differentially private and opportunistic model updating mechanism for intra-cluster model aggregation and an advanced threshold homomorphic encryption scheme for inter-cluster aggregation. Moreover, OFL secures global model aggregation by implementing poisoning attack detection using frequency analysis while keeping models encrypted. We have implemented OFL in a real-world testbed and evaluated OFL comprehensively. The evaluation results demonstrate that OFL achieves satisfying model performance and improves efficiency and security, outperforming existing solutions. 1. Introduction Federated Learning (FL) has emerged as a promising solution for collaborative machine learning, especially for large-scale participants. For example, Google uses FL for improving autocorrect and text suggestions of mobile phone keyboards ( Xu et al., 2023b ) , and Nvidia offers FLARE ( NVI, 2025 ) to enable FL in autonomous vehicles driving. However, FL has encountered critical issues in practical deployments ( Chahoud et al., 2023 ; Ji et al., 2023 ; Ezzeldin et al., 2023 ) , including device heterogeneity, resource limitation, data heterogeneity, and so on. What makes things worse is that private data leakage has been identified in FL. Although raw data is kept locally, private training data can still be disclosed by membership inference ( Yan et al., 2022 ) , reconstruction ( Mehnaz et al., 2022 ) , and many other attacks. To implement efficient mobile FL systems, clustering FL (CFL) ( Sattler et al., 2020 ) and hierarchical FL (HFL) ( Wang et al., 2021 ) frameworks have been proposed. CFL frameworks like IFCA ( Ghosh et al., 2020 ) suggest clustering participants based on their training data similarity to mitigate the influence of data heterogeneity. Since real-world participants’ computing and communicating resources may vary dramatically (e.g., a gap of 160x in Asteroid ( Ye et al., 2024 ) ), frameworks like ( Xu et al., 2023a ) suggest grouping participants based on device resources. HFL frameworks commonly group participants based on the similarity of local model updates ( Briggs et al., 2020 ) or datasets characteristics ( Wang et al., 2021 ) while dynamically adjusting groups in response to changes in network conditions or client availability ( Abad et al., 2020 ; Chen et al., 2020 ) . Except for differences in grouping, HFL assigns a stable leader for each group to communicate with the central server, while CFL has no restrictions on communications. Meanwhile, research efforts ( Sav et al., 2020 ; Yan et al., 2024 ; Kanagavelu et al., 2020 ; Fereidooni et al., 2021 ) have been made to address privacy leakage issues, introducing sophisticated defense solutions. Since cryptographic tools like multiparty computation (MPC) ( Gehlhar et al., 2023 ) and homomorphic encryption (HE) ( Jin et al., [n. d.] ) are widely used, these solutions need intensive computation and communication, leading to unaffordable costs for FL participants, especially for mobile devices. Besides, it has been proved that solely applying cryptographic tools cannot prevent threats from inference and reconstruction attacks ( Zhao et al., 2024 ; Mehnaz et al., 2022 ) . Thus, artificial perturbations like differentially private (DP) mechanisms are still needed to protect models trained in FL ( Truex et al., 2020 ; Zhao et al., 2020 ; Mao et al., 2023 ; Yang et al., 2023 ) . Although CFL and HFL consider participant conditions, they rely on frequent communication between participants and the central server. This leads to significant communication overhead and stable communication channel requirements, which is impractical for mobile devices like autonomous vehicles and mobile phones. Besides, the existing FL frameworks lack a comprehensive consideration of device heterogeneity and security. Most existing studies either focus on matching heterogeneous resources or defending against attacks, failing to provide heterogeneous device management and FL security in a single solution. However, we note that it is rather challenging to design a satisfying FL framework due to the following reasons. 1 Heterogeneous devices have a large variance of local running time. It is hard to synchronize on-device models efficiently. 2 Participants, especially for mobile devices, may have unstable network connections or limited bandwidth, leading to unavailability or synchronizing dropout. 3 Preserving local data privacy contradicts global model learning algorithms. It is hard to balance data privacy and model performance. 4 Securing data confidentiality and integrity against an untrusted server contradicts malicious client detection. Encryption-based FL solutions have trouble finding malicious model updates by leveraging conventional methods efficiently. Having realized the gap between existing FL frameworks and practical demands, we propose an opportunistic federated learning (OFL) framework for resource-heterogeneous and privacy-aware devices, solving the aforementioned challenges simultaneously. OFL uses a hierarchical aggregation protocol to enhance the performance of FL in the presence of heterogeneous devices and data distributions. Notably, multiple factors, including computation, communication, data heterogeneity, availability, and privacy budget, are fully considered by OFL to fulfill practical demands. OFL ensures efficiency by employing an opportunistic updating strategy. When a device is available to communicate, it seizes the opportunity to sync the most crucial part of model parameters based on a well-defined score function. This strategy, coupled with the pruning of updating gradients according to significance and similarity, ensures that the server in OFL can maintain a balanced model performance through periodic re-clustering based on local model states and device availability. For security concerns, OFL utilizes a hybrid solution, combining an advanced threshold fully HE scheme for inter-cluster aggregation with a novel DP mechanism for intra-cluster aggregation. In particular, we design the DP mechanism utilizing the opportunistic updating strategy and pruning, which offers a better balance between privacy budget and model performance than conventional DP mechanisms. Overall, OFL makes the following contributions: • OFL provides a unified solution for resource-heterogeneous and privacy-aware devices, fully considering each device’s resource limitation and data heterogeneity. • OFL adopts an opportunistic model updating strategy, providing stragglers with an optimized syncing option considering device resources and privacy budgets, achieving better resource utilization. • OFL has a hybrid defense with provable security, including a novel DP mechanism and an advanced threshold fully HE scheme. In addition, OFL significantly reduces the additional overhead of protection through the opportunistic updating strategy. • We implement OFL in a real-world testbed using Jetson Xavier NX boards mimicking different devices with various working modes. We evaluate OFL on various learning tasks and settings. Real-world test results and large-scale simulating results indicate that OFL provides satisfying features and outperforms existing work. The source code of OFL implementation will be available after anonymous peer review. 2. Related Work and Motivation Table 1. Comparison of recent solutions for

Read the complete text