Pigeon-SL: Robust Split Learning Framework for Edge Intelligence under Malicious Clients
Sangjun Park, Tony Q.S. Quek, Hyowoon Seo · 2025
Read Pigeon-SL: Robust Split Learning Framework for Edge Intelligence under Malicious Clients by Sangjun Park, Tony Q.S. Quek, Hyowoon Seo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02235.txt.
Introduction
Sangjun Park, Tony Quek, and Hyowoon Seo armor split learning against cheating clients. Their 2025 paper works at the network edge, where a model is split between devices and a server. The step-by-step training chain is fragile: one bad client can poison the whole model. Their scheme leans on the pigeonhole principle.
Clients are split into one more cluster than the count of foes, so at least one cluster must be fully honest. Each cluster trains alone, and only the best-scoring one moves on. A plus version retrains the winner to keep pace with normal training. Under label-flip and gradient attacks, the method held accuracy far better than standard split learning.
Catalog record
| CREATOR | Sangjun Park, Tony Q.S. Quek, Hyowoon Seo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-02235
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pigeon-SL: Robust Split Learning Framework for Edge Intelligence under Malicious Clients Sangjun Park, Tony Q.S. Quek, Hyowoon Seo Abstract Recent advances in split learning (SL) have established it as a promising framework for privacy-preserving, communication-efficient distributed learning at the network edge. However, SL’s sequential update process is vulnerable to even a single malicious client, which can significantly degrade model accuracy. To address this, we introduce Pigeon-SL , a novel scheme grounded in the pigeonhole principle that guarantees at least one entirely honest cluster among M M clients, even when up to N N of them are adversarial. In each global round, the access point partitions the clients into N + 1 N+1 clusters, trains each cluster independently via vanilla SL, and evaluates their validation losses on a shared dataset. Only the cluster with the lowest loss advances, thereby isolating and discarding malicious updates. We further enhance training and communication efficiency with Pigeon-SL+ , which repeats training on the selected cluster to match the update throughput of standard SL. We validate the robustness and effectiveness of our approach under three representative attack models-label flipping, activation and gradient manipulation—demonstrating significant improvements in accuracy and resilience over baseline SL methods in future intelligent wireless networks. I Introduction Distributed machine learning has become essential for processing large-scale datasets and compute-intensive tasks across diverse domains such as healthcare, finance, and robotics, while preserving data privacy and reducing communication overhead. Traditional centralized training, which aggregates raw data at a central server, is often impractical due to privacy concerns, bandwidth limitations, and the volume of edge-generated data. Federated learning (FL) [ 1 , 2 , 3 ] addresses some of these challenges by exchanging model updates instead of raw data, though it still incurs significant communication costs when transmitting full gradients or weights. To further alleviate these limitations, split learning (SL) [ 4 , 5 , 6 ] has emerged as a complementary paradigm that partitions the model into client-side and server-side components. SL transmits only activations and cut-layer gradients, keeping raw data entirely local. This design dramatically reduces communication load and is especially well-suited for resource-constrained, privacy-sensitive environments. Building on these paradigms, SplitFed Learning (SFL) [ 7 ] combines the strengths of FL and SL. It introduces a hybrid architecture where clients train up to the cut layer (as in SL), and a federated server aggregates client-side models via federated averaging. This setup can improve generalization under certain system configurations. However, like FL, SFL exposes client-side models to the server, which may pose privacy risks in sensitive applications. In contrast, SL’s unique advantage lies in sharing only intermediate representations, underscoring its potential for secure learning and motivating further investigation. Despite these advantages, SL presents its own challenges. Its inherently sequential update process means that a single malicious client can inject corrupted activations or gradients, severely disrupting convergence and degrading model performance. While FL has inspired a wide range of Byzantine-robust aggregation techniques and reputation-based defenses [ 8 , 9 , 10 , 11 , 12 , 13 , 14 ] , analogous defense mechanisms for SL remain largely underexplored. This gap highlights the urgent need to develop robust SL frameworks that can withstand adversarial behaviors. To address the lack of robustness in SL, we propose Pigeon-SL , a novel cluster-based defense that leverages the pigeonhole principle to isolate honest updates even when up to N out of M clients are adversarial. In each global round, the access point (AP) randomly partitions the M clients into N{+}1 clusters, independently trains each via vanilla SL, and evaluates their validation losses on a shared dataset. Since all clusters are assessed on the same dataset, the validation loss provides a fair metric of training quality. By selecting the cluster with the lowest loss, Pigeon-SL discards malicious contributions while ensuring at least one entirely honest cluster remains. To compensate for the reduced per-round update throughput caused by clustering, we introduce Pigeon-SL+ . After selecting the best-performing cluster, Pigeon-SL+ continues SL training on it for N additional subrounds, yielding N{+}1 updates per global iteration—matching the throughput of standard SL while preserving robustness. We provide a convergence analysis of Pigeon-SL under standard smoothness and bounded variance assumptions, showing sublinear regret and convergence to a stationary point at rates comparable to existing distributed learning methods. Through simulations of three representative attacks—label flipping, activation tampering, and gradient tampering—we demonstrate that our methods significantly outperform baseline SL in both accuracy and resilience. I-A Related Work I-A 1 Split Learning (SL) SL was first introduced in [ 4 , 5 ] and demonstrated superior communication and computation efficiency compared to other distributed learning paradigms. Since then, SL has been extended in various directions to tackle emerging challenges and applications [ 15 ] . For example, [ 7 ] combines SL with FL to accelerate training, while [ 16 ] introduces communication-aware SL to address channel variability and device heterogeneity in IoT platforms. Parallel SL frameworks with integrated resource management have also been proposed to reduce training latency in wireless edge environments [ 17 , 18 ] . To enhance speed and privacy for mobile applications, [ 19 ] proposes binarizing client-side layers. In terms of privacy, pruning-based SL with differential privacy is introduced in [ 20 ] for secure learning in satellite networks. Moreover, vulnerabilities arising from a malicious server have been identified [ 21 , 22 , 23 ] , and corresponding defense mechanisms have been developed. Despite these advances, comparatively little attention has been given to defending SL systems against attacks from malicious clients—a critical gap our work aims to address. I-A 2 Robust Distributed Learning To address the challenges posed by malicious clients, extensive research has focused on enhancing robustness in distributed learning—particularly within the FL framework. For instance, [ 11 ] proposes a hierarchical audit-based FL scheme for improved reliability and security with minimal overhead, while [ 12 ] introduces reputation-based aggregation and resource optimization to boost training efficiency in wireless FL. In [ 14 ] , a proactive defense mechanism is developed using a federated analytics paradigm. Additional defense strategies against malicious attacks in FL are presented in [ 8 , 9 , 10 , 13 ] . Although robustness has been actively studied in FL, similar efforts for SL remain limited. To safely harness the efficiency advantages of SL in distributed systems, it is crucial to develop robust SL techniques that can withstand adversarial clients. I-B Contributions, Organization and Notations I-B 1 Summarized Contributions • We propose a robust client clustering approach that identifies trustworthy client groups by monitoring cluster-level validation losses. Model updates are performed using the most reliable cluster to mitigate the influence of malicious clients. • To safeguard the validation process, we introduce a tamper-resilient mechanism using shared validation samples, preventing adversaries from manipulating loss values or cluster selection. • We validate the effectiveness of our scheme under three representative tampering attacks, demonstrating superior resilience compared to conventional methods. I-B 2 Organization The remainder of the paper is organized as follows. Section II describes the SL system model. Section III presents the proposed Pigeon-SL method. Section IV provides its convergence analysis. Section V reports simulation results, and Section VI concludes the paper. I-B 3 Notations Throughout the article,