Robust Federated Learning for Malicious Clients using Loss Trend Deviation Detection
Deepthy K Bhaskar, Minimol B, Binu V P · 2026
Read Robust Federated Learning for Malicious Clients using Loss Trend Deviation Detection by Deepthy K Bhaskar, Minimol B, Binu V P (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20915.txt.
Introduction
Deepthy Bhaskar, Minimol B, and Binu V P defend federated learning against clients who cheat. Their 2026 paper concerns collaborative training across distributed clients. In federated learning, raw data stays on local devices. Only model updates travel. That design protects privacy, but it opens a door to abuse. Malicious or unreliable clients can send misleading updates. Those updates can harm the shared model's performance and reliability.
The authors propose detection based on loss trend deviation. Honest training shows a steady loss pattern over rounds. A client whose loss trend strays in odd ways stands out. Flagging such clients protects the global model without reading their data. The method serves hospitals, banks, and phone networks that train together. It adds a guard where trust cannot be assumed.
Catalog record
| CREATOR | Deepthy K Bhaskar, Minimol B, Binu V P |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20915
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust Federated Learning for Malicious Clients using Loss Trend Deviation Detection Deepthy K Bhaskar, Minimol B, Binu V P Abstract Federated Learning (FL) facilitates collaborative model training among distributed clients while ensuring that raw data remains on local devices.Despite this advantage, FL systems are still exposed to risks from malicious or unreliable participants. Such clients can interfere with the training process by sending misleading updates, which can negatively affect the performance and reliability of the global model. Many existing defense mechanisms rely on gradient inspection, complex similarity computations, or cryptographic operations, which introduce additional overhead and may become unstable under non-IID data distributions. In this paper, we propose the Federated Learning with Loss Trend Detection (FL-LTD), a lightweight and privacy-preserving defense framework that detects and mitigates malicious behavior by monitoring temporal loss dynamics rather than model gradients. The proposed approach identifies anomalous clients by detecting abnormal loss stagnation or abrupt loss fluctuations across communication rounds. To counter adaptive attackers, a short-term memory mechanism is incorporated to sustain mitigation for clients previously flagged as anomalous, while enabling trust recovery for stable participants. We evaluate FL-LTD on a non-IID federated MNIST setup under loss manipulation attacks. Experimental results demonstrate that the proposed method significantly enhances robustness, achieving a final test accuracy of 0.84, compared to 0.41 for standard FedAvg under attack. FL-LTD incurs negligible computational and communication overhead, maintains stable convergence, and avoids client exclusion or access to sensitive data, highlighting the effectiveness of loss-based monitoring for secure federated learning. keywords Federated Learning, Security, Malicious Clients, Loss Manipulation Attack, Anomaly Detection 1 Introduction The rapid proliferation of data-driven applications across domains such as healthcare, finance, and smart infrastructures has accelerated the adoption of collaborative machine learning paradigms. Traditional centralized learning approaches require aggregating raw data at a central server, which raises serious privacy, regulatory, and security concerns. Federated Learning has emerged as a promising alternative by enabling multiple clients to jointly train a shared model while keeping their data local mcmahan2017communication ; konevcny2016federated . This decentralized training paradigm significantly reduces privacy risks and has been adopted in several real-world systems. Recent studies have emphasized the importance of privacy-preserving and secure machine learning in distributed environments, particularly in federated learning systems bhaskar2023review . While cryptographic approaches such as homomorphic encryption provide strong privacy guarantees, they often introduce significant computational overhead bhaskar2025diabetes . Despite its advantages, federated learning is inherently vulnerable to malicious or unreliable participants. Since the central server does not have access to client data, it must rely on received model updates, which can be intentionally manipulated to poison the global model or unintentionally degraded due to noisy or low-quality local training. Prior studies have shown that even a single adversarial client can severely compromise model performance through poisoning or manipulation attacks bhagoji2019analyzing ; fang2020local . These vulnerabilities pose critical challenges to the deployment of FL in safety-critical and privacy-sensitive environments. To address these issues, a variety of robust aggregation and defense mechanisms have been proposed. Gradient-based defenses, such as coordinate-wise median and trimmed mean aggregation, attempt to suppress malicious updates by identifying outliers in the gradient space yin2018byzantine ; blanchard2017machine . However, such approaches often rely on strong assumptions about data distributions and can be unstable under non-IID settings, which are common in practical FL deployments. Moreover, inspecting gradients or model updates may inadvertently leak sensitive information and increase computational overhead zhu2019deep ; geiping2020inverting . Recent studies have explored federated learning as an effective framework for scalable optimization in distributed systems bhaskar2025parallel . More recent works have explored trust-aware and reputation-based mechanisms, where client contributions are weighted based on historical behavior kang2019reliable ; li2021learning . While effective, many of these methods require complex similarity computations, auxiliary validation datasets, or long-term profiling of clients, which may conflict with privacy principles and practical constraints. Therefore, there remains a need for lightweight, privacy-preserving defense mechanisms that can robustly mitigate malicious behavior without inspecting gradients or accessing client data. In this work, we propose FL-LTD, a simple yet effective defense framework for federated learning. Unlike existing approaches that operate in the gradient space, the proposed method relies solely on monitoring the temporal evolution of client-reported training loss. By analyzing relative loss changes across communication rounds, the server can identify abnormal behaviors such as abrupt loss spikes indicative of poisoning attacks, as well as stagnation patterns associated with unreliable or free-riding clients. To further enhance robustness against adaptive adversaries, a short-term memory mechanism is introduced to sustain mitigation across multiple rounds while allowing trust recovery for stable clients. The proposed approach offers several key advantages. First, it is fully compatible with standard FL workflows and introduces negligible computational and communication overhead. Second, it preserves privacy by avoiding gradient inspection, auxiliary datasets, or long-term client profiling. Finally, it provides an interpretable and stable mitigation strategy through adaptive down-weighting rather than client exclusion. Extensive experiments on a non-IID federated MNIST setup demonstrate that FL-LTD significantly improves robustness under loss manipulation attacks, achieving substantially higher accuracy compared to standard FedAvg. The remainder of this paper is organized as follows. Section 2 reviews related work on robust federated learning. Section 3 presents the proposed FL-LTD framework in detail. Experimental results and analysis are provided in Section 4 , followed by conclusions and future directions in Section 5 . 2 Related Work Federated Learning is vulnerable to poisoning and Byzantine behaviors because the server typically aggregates client updates without seeing raw data. Recent journal research broadly falls into three practical defense directions: (i) robust aggregation rules, (ii) malicious-client detection and filtering, and (iii) privacy-preserving (encrypted) yet robust aggregation. 2.1 Robust aggregation under Byzantine/poisoning A common line of work improves robustness by changing the aggregation operator so that a small fraction of corrupted updates cannot dominate the global model. Geometric-median style robust aggregation has been analyzed and empirically validated as a strong baseline for Byzantine robustness in FL settings Pillutla2022RFA . More recently, behavior-based robust aggregation methods shift the focus from raw parameter similarity to how local models behave on carefully constructed or auxiliary representations. For example, RFVIR proposes detecting Byzantine clients through feature representations on a virtual dataset and removing anomalies before aggregation, showing robustness especially under non-IID partitions Wang2024RFVIR . Another direction is to minimize the dispersion of client updates: the variance-minimization approach explicitly constrains update variance to defend against model poisoning while preserving training utility Xu2024MinVar . Dynamic robust aggregation has also been explored; FedRDF uses a dynamic rejection/weighting mechanism to reduce poisoning influence without requiring a fixed global threshold Campos2025FedRDF . 2.2 Detection and auditing of malicious contributions Instead of (or in addition to) robust aggregation, several works add a detection layer to identify suspicious clients or suspicious rounds. DPAD introduces an audit-based mechanism to verify client updates before including them in aggregation and reports improved robustness under poisoning scenarios Basak2025DPAD . Detection is particularly challenging when attackers vary strategies over time or perform multi-label manipulations. Scientific Reports (2025) proposes extracting discriminative gradient features from the output layer and applying clustering to separate benign vs. malicious participants under multi-label flipping attacks Ma2025MultiLabel . 2.3 Privacy-preserving robust FL under secure aggregation Secure aggregation and homomorphic encryption improve confidentiality but make server-side defenses harder because the server cannot inspect plaintext