Stealth by Conformity: Evading Robust Aggregation through Adaptive Poisoning

Ryan McGaughey 1 , Jesús Martínez del Rincón 2 and Ihsen Alouani 3 · 2025

Read Stealth by Conformity: Evading Robust Aggregation through Adaptive Poisoning by Ryan McGaughey 1 , Jesús Martínez del Rincón 2 and Ihsen Alouani 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08746.txt.

Introduction

Ryan McGaughey and 2 co-authors challenge a core belief about defenses in federated learning in a 2025 paper. In federated learning, many clients train a shared model without pooling raw data. Robust aggregation tries to spot and exclude harmful client updates.

Their Chameleon Poisoning keeps harmful updates inside the main distribution, so they look normal. Feedback from aggregation tells the attacker whether its update was accepted. The attacker then balances a harmful part with a camouflage part. Across two datasets, attack success rises sharply against nine defenses. The result shows detection based on outliers alone is not enough.

Catalog record

CREATORRyan McGaughey 1 , Jesús Martínez del Rincón 2 and Ihsen Alouani 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08746

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stealth by Conformity: Evading Robust Aggregation through Adaptive Poisoning Thanks: This PhD project receives funding from the Cyber AI Hub Doctoral Training Program at CSIT, Queen’s University Belfast, supported by the UK Government as part of the New Deal for Northern Ireland, administered through Innovate UK/UKRI. Ryan McGaughey 1 , Jesús Martínez del Rincón 2 and Ihsen Alouani 3 Abstract Federated Learning (FL) is a distributed learning paradigm designed to address privacy concerns. However, FL is vulnerable to poisoning attacks, where Byzantine clients compromise the integrity of the global model by submitting malicious updates. Robust aggregation methods have been widely adopted to mitigate such threats, relying on the core assumption that malicious updates are inherently out-of-distribution and can therefore be identified and excluded before aggregating client updates. In this paper, we challenge this underlying assumption by showing that a model can be poisoned while keeping malicious updates within the main distribution. We propose Chameleon Poisoning ( ChamP ), an adaptive and evasive poisoning strategy that exploits side-channel feedback from the aggregation process to guide the attack. Specifically, the adversary continuously infers whether its malicious contribution has been incorporated into the global model and adapts accordingly. This enables a dynamic adjustment of the local loss function, balancing a malicious component with a camouflaging component, thereby increasing the effectiveness of the poisoning while evading robust aggregation defenses. ChamP enables more effective and evasive poisoning, highlighting a fundamental limitation of existing robust aggregation defenses and underscoring the need for new strategies to secure federated learning against sophisticated adversaries. Our approach is evaluated in two dataset reaching an average increase of 47.07% in attack success rate against nine robust aggregation defenses. I Introduction Federated Learning (FL) was introduced in [ 1 ] as a distributed training paradigm designed to enhance privacy by keeping data on client devices. Instead of sharing raw data, only model parameters are exchanged, thereby mitigating many of the privacy risks inherent to centralized learning. This makes FL especially valuable in data-sensitive domains, where client data must remain local and protected against potential leakage. Under this framework, in each round of FL training, each client trains a local model on its private dataset, then transmits the model updates (e.g., gradients or weights) to a central server, which aggregates these updates—typically via weighted averaging based on dataset size— to produce a refined global model, which is then redistributed to clients. In the original FL setup proposed in [ 1 ] , FedAvg was proposed as the aggregation scheme. This aggregation was done by taking the parameter by parameter average update to the server by each client. Fig. 1 : Conceptual description of our adaptive poisoning attack against a RA scheme. Data points represent instances of model updates \Delta\theta . While FL mitigates many traditional privacy risks and provides a scalable alternative to centralized learning, its decentralized nature also introduces new vulnerabilities. Since the central server has no direct access to client data, it must trust the updates provided by participating clients. This exposes the system to poisoning attacks, where malicious or Byzantine clients deliberately craft updates to manipulate the global model [ 2 ] . Unlike random noise or benign irregularities, these adversarial updates are designed to degrade model performance, introduce targeted misclassifications, or embed hidden backdoors; all while evading detection [ 3 , 4 , 5 ] . To mitigate the risk of poisoning, a prominent line of defense in FL has been the development of Robust Aggregation (RA) methods. The core rationale of these methods is that malicious updates can be distinguished from benign ones because they are expected to deviate significantly from the majority. By assuming that most clients behave honestly and that adversarial contributions are statistical outliers, RA seeks to preserve the integrity of the global model through anomaly-resistant techniques such as trimmed mean, coordinate-wise median, or geometric approaches [ 6 , 7 , 8 ] . In practice, these methods attempt to filter or exclude suspicious updates before aggregation, thereby preventing Byzantine clients from disproportionately influencing the model. This approach, however, relies on a critical assumption: that malicious updates are inherently out-of-distribution relative to benign ones. In this paper, we challenge that assumption, showing that poisoning can remain both effective and statistically consistent with benign updates. Our rationale is twofold. First, modern FL operates in very high-dimensional parameter spaces with heterogeneous clients, so benign updates naturally exhibit broad, anisotropic variability. Common robust aggregators, such as coordinate-wise trimming/median, geometric median, Krum variants, instantiate “out-of-distribution” via deviation rules whose acceptance regions widen along directions of natural variance. We exploit this by designing an adaptive, camouflaged poisoning method that shapes its updates to remain within typical ranges, norms, and angular similarities, while subtly steering the global model in task-critical directions. Second, deep networks have steep, non-convex loss landscapes: small, well-placed parameter shifts can induce disproportionately large behavioral changes. From this perspective, our problem formulation is the dual of adversarial examples problem. Whereas adversarial attacks constrain perturbations (e.g., by projecting into an \ell_{p} -norm ball in the input space) our method operates in the parameter-update space, keeping updates within the robust aggregator’s “acceptable” range as implied by honest variability and deviation thresholds. The adversarial updates dual problem is outlined conceptually in Fig. 1 . This, however, raises a key challenge: how can we reliably steer updates into the acceptable region without white-box access to the server or its aggregation rule? To address this challenge, we extract side-channel feedback from the aggregated model. After each round, the updated global model is probed and a targeted membership-inference test is run by the malicious client on the poisoned/backdoor set to estimate whether—and to what extent—the malicious contribution has been incorporated by the aggregator. The resulting signal —binary or graded— drives an adaptive regularization term that updates the camouflage component of the local objective, dynamically rebalancing attack strength against distributional conformity. This feedback mechanism enables black-box steering of updates into the aggregator’s acceptance region while sustaining poisoning efficacy across rounds. We evaluate our attack on nine state-of-the-art RA methods from different categories, including coordinate-wise, distance-based, and clustering-based approaches, and show that all of them fail to provide robustness against our approach. Our experiments demonstrate that robust aggregation schemes remain vulnerable to adaptive adversaries, challenging the prevailing assumption that robust aggregation ensures resilience, and redefining the threat model for secure FL. The main contributions of this paper are as follows: • We propose a new attack strategy that adaptively camouflages malicious updates to evade detection. The attack dynamically balances a malicious objective with a camouflage loss to keep updates within the acceptance region of robust aggregators. • The camouflage loss regularization term is updated continuously based on a side-channel information that we collect from the aggregated model. We introduce a black-box feedback mechanism that estimates whether the adversary’s contribution has been incorporated into the aggregated model. This signal is extracted through membership inference on the poison/backdoor data and is used to adaptively regulate the camouflage loss. • We evaluate the attack across multiple datasets, model architectures, and robust aggregation techniques. Results show that our method consistently evades robust aggregation, achieving high poisoning success rates while maintaining statistical conformity with benign updates. II Background II-A Federated Learning

Read the complete text