OptiGradTrust: Byzantine-Robust Federated Learning with Multi-Feature Gradient Analysis and Reinforcement Learning-Based Trust Weighting
Mohammad Karami ∗ , Fatemeh Ghassemi † , Hamed Kebriaei † , Hamid Azadegan ‡ · 2025
Read OptiGradTrust: Byzantine-Robust Federated Learning with Multi-Feature Gradient Analysis and Reinforcement Learning-Based Trust Weighting by Mohammad Karami ∗ , Fatemeh Ghassemi † , Hamed Kebriaei † , Hamid Azadegan ‡ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23638.txt.
Introduction
Mohammad Karami, Fatemeh Ghassemi, Hamed Kebriaei, and Hamid Azadegan present a 2025 paper on defending shared learning against cheating participants. Hospitals can train one model together without sharing patient data. But some members may send poisoned updates, and uneven data across sites slows learning as well.
Their defense scores each update with a six part fingerprint. The parts cover rebuild error, direction match, size, sign agreement, and a fairness based value. A hybrid module blends learning based trust weights with attention to score each sender. A second method steadies training across uneven sites. Tests span digits, images, and Alzheimer's scans under attack.
Catalog record
| CREATOR | Mohammad Karami ∗ , Fatemeh Ghassemi † , Hamed Kebriaei † , Hamid Azadegan ‡ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-23638
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OptiGradTrust: Byzantine-Robust Federated Learning with Multi-Feature Gradient Analysis and Reinforcement Learning-Based Trust Weighting Mohammad Karami ∗ , Fatemeh Ghassemi † , Hamed Kebriaei † , Hamid Azadegan ‡ Abstract Federated Learning (FL) enables collaborative model training across distributed medical institutions while preserving patient privacy, but remains vulnerable to Byzantine attacks and statistical heterogeneity. We present OptiGradTrust, a comprehensive defense framework that evaluates gradient updates through a novel six-dimensional fingerprint including VAE reconstruction error, cosine similarity metrics, L 2 L_{2} norm, sign-consistency ratio, and Monte Carlo Shapley value, which drive a hybrid RL-attention module for adaptive trust scoring. To address convergence challenges under data heterogeneity, we develop FedBN-Prox (FedBN-P), combining Federated Batch Normalization with proximal regularization for optimal accuracy-convergence trade-offs. Extensive evaluation across MNIST, CIFAR-10, and Alzheimer’s MRI datasets under various Byzantine attack scenarios demonstrates significant improvements over state-of-the-art defenses, achieving up to +1.6 percentage points over FLGuard under non-IID conditions while maintaining robust performance against diverse attack patterns through our adaptive learning approach. I Introduction In recent years, Federated Learning (FL) has emerged as a powerful paradigm for training deep neural networks across geographically distributed hospitals while preserving patient privacy under stringent regulations such as HIPAA and GDPR [ 1 , 2 , 3 , 4 ] . Recent advances in federated learning for healthcare have shown significant promise in addressing privacy-sensitive medical data challenges through innovative approaches such as secure multi-party computation [ 5 ] and blockchain-enhanced frameworks [ 6 ] while enabling secure collaborative learning across medical institutions. As illustrated in Fig. 1 , this collaborative framework allows medical institutions to exchange model updates rather than raw MRI scans, enabling multi-institutional collaboration—for instance, a small rural hospital with just a handful of Alzheimer’s MRI scans can still contribute to, and benefit from, a model jointly trained with top-tier research centers. However, real-world FL deployments must cope with two intertwined challenges. First, Byzantine updates —malicious or low-quality gradient submissions—can severely skew the global model and compromise clinical reliability [ 7 , 8 ] , arising from hospitals with insufficient labeled data, poor-quality imaging equipment, or adversarial behavior. Second, statistical heterogeneity from variations in imaging protocols and patient demographics leads to non-IID data distributions that undermine conventional aggregation schemes. Even robust methods like FLGuard [ 9 ] , FLTrust [ 10 ] , and FLAME [ 11 ] exhibit reduced performance under severe non-IID conditions combined with Byzantine attacks [ 1 , 12 ] . To overcome these limitations, we present OptiGradTrust, a unified trust framework that assigns each client gradient a comprehensive six-dimensional fingerprint : (1) VAE reconstruction error (detecting distributional anomalies), (2) cosine similarity to a trusted server reference (directional consistency), (3) average similarity to peer updates (consensus alignment), (4) L_{2} norm of the gradient (magnitude analysis), (5) sign-consistency ratio (sign pattern matching), and (6) novel Monte Carlo Shapley value measuring each client’s marginal contribution to global validation performance—a game-theoretic approach that quantifies the actual utility of each gradient update. These complementary metrics feed a hybrid RL-attention based module that dynamically computes trust scores, adaptively reweighting updates during aggregation, while creating a positive incentive structure where high-quality data contributors receive greater influence in the global model. The complete OptiGradTrust pipeline is detailed in Fig. 2 . Fig. 1 : Federated learning architecture for medical applications: hospitals securely exchange gradient updates while the OptiGradTrust server performs trust-aware aggregation. Fig. 2 : OptiGradTrust enhanced pipeline: comprehensive six-dimensional fingerprint analysis with utility-based Shapley value assessment, followed by RL-dual attention mechanism for adaptive trust-weighted gradient aggregation. Moreover, to ensure fast and stable convergence under statistical heterogeneity, we develop FedBN-Prox (FedBN-P), a novel optimizer that integrates Federated Batch Normalization with proximal regularization, delivering superior accuracy-convergence trade-offs compared to eight popular federated optimizers tested on Alzheimer’s MRI dataset. We conduct comprehensive evaluations across MNIST, CIFAR-10, and Alzheimer’s MRI datasets, systematically testing robustness against five distinct Byzantine attack types under both IID and challenging Non-IID distribution scenarios. Against established baselines including FLTrust [ 10 ] , FLAME [ 11 ] , and FLGuard [ 9 ] , OptiGradTrust demonstrates consistent superiority, achieving up to +1.6 percentage points improvement over FLGuard on Alzheimer’s MRI under Non-IID conditions while retaining over 97% accuracy on MNIST and 94% on Alzheimer’s MRI even under extreme heterogeneity. Our main contributions are: (1) OptiGradTrust: a comprehensive trust framework featuring a six-dimensional gradient fingerprint system including novel Monte Carlo-based Shapley value calculation; (2) hybrid RL-attention mechanism: an adaptive trust weighting system that learns to identify emerging attack patterns over time; (3) FedBN-P optimizer: a novel combination of Federated Batch Normalization with proximal regularization for enhanced convergence under heterogeneity; and (4) comprehensive evaluation: demonstrating superior performance across three datasets and five attack scenarios against established baselines. II Related Work Federated learning faces a fundamental dilemma: how can distributed participants collaborate effectively while protecting against malicious actors and handling diverse data distributions? Despite significant progress, existing solutions suffer from critical limitations that prevent their deployment in high-stakes applications like healthcare. This section systematically examines these limitations across four key areas, revealing three fundamental gaps: (1) existing robust aggregators fail to maintain high accuracy under sophisticated attacks, (2) heterogeneity-aware optimizers ignore security threats, and (3) current multi-signal defenses lack adaptive intelligence to counter evolving attacks. II-A Limitations of Existing Approaches Current federated learning defenses fall into three main categories, each addressing different aspects of the problem but failing to provide comprehensive solutions that handle both security and heterogeneity simultaneously. Byzantine-Robust Defenses: Security at the Cost of Accuracy. The first generation of Byzantine-robust aggregators established theoretical foundations but revealed a fundamental limitation: while providing security guarantees, they struggle to maintain high accuracy under sophisticated attacks. Krum pioneered the geometric approach [ 7 ] but suffers from \mathcal{O}(N^{2}) computational complexity and conservative selection that discards valuable benign updates. Statistical approaches through coordinate-wise robust statistics [ 13 ] reduce complexity but remain vulnerable to sophisticated attackers crafting statistically plausible malicious gradients. Geometric–median aggregation (RobustFedAvg) [ 14 , 15 ] represents the current state-of-the-art, yet struggles with 10% accuracy drop when facing 20% attackers. Advanced schemes like Bulyan [ 16 ] , tRFA [ 8 ] , and FLAME [ 11 ] combine multiple defenses but inherit component limitations. Recent adaptive approaches include RL-guided geometric median (RL-GM), where a DDPG agent dynamically adjusts aggregation weights [ 17 ] , demonstrating superior robustness but remaining limited in scope—adapting only aggregation weights while ignoring optimization challenges. Heterogeneity-Aware Optimizers: The Security Blind Spot. A parallel research track addresses statistical heterogeneity but creates a dangerous blind spot: these optimizers achieve impressive performance improvements while remaining completely vulnerable to malicious attacks. In realistic federated settings, participants exhibit vastly different data characteristics, creating heterogeneity that derails aggregation schemes. FedProx introduced proximal regularization \mu\lVert w-w^{t}\rVert_{2}^{2} [ 18 ] , while SCAFFOLD uses control variates [ 19 ] , but both assume honest participation. FedBN represents a breakthrough for medical applications by keeping batch normalization parameters local [ 20 ] , delivering remarkable improvements (over six percentage points in Alzheimer’s MRI classification), but remains defenseless against malicious hospitals. The ecosystem includes FedNova [ 21 ] , FedAdam [ 22 ] , FedDWA [ 23 ] , and RL-driven approaches like FedAA [ 24 ] , but all