Evaluating the Robustness of Adversarial Defenses in Malware Detection Systems
Mostafa Jafari, Alireza Shameli-Sendi · 2025
Read Evaluating the Robustness of Adversarial Defenses in Malware Detection Systems by Mostafa Jafari, Alireza Shameli-Sendi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09342.txt.
Introduction
Mostafa Jafari and Alireza Shameli-Sendi attack the defenses of machine-learning malware detectors, in a 2025 paper. Android detectors can be dodged by tiny edits, and binary features make those edits awkward to craft. The authors add a rounding method that keeps attacks strong in binary space and a new sigma-binary attack that reaches its goal with few feature flips.
Against detector-guarded defenses, their attack succeeded over ninety percent of the time with under ten changes. Even hardened, adversarially trained models fell at high rates once the budget grew, and the strongest prior defense dropped from resisting most attacks to failing nearly every unrestricted attempt. The authors argue defenses must be graded with attacks built for binary data.
Catalog record
| CREATOR | Mostafa Jafari, Alireza Shameli-Sendi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-09342
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating the Robustness of Adversarial Defenses in Malware Detection Systems Mostafa Jafari, Alireza Shameli-Sendi Abstract Machine learning (ML) has become a vital tool in Android malware detection, effectively identifying malicious patterns in applications to combat the growing threat of malware. However, ML-based systems remain highly vulnerable to evasion attacks, where subtle perturbations can bypass detection mechanisms. Despite efforts to develop adversarially robust malware detection systems, the lack of comprehensive evaluation frameworks for state-of-the-art defenses in this domain limits the thorough understanding of their effectiveness. This study introduces two key contributions to advance adversarial evaluation in binary-constrained domains. First, we propose Prioritized Binary Rounding , a technique that efficiently transforms continuous adversarial perturbations into binary spaces while preserving high attack success rates and minimizing perturbation size. Second, we develop the σ \sigma -binary attack , a novel adversarial attack specifically tailored for binary domains, designed to achieve adversarial objectives with minimal perturbations while maintaining compatibility with binary feature constraints. Extensive evaluations on the Malscan dataset demonstrate the superiority of the proposed approach. σ \sigma -binary consistently outperforms existing adversarial methods, including CW, σ \sigma -zero, Mimicry, and PGD-based attacks, across both robust and non-robust defenses in terms of attack success rate and perturbation size. Furthermore, our analysis of state-of-the-art defenses using σ \sigma -binary reveals critical vulnerabilities. Defenses equipped with adversary detectors, such as KDE, DLA, DNN + , and ICNN, exhibit significant brittleness, with attack success rates exceeding 90% for fewer than 10 feature modifications and reaching 100% with a 20-feature perturbation budget. Adversarially trained defenses, including AT-rFGSM k and AT-MaxMA, exhibit improved robustness at lower budgets but remain highly susceptible to unrestricted perturbations, with attack success rates of 99.45% and 96.62%, respectively. Although PAD-SMA has been demonstrated to maintain a high accuracy above 83.45% (equivalent to an attack success rate below 16.55%) against 15 gradient-based attacks without perturbation limits, our analysis reveals significant vulnerabilities. The σ \sigma -binary attack achieves a 36.34% success rate against PAD-SMA with fewer than 10 modified features, increasing to 94.56% under unrestricted perturbations. These findings underscore the importance of precise evaluation tools, such as σ \sigma -binary, to uncover latent weaknesses in existing defenses and guide the development of more robust malware detection systems. I Introduction The surge in mobile device attacks has escalated into a critical global concern. In 2023 alone, such attacks increased by 50% compared to the previous year. According to Kaspersky, their systems blocked 33.8 million instances of malware, adware, and riskware targeting mobile devices, with Android remaining the primary focus of cybercriminals [ 1 ] . This significant increase in Android malware underscores the urgent need for advanced detection strategies to counter increasingly sophisticated threats. Machine learning (ML) has become a cornerstone of Android malware detection, significantly improving scalability and detection precision [ 2 , 3 , 4 , 5 , 6 ] . Among ML-based approaches, static analysis methods, such as Drebin [ 4 ] and MaMaDroid [ 7 ] , have demonstrated notable efficiency. These methods analyze application features without requiring execution, enabling rapid and scalable security assessments. Consequently, static analysis has become a foundational component of modern malware detection pipelines. Despite these advancements, ML-based malware detectors are inherently vulnerable to adversarial attacks. These attacks exploit weaknesses in detection models by introducing carefully crafted perturbations to evade detection. Such attacks, which undermine reliability, are broadly categorized into evasion and poisoning attacks. Evasion attacks manipulate test examples during the deployment phase to bypass detection [ 8 , 9 , 10 , 11 , 12 ] , whereas poisoning attacks compromise training datasets to degrade detector performance [ 13 , 14 ] . This study focuses on evasion attacks because of their immediate implications for operational systems. Evasion attacks can be further divided into problem-space and feature-space attacks. Problem-space attacks modify malware applications directly, such as injecting benign ”gadgets” or altering application components to obscure malicious intent [ 15 , 16 , 17 ] . In contrast, feature-space attacks modify feature vectors extracted from malware while preserving the functionality of the original sample [ 9 , 8 ] . This study focuses exclusively on feature-space attacks because of their controlled evaluation capabilities and practical relevance. Defending against adversarial attacks remains a significant challenge. Adversarial training, which incorporates adversarial samples into training datasets, has shown promise in improving robustness [ 8 ] . However, these methods often fail to generalize to novel attack strategies, impose high computational costs, and risk overfitting to specific attacks [ 18 ] . Other defense mechanisms such as ensemble methods [ 19 , 20 , 21 ] , auxiliary models such as Variational Autoencoders (VAEs) [ 22 ] , and hybrid frameworks such as PAD-SMA [ 23 ] offer varying degrees of effectiveness. However, these approaches frequently involve trade-offs, including increased complexity and reduced detection accuracy. I-A Our Contributions Evaluating the adversarial robustness of malware defenses in binary space presents significant challenges. Existing approaches encounter two critical limitations. First, gradient-based attacks originally designed for continuous spaces are often adapted to binary domains using naive binarization techniques such as Deterministic and Randomized Binary Rounding, which significantly reduce their effectiveness (e.g., [ 9 ] ). Additionally, the absence of a gradient-based attack designed for binary spaces arises from the inherent complexity of optimization within a non-convex and non-differentiable constraint space, further exacerbating this limitation. Second, these methods rely on subjective methodologies and generalized attack strategies, employing low-iteration gradient-based attacks with fixed hyperparameters across all defenses without optimizing them to individual models (e.g., [ 23 , 22 , 24 , 20 , 25 ] ). This combination of attack incompatibility with binary-constrained domains and insufficient optimization prevents these methods from effectively exposing vulnerabilities in defense mechanisms. To address the challenges of evaluating adversarial robustness in binary-constrained domains, this study introduces a novel framework tailored for thorough assessment of defenses. The key contributions of our research are as follows: First, we propose Prioritized Binary Rounding , an innovative technique for transforming gradient-based attacks from continuous to binary spaces. Extensive evaluations on the Malscan dataset [ 26 ] , encompassing four defenses (DNN, AT-rFGSM , AT-MaxMA, and PAD-SMA) and two attack scenarios ( \sigma -zero and CW attacks, optimizing \ell_{0} -norm and \ell_{2} -norm , respectively), demonstrate its superiority over Deterministic and Randomized Binary Rounding in terms of both attack success rate and perturbation size IV-B . For the \sigma -zero attack, Prioritized Binary Rounding achieves results nearly identical to continuous outputs, minimizing feature modifications while maintaining high attack success rates: 100\% on DNN (compared with 94.88% for the second-best method), 85.95\% on AT-rFGSM (vs. 78.64\% ), 92.56\% on AT-MaxMA (vs. 81.31\% ), and 79.64\% on PAD-SMA (vs. 69.91\% ). For the CW attack, it effectively addresses the challenge of binarizing small fractional perturbations, achieving 100\% success on DNN (vs. 49.45\% ), 68.36\% on AT-rFGSM (vs. 26.10\% ), 65.37\% on AT-MaxMA (vs. 37.18\% ), and 36.82\% on PAD-SMA (vs. 8.25\% ). Second, we introduce \sigma -binary attack , a novel adversarial method specifically designed for binary-constrained domains. This attack leverages a differentiable approximation of the Hamming distance, which is a key metric for binary vectors, to facilitate an effective gradient-based optimization. Furthermore, it incorporates dynamic confidence adjustment, enabling the optimization