Exploring Secure Machine Learning Through Payload Injection and FGSM Attacks on ResNet-50
Umesh Yadav 1 , Suman Niroula 2 , Gaurav Kumar Gupta 3 Bicky Yadav 4 · 2025
Read Exploring Secure Machine Learning Through Payload Injection and FGSM Attacks on ResNet-50 by Umesh Yadav 1 , Suman Niroula 2 , Gaurav Kumar Gupta 3 Bicky Yadav 4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02147.txt.
Introduction
Umesh Yadav and co-authors probe how a top image model breaks under two stealth attacks, in a 2025 paper. Their target is ResNet-50, a widely used image classifier. One attack, the fast gradient sign method, nudges pixels by a rule tied to the model's own gradients. The other slips a hidden payload into inputs. On clean images, the model scored barely over half right.
Under gradient nudges, its hit rate held, yet its confidence in wrong calls rose sharply. The payload scheme landed in the vast bulk of test samples, bending calls with no visible damage to the image. The team warns that strong models need tougher shields for security-critical use.
Catalog record
| CREATOR | Umesh Yadav 1 , Suman Niroula 2 , Gaurav Kumar Gupta 3 Bicky Yadav 4 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02147
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploring Secure Machine Learning Through Payload Injection and FGSM Attacks on ResNet-50 Umesh Yadav 1 , Suman Niroula 2 , Gaurav Kumar Gupta 3 Bicky Yadav 4 Abstract This paper investigates the resilience of a ResNet-50 image classification model under two prominent security threats: Fast Gradient Sign Method (FGSM) adversarial attacks and malicious payload injection. Initially, the model attains a 53.33% accuracy on clean images. When subjected to FGSM perturbations, its overall accuracy remains unchanged; however, the model’s confidence in incorrect predictions notably increases. Concurrently, a payload injection scheme is successfully executed in 93.33% of the tested samples, revealing how stealthy attacks can manipulate model predictions without degrading visual quality. These findings underscore the vulnerability of even high-performing neural networks and highlight the urgency of developing more robust defense mechanisms for security-critical applications. I Introduction In the modern landscape of cybersecurity, machine learning (ML) models, especially in areas like image classification, are increasingly integrated into systems where robustness and security are paramount. However, these models are highly susceptible to adversarial attacks, where small, crafted perturbations can lead to incorrect predictions and, in more severe cases, unauthorized access or manipulation of systems [ 2 ] . Such attacks expose fundamental weaknesses in ML models, undermining their performance and reliability in critical applications. Adversarial learning has attracted substantial attention in AI and ML research due to its potential to expose vulnerabilities in otherwise robust models. By adding minor, often imperceptible perturbations to input data, adversarial attacks can force models into making incorrect predictions [ 9 ] . This poses serious risks, especially in critical sectors such as autonomous driving and facial recognition. This report explores the impact of adversarial attacks on a pre-trained convolutional neural network (CNN) for image classification, specifically ResNet50. ResNet50 is a deep residual network with 50 layers, known for its high performance in image classification tasks [ 6 ] . Additionally, we will implement the Fast Gradient Sign Method (FGSM) attack to to demonstrate the susceptibility of even high-performing models to subtle perturbations. FGSM is a white-box attack that uses the gradient of the loss with respect to the input data to create adversarial examples [ 5 ] .In this project, we explore the intersection of cybersecurity and adversarial attacks through the implementation of both payload injection and FGSM attacks on ResNet50. The goal is to assess how resilient such models are to attacks that combine adversarial noise with malicious payloads, highlighting the potential risks in real-world cybersecurity applications such as facial recognition, autonomous systems, and access control mechanisms. II Motivation and Problem Defination As ML models continue to integrate into critical cybersecurity systems, the ability to exploit these models through adversarial techniques poses significant threats. A study predicts that by 2025, 30% of cyberattacks will involve adversarial machine-learning tactics [ 16 ] . Pre-trained models are susceptible to perturbations adversarial attacks, which can undermine trust in AI systems due to the lack of customized defensive measures during training. For example, in an autonomous driving scenario, a manipulated stop sign image could be misclassified, potentially leading to catastrophic consequences [ 13 ] . In facial recognition systems, for example, a carefully crafted adversarial attack could allow an unauthorized user to bypass authentication systems, leading to severe security breaches [ 11 ] [ 12 ] . Another issue is payload injection, where malicious inputs are crafted not only to fool the model but also to execute harmful actions, potentially compromising the entire system. A study estimates that over 41% of companies using AI report concerns about adversarial attacks on their systems [ 16 ] . The combination of adversarial perturbations and malicious payloads exposes vulnerabilities in widely used ML models, especially those deployed in high-stakes environments like security access control, intrusion detection systems, and network defense mechanisms. II-A Usages Examples and Scenarios The relevance of adversarial attacks is profound in domains where security and precision are critical. In facial recognition systems, adversarial attacks could enable unauthorized access. Similarly, adversarial noise in medical imaging could lead to incorrect diagnoses, potentially jeopardizing patient health. This project simulates adversarial conditions in a controlled setting, using a pre-trained image classification model, to better understand and address these vulnerabilities. Below is the sequence followed in this project: 1. Start 2. Load a clean image. 3. Get a prediction on the clean image. 4. Inject payload into the image. 5. FGSM attack on both clean and injected images. 6. Get a prediction on modified both images from step 5. 7. Extract the payload from the injected image. This workflow allows us to assess the model’s performance under various attack scenarios and evaluate the effectiveness of payload injection and extraction II-B Problem Definition The primary focus of this research is to evaluate the resilience of a pre-trained image classification model, ResNet50, to adversarial attacks that include both perturbations and malicious payload injection. We investigate how adversarial perturbations affect model accuracy and assess the success rate of payload injection attacks. Even minor perturbations can lead to significant misclassifications, and this project seeks to demonstrate how vulnerable popular pre-trained models like ResNet50 are in adversarial conditions. III Related Work Research on adversarial attacks has been a focal point in machine learning (ML), particularly in the context of image classification and security-sensitive applications. The concept of adversarial examples was first introduced by Goodfellow et al. (2015), who demonstrated that even small, imperceptible perturbations to input data could lead to significant misclassifications in neural networks [ 5 ] . This breakthrough spurred the development of various attack techniques, including the Fast Gradient Sign Method (FGSM), which uses the gradient of the loss function with respect to the input data to generate adversarial examples [ 5 ] . Subsequent works such as the Projected Gradient Descent (PGD) method further refined adversarial attacks, making them more robust and harder to defend against [ 8 ] . In cybersecurity, adversarial attacks have raised concerns about the security and robustness of machine learning models, especially when deployed in high-stakes environments. For example, in autonomous driving systems, adversarial attacks can manipulate stop sign images, causing vehicles to misinterpret critical road signs, as demonstrated by Sitawarin et al. (2018) [ 13 ] . This illustrates how adversarial perturbations can lead to severe real-world consequences when they exploit vulnerabilities in image classification models. Similarly, adversarial examples have been shown to compromise facial recognition systems, allowing attackers to bypass security protocols and gain unauthorized access [ 11 ] [ 12 ] . The threat posed by adversarial examples extends beyond misclassifications, with the potential to enable malicious actions, such as manipulating security systems or causing critical failures in autonomous systems. One of the significant advancements in adversarial attacks has been the integration of payload injection techniques. In this approach, adversarial examples not only mislead the model into making incorrect predictions but also embed malicious payloads that can compromise the entire system. For example, Yuan et al. (2019) explored how adversarial payloads can be injected into images, altering their underlying data without changing their visual appearance [ 17 ] . This allows attackers to manipulate systems without triggering alarms, making it a potent tool for bypassing security mechanisms. Furthermore, Shen et al. (2021) demonstrated the effectiveness of such attacks