Uncovering and Understanding FPR Manipulation Attack in Industrial IoT Networks

Mohammad Shamim Ahsan, Peng Liu · 2026

Read Uncovering and Understanding FPR Manipulation Attack in Industrial IoT Networks by Mohammad Shamim Ahsan, Peng Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14505.txt.

Introduction

Mohammad Shamim Ahsan and Peng Liu study a blind spot in network security in this 2026 paper. Machine learning-based network intrusion detection systems sort packets into benign and attack classes. Attacks on such systems are usually framed one way: attack packets perturbed so they are misclassified as benign. Practical issues like imbalanced data shaped that belief.

The reverse case has been largely ignored. A maliciously perturbed benign packet can be misclassified as an attack. The authors call this FPR manipulation, since it inflates the false positive rate. Their study uncovers how the attack works in industrial IoT networks. Readers get a warning about a threat that can flood defenders with fake alarms.

Catalog record

CREATORMohammad Shamim Ahsan, Peng Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14505

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncovering and Understanding FPR Manipulation Attack in Industrial IoT Networks Mohammad Shamim Ahsan, Peng Liu Abstract In the network security domain, due to practical issues – including imbalanced data and heterogeneous legitimate network traffic – adversarial attacks in machine learning-based NIDSs have been viewed as attack packets misclassified as benign . Due to this prevailing belief, the possibility of (maliciously) perturbed benign packets being misclassified as attack has been largely ignored. In this paper, we demonstrate that this is not only theoretically possible, but also a particular threat to NIDS. In particular, we uncover a practical cyberattack, FPR manipulation attack (FPA), especially targeting industrial IoT networks, where domain-specific knowledge of the widely used MQTT protocol is exploited and a systematic simple packet-level perturbation is performed to alter the labels of benign traffic samples without employing traditional gradient-based or non-gradient-based methods. The experimental evaluations demonstrate that this novel attack results in a success rate of 80.19% to 100%. In addition, while estimating impacts in the Security Operations Center, we observe that even a small fraction of false positive alerts, irrespective of different budget constraints and alert traffic intensities, can increase the delay of genuine alerts investigations up to 2 hr in a single day under normal operating conditions. Furthermore, a series of relevant statistical and XAI analyses is conducted to understand the key factors behind this remarkable success. Finally, we explore the effectiveness of the FPA packets to enhance models’ robustness through adversarial training and investigate the changes in decision boundaries accordingly. I Introduction In the critical field of network security, the expected performance of a network intrusion detection system (NIDS) is determined through the operation point , i.e., the selected FNR-FPR (False Negative Rate-False Positive Rate) tradeoff point on the ROC (Receiver Operating Characteristic) curve, chosen by the Security Operations Center (SOC) during deployment. However, operation point drift , induced by adversarial attacks, could result in a significant deviation from expected performance. Therefore, investigating operation point drift is paramount to gain awareness of the real NIDS performance. When successful adversarial evasion attacks [ 3 , 84 , 41 , 69 , 29 , 85 , 68 , 20 , 81 ] are in presence, the previously-chosen operation point would drift to a new position in the ROC space where the x-axis represents the FPR, while the y-axis represents the TPR (True Positive Rate). Because the evasion attacks result in false negatives, the drifting direction would be up-and-down, that is, the new position has a smaller y-coordinate, but the x-coordinate remains unchanged. Although drifting along the side-to-side direction is theoretically possible, only up-and-down drifting has been reported in the literature. In this paper, we demonstrate that side-to-side operation point drifting is not only theoretically possible, but also a practical threat to NIDS effectiveness. The demonstration is achieved through a newly uncovered FPR manipulation attack (FPA, in short) against machine learning-based NIDSs defending industrial internet of things (IIoT) networks. Regarding whether this is a profound research finding, our main observations are associated with not only signature-based NIDS but also ML-based NIDS. First of all, we found that FPR manipulation attack can indeed result in very serious real-world consequences, particularly the investigations of genuine threats can drastically be hampered, making the network more vulnerable to actual attacks. Our experiments, conducted in § V-C , show that a relatively small number of false alarms caused by FPA can lead to several hours of delay in investigating genuine alerts, even under normal cyber operation conditions. Second, from the point of view of signature-based NIDS (e.g., Snort [ 61 ] , Bro [ 57 ] ), although benign traffic could be theoretically perturbed while remaining benign and cause NIDS to raise false alarms, a signature-based NIDS usually does not provide realistic opportunities for such perturbations to succeed. In particular, signature-based NIDSs have one property: there is a notable distance between the clean, precise signatures and slightly perturbed benign traffic. Consequently, slight perturbations without violating any network protocol constraints are unlikely to result in a considerable deviation. Third, from an ML‑NIDS perspective, researchers tend to treat “adversarial examples” and “attack packets” equivalently, though this belief does have a logic gap , since benign packets could also serve as adversarial examples in the ML context. Many researchers are probably aware of this logic gap, but it is clear that the logic gap has not been taken seriously. Reflecting on why it has not been received sufficient attention, we found two possible reasons: (Reason 1) ML-based NIDS is often developed to address the limitations of signature-based NIDS, but as mentioned above, slightly perturbed benign traffic is unlikely to trigger a signature-based NIDS to raise alarms. (Reason 2) Due to several real-world considerations, researchers tend to assume that evasion attacks are more realistic than FPR manipulation attacks. Here, we illustrate two such real-world considerations. (a) Imbalanced data is a widely existing issue for ML-based NIDS [ 88 , 1 , 21 ] . Since the amount of benign packets is usually much greater than that of attack packets in the training dataset, researchers are of the view that the trained model has more vulnerabilities (e.g., overfitting) associated with attack packets. (b) Due to heterogeneous protocols and applications, benign packets in IoT networks exhibit diversity , which enables a detection model to learn more generalized underlying structures of these packets and makes adversarial perturbations less likely to succeed. For example, Edge-IIoTset [ 16 ] , the most widely-adopted benchmark IIoT network dataset in the research community, has one interesting characteristic: although about 20% of the benign packets are MQTT packets, none of the (fourteen) attack classes involve MQTT packets. As a result, the trained model pushes the decision boundary far away from the cluster of MQTT samples. In fact, we checked the margins computed from the logits (pre-softmax) of the final dense layer, following the standard approach [ 52 ] , and found that all (correctly) classified MQTT packets have very large positive margins (roughly 120 \sim 124), eventually predicted with near-perfect confidence scores. This indicates that they lie far from the decision boundary; hence, highly robust to minimal perturbations [ 83 , 34 , 80 ] . Finally, the importance of this research finding is also due to the practicality of the newly uncovered FPR manipulation attack. Based on the surprising finding that a systematic simple perturbation of real MQTT packets is sufficient to flip the label of the unperturbed versions , our FPR manipulation attack does not require one to apply any sophisticated attack techniques, such as gradient-based [ 69 , 29 , 18 , 45 , 55 ] , score-based [ 85 , 9 ] , decision boundary-based [ 85 , 6 ] , or GAN-based approaches [ 3 , 84 , 41 , 87 ] . In addition, since FPR manipulation attacks only utilize benign and legitimate MQTT messages, the new attack, in principle, is hard to detect. Moreover, the adversary often employs multiple IoT devices to attack the network and can tactically avoid letting the same device launch both evasion attacks and FPR manipulation attacks. This makes the new attack even harder to detect. Overview of the new attack. The FPR manipulation attack (FPA, in short)

Read the complete text