Countering adversarial evasion in regression analysis
[1ex] David Benfield, Phan Tu Vuong, Alain Zemkoho, [1.5ex] School of Mathematical SciencesUniversity of SouthamptonSO17 1BJ Southampton, United Kingdom [email protected] , [email protected] , [email protected] [1.5ex] · 2025
Read Countering adversarial evasion in regression analysis by [1ex] David Benfield, Phan Tu Vuong, Alain Zemkoho, [1.5ex] School of Mathematical SciencesUniversity of SouthamptonSO17 1BJ Southampton, United Kingdom [email protected] , [email protected] , [email protected] [1.5ex] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22113.txt.
Introduction
David Benfield, Phan Tu Vuong, and Alain Zemkoho study how to keep prediction models honest when the people being predicted fight back. In spam filtering, malware detection, and fake-image spotting, adversaries reshape their data to slip past an established model. Game theory captures that contest. A recent tool, pessimistic bilevel optimization, has proven strong for classification. It assumes the adversary plays as badly as possible for the defender, without assuming their best move is unique or well-behaved.
That tool, however, had not been carried over to regression, where the model predicts a number rather than a class. This 2025 paper proposes a pessimistic bilevel program for the regression setting. It keeps the same freedom from assumptions: no convexity of the adversary's problem, and no uniqueness of their optimal response. The aim is predictors that stay resilient when the data-generating side adapts.
Catalog record
| CREATOR | [1ex] David Benfield, Phan Tu Vuong, Alain Zemkoho, [1.5ex] School of Mathematical SciencesUniversity of SouthamptonSO17 1BJ Southampton, United Kingdom [email protected] , [email protected] , [email protected] [1.5ex] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-22113
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Countering adversarial evasion in regression analysis [1ex] David Benfield, Phan Tu Vuong, Alain Zemkoho, [1.5ex] School of Mathematical SciencesUniversity of SouthamptonSO17 1BJ Southampton, United Kingdom [email protected] , [email protected] , [email protected] [1.5ex] Abstract Adversarial machine learning challenges the assumption that the underlying distribution remains consistent throughout the training and implementation of a prediction model. In particular, adversarial evasion considers scenarios where adversaries adapt their data to influence particular outcomes from established prediction models, such scenarios arise in applications such as spam email filtering, malware detection and fake-image generation, where security methods must be actively updated to keep up with the ever-improving generation of malicious data. Game theoretic models have been shown to be effective at modelling these scenarios and hence training resilient predictors against such adversaries. Recent advancements in the use of pessimistic bilevel optimsiation which remove assumptions about the convexity and uniqueness of the adversary’s optimal strategy have proved to be particularly effective at mitigating threats to classifiers due to its ability to capture the antagonistic nature of the adversary. However, this formulation has not yet been adapted to regression scenarios. This article serves to propose a pessimistic bilevel optimisation program for regression scenarios which makes no assumptions on the convexity or uniqueness of the adversary’s solutions. 1 Introduction Adversarial machine learning considers the exploitable vulnerabilities of machine learning models and the strategies needed to counter or mitigate such threats [ 32 ] . By considering these vulnerabilities during the development stage of our machine learning models, we can work to build resilient methods [ 9 , 11 ] such as protection from credit card fraud [ 35 ] or finding the optimal placement of air defence systems [ 20 ] . In particular, we consider the model’s sensitivity to changes in the distribution of the data. The way the adversary influences the distribution can fall under numerous categories, see [ 21 ] for a helpful taxonomy that categorises these attacks. We focus on the specific case of exploratory attacks, which consider the scenarios where adversaries attempt to modify their data to evade detection by a classifier. Such attacks might occur in security scenarios such as malware detection [ 3 ] and network intrusion traffic [ 31 ] . In a similar vein, and more recently, vulnerabilities in deep neural networks (DNN) are being discovered, particularly in the field of computer vision and image classification; small perturbations in the data can lead to incorrect classifications by the DNN [ 33 , 19 ] . These vulnerabilities raise concerns about the robustness of the machine learning technology that is being adopted and, in some cases, in how safe relying on their predictions could be in high-risk scenarios such as autonomous driving [ 15 ] and medical diagnosis [ 16 ] . By modelling the adversary’s behaviour and anticipating these attacks, we can train classifiers that are resilient to such changes in the distribution before they occur. Game theory provides an effective and popular technique to model adversarial scenarios. These games see one player, the learner, attempt to train a prediction model while another player, the adversary, modifies their data in an attempt to influence particular outcomes from the learner’s predictor. See, for example [ 10 ] for early work in modelling adversarial learning. The precise structure of such a model then depends on a number of factors, such as whether the attack occurs either at training time [ 27 ] , or implementation time [ 5 ] . Further to this, while some games assume the players act simultaneously [ 4 , 29 ] , others allow for sequential play where either the adversary acts first [ 25 , 26 , 7 , 24 ] or the learner acts first [ 21 , 5 ] . We focus our attention on attacks made at implementation time where the adversary seeks to influence an already established prediction model, commonly known as evasion attacks in the literature [ 21 ] . Sequential evasion games naturally take on the form of a bilevel optimisation program. In this formulation, the learner, taking the role of the leader in the upper-level, train a prediction function while anticipating how the adversary, taking the role of the follower in the lower-level, will react. The solution to this program then results in a resilient prediction function. Pessimistic bilevel optimisation in particular has proved particularly effective. When multiple optimal solutions are available to the adversary, the pessimistic model, unlike its optimistic variant, assumes no cooperation between the adversary and the learner. This formulation better captures the antagonistic nature of adversarial evasion scenarios [ 2 , 5 ] . In this article, we adapt the pessimistic bilevel program proposed by [ 37 ] to train resilient predictors in regression scenarios. We model scenarios where we might expect adversaries to modify their data in an attempt to influence a particular label from a prediction model. We use the motivating example of an adversary providing falsified information about a house in order to influence a higher valuation. We explore properties of the constrained bilevel model under new choices of objective functions, showing the possible existence of multiple optimal solutions and hence the benefit of a constrained pessimistic bilevel approach, which, to the best of our knowledge, has not yet been applied to regression analysis. Moreover, we take this opportunity to exploit the fact that our method does not require the use of feature maps in its solution method. Feature maps, such as PCA, as was used [ 5 ] , are typically not bijective. Consequently, although a solution to the adversary can be found in the map-induced feature space, a corresponding solution in the original feature space cannot be identified. However, under our model, we can view the explicit values of the adversary’s data at their solution. These values can give us insight into the strategies played by the adversary and allows us to identify the extent to which each feature needs to be modified in order to adequately influence the prediction model. From this, we can identify which features are most vulnerable. For example, if a certain feature required only a minor perturbation, then we might consider this feature to be particularly vulnerable to adversarial influence. On the other hand, if a feature required large transformations to trick the learner, then we might consider this feature to be resilient to attacks. The contributions of this article can be summarised as follows. We adapt the bilevel model proposed in [ 37 ] to accommodate regression analysis and present a novel pessimistic bilevel optimisation program to train prediction functions that are resilient to strategic changes in the data of regression scenarios. This bilevel program makes no assumptions on the convexity of the lower-level problem, or the uniqueness of its solution, which, to the best of our knowledge, has not previously been proposed for adversarial regression analysis. We design experiments to assess the performance of our model and showcase its ability to outperform existing methods. Finally, we demonstrate a key benefit of our model over existing approaches. Where existing approaches required the use of kernel transformations to ensure convexity, we are able to keep the lower-level variable (the adversary’s data) in its original feature space,