Colliding with Adversaries at ECML-PKDD 2025 Adversarial Attack Competition 1st Prize Solution

Dimitris Stefanopoulos (✉), Andreas Voskou · 2025

Read Colliding with Adversaries at ECML-PKDD 2025 Adversarial Attack Competition 1st Prize Solution by Dimitris Stefanopoulos (✉), Andreas Voskou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16440.txt.

Introduction

Dimitris Stefanopoulos and Andreas Voskou report a contest win in their 2025 write-up. The contest, held at ECML-PKDD 2025, asked teams to fool a physics sorting model. A good attack flips the model's answer with the least change to the input. Their attack works in rounds and uses the model's own slopes to guide each tweak.

Random starts and sample mixing made the attack stronger still. It earned the best mix of small change and high fool rate, and took first place. Work like this stress-tests models used in physics hunts for new particles. Strong attacks show where a model can break before real use.

Catalog record

CREATORDimitris Stefanopoulos (✉), Andreas Voskou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE10 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-16440

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Colliding with Adversaries at ECML-PKDD 2025 Adversarial Attack Competition 1st Prize Solution Dimitris Stefanopoulos (✉), Andreas Voskou Abstract This report presents the winning solution for Task 1 of Colliding with Adversaries: A Challenge on Robust Learning in High Energy Physics Discovery at ECML-PKDD 2025. The task required designing an adversarial attack against a provided classification model that maximizes misclassification while minimizing perturbations. Our approach employs a multi-round gradient-based strategy that leverages the differentiable structure of the model, augmented with random initialization and sample-mixing techniques to enhance effectiveness. The resulting attack achieved the best results in perturbation size and fooling success rate, securing first place in the competition. 1 Introduction This report describes the solution of team APTH for Task 1 of the Colliding with Adversaries: A Challenge on Robust Learning in High Energy Physics Discovery challenge of ECML-PKDD 2025. The task focuses on performing adversarial attacks against machine learning models trained on experimental high-energy physics data in tabular format [ 3 ] . Specifically, it concerns a binary classification problem between two different simulated processes: (i) two top-Jets (TTJets) and (ii) two W-Boson-jets. The goal is to generate adversarial examples that force misclassifications by a given model (based on TopoDNN [ 1 ] , [ 2 ] ), while keeping perturbations as small as possible. Given that both the model and the evaluation dataset were provided, we adopted a white-box, model-aware attack methodology. Since TopoDNN is a differentiable neural network, allowing for gradient-based optimization, our approach centered on a gradient-descent-based attack. The code for the proposed methodology can be found in the Colliding with Adversaries GitHub repository . 2 Task Definition Let the dataset be denoted as D=\{X,Y\} , where X\in\mathbb{R}^{5000\times 87} is the input matrix and Y\in\{0,1\}^{5000} the corresponding binary labels. Each pair (x_{i},y_{i}) corresponds to a data point and its label for i\in[1,5000] . The model under attack is denoted as F , representing the TopoDNN-like network with the provided pretrained weights. The objective is to find, for each input x_{i} , a perturbed input x^{\prime}_{i}=x_{i}+\delta x_{i} such that the model’s prediction changes: F(x_{i})\neq F(x^{\prime}_{i}) , while keeping the perturbation ||\delta x_{i}||_{1} as small as possible. The evaluation metric for the competition is defined as: S=\text{FR}\cdot e^{-20D} (1) where FR (Fooling Ratio) is the proportion of originally correctly classified samples that become misclassified after the attack, and D=\frac{1}{N_{f}}\sum_{i=1}^{5000}||\delta x_{i}||_{1} is the average L_{1} distance between original and adversarial examples for the successfully reversed (fooled) cases. The total number of reversed predictions is denoted as N_{f} . The task therefore requires jointly (i) reversing the model’s prediction and (ii) minimizing the input perturbation. This leads to a mixed optimization objective that balances adversarial effectiveness (via cross-entropy loss or similar) and minimization of the perturbation (via L_{1} norm). 3 Core Methodology Based on the task formulation and taking into account that: 1. The fooling ratio is binary per sample (1 if prediction flips, 0 otherwise), 2. The provided TopoDNN model ( F ) has 100% accuracy on the clean dataset, 3. We only care about minimizing ||\delta x_{i}||_{1} for successful attacks (i.e., when the prediction flips), since the rest can be considered as having zero contribution. we designed the following objective function: L=\begin{cases}L_{fool}&\text{if }F(x_{i}+\delta x_{i})=F(x_{i})\\ L_{reduce}&\text{if }F(x_{i}+\delta x_{i})\neq F(x_{i})\end{cases} (2) where: L_{\text{fool}}=-\text{BCE}(F(x_{i}+\delta x_{i}),y_{i}) (3) L_{\text{reduce}}=||\delta x_{i}||_{1} (4) Here, L_{\text{fool}} encourages flipping the model’s prediction using the negative binary cross-entropy as a minimization objective, but only if a prediction flip has not yet been achieved. This corresponds to targeting a prediction confidence just over 50%, sufficient to change the prediction without requiring excessive perturbation. L_{\text{reduce}} corresponds to direct L_{1} distance minimization of ||\delta x||_{1} , encouraging small perturbations; this term applies only when the prediction flip has already been achieved. This formulation prioritizes reversing the prediction and avoids unnecessary variance from optimizing both terms simultaneously. After optimizing the main objective, we also perform a follow-up pure L_{fool} optimization for a small number of steps to ensure that predictions have been successfully reversed and to avoid marginally non-reversed cases. The objective minimization was performed using vanilla gradient descent. While more sophisticated approaches such as Adam could be faster or more effective, we were able to achieve the desired results easily, and GD proved sufficient. 4 Overall Approach While the previously described process was the core component of our methodology, a few auxiliary strategies were employed to further improve the performance of our adversarial attacks. Instead of running the optimization only once based on the original test set as a starting point, we performed it multiple times with several variations. Specifically, we executed a long sequence of optimization rounds, 150 in total, with 20 parallel runs in each. The optimization step size for each run was set randomly using a changing uniform distribution with decreasing maximum and minimum values: \displaystyle step_{n}^{j}\sim U(min_{n},max_{n}) (5) \displaystyle max_{n}=2^{(9-\frac{n}{5})},\;\;min_{n}=\frac{max_{n}}{10} (6) where n\in[1,150] is the optimization round, and j\in[1,20] denotes each of the 20 parallel runs. The step size for the follow-up optimization is always set to step_{fu}=0.01 . The main runs are performed using 2500 total steps, while the follow-up runs use 250 steps. Furthermore, instead of always using the original data as the initial point, each of the 20 parallel runs for each optimization round used a different approach. Specifically, the following strategies were employed: • For j=1 , we use the original data X . • For j=2 , we use the best state up to the current round, X_{best} . For the remaining cases, we define and use a row-wise random mixture process formulated as: f_{rm}(x_{a},x_{b}):=x_{a}\cdot w+x_{b}\cdot(1-w),\;\;w\sim U(0,1) (7) where x_{a},x_{b}\in\mathbb{R}^{87} and w\in\mathbb{R} . This method is equivalent to randomly selecting a point on the line connecting x_{a} and x_{b} in the feature space. This technique is applied as follows: • For j=3 to j=10 , we mix the original data X with X_{best} , generating 8 different random mixtures: x_{i}^{j}=f_{rm}(x_{i},x_{best_{i}}) . • For j=11 to j=20 , we again use the mixture process in equation ( 7 ), but with different components. Assuming that for a specific point x_{a} , the correct label is 1, we randomly select an example x_{b} from the original dataset X with the opposite label (in this case, 0), and randomly mix them. Technically, we leverage the fact that we know a direction where the prediction will eventually reverse and move the initial point toward it. This approach proved effective in the hardest-to-reverse cases, where local gradients do not provide reliable guidance for prediction reversing. Finally, we note that at the end of each round, the initial conditions have a 50% chance to be updated based on the procedure above, and a 50% chance to continue from the previous state. After each round, the best result for each row (with a prediction flip and minimum ||\delta x_{i}||_{1} ), among the 20 runs or the previous best, is selected to form X_{best} . The final X_{best} forms the solution for the task. 5 Evaluation and Discussion Table 1: Results Comparison Method Score Competition Third Place 0.91 Second Place 0.94 Ours Core 0.934 Single Round 0.956 Full Method 0.976 We evaluate our approach on the provided test set X_{\text{test}} , with results summarized in Table 1 . For reference, we

Read the complete text