Colliding with Adversaries at ECML-PKDD 2025 Model Robustness Competition 1st Prize Solution
Dimitris Stefanopoulos (✉), Andreas Voskou · 2025
Read Colliding with Adversaries at ECML-PKDD 2025 Model Robustness Competition 1st Prize Solution by Dimitris Stefanopoulos (✉), Andreas Voskou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16443.txt.
Introduction
In a paired 2025 report, Dimitris Stefanopoulos and Andreas Voskou share their win in a defence contest. The task was to train a model that stays right on clean data and on attacked data. Attacks came from a shuffle trick that swaps values to break patterns. The event was part of the same ECML-PKDD 2025 physics challenge as their attack win.
First, the pair made 15 million fake training samples with that same shuffle trick. Then they trained a model with a shared-weight block plus a fusion tail. It scored 80 percent on mixed clean and attacked data. That beat the next team by two points and took first place.
Catalog record
| CREATOR | Dimitris Stefanopoulos (✉), Andreas Voskou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16443
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Colliding with Adversaries at ECML-PKDD 2025 Model Robustness Competition 1st Prize Solution Dimitris Stefanopoulos (✉), Andreas Voskou Abstract This report presents the winning solution for Task 2 of Colliding with Adversaries: A Challenge on Robust Learning in High Energy Physics Discovery at ECML-PKDD 2025. The goal of the challenge was to design and train a robust ANN-based model capable of achieving high accuracy in a binary classification task on both clean and adversarial data generated with the Random Distribution Shuffle Attack (RDSA). Our solution consists of two components: a data generation phase and a robust model training phase. In the first phase, we produced 15 million artificial training samples using a custom methodology derived from Random Distribution Shuffle Attack (RDSA). In the second phase, we introduced a robust architecture comprising (i)a Feature Embedding Block with shared weights among features of the same type and (ii)a Dense Fusion Tail responsible for the final prediction. Training this architecture on our adversarial dataset achieved a mixed accuracy score of 80%, exceeding the second-place solution by two percentage points. 1 Introduction The task focuses on developing a deep neural network that is robust to adversarial examples in high-energy physics data presented in tabular format. Specifically, it addresses a binary classification problem that aims to distinguish between two classes of particle jets produced by particle colliders such as the LHC (Large Hadron Collider): "two top-jets (TTJets)" and "two W-boson-jets". Given that the RDSA (Random Distribution Shuffle Attack) method is used to generate adversarial examples for TopoDNN ( [ 3 ] , [ 7 ] ), we opted for a method-aware robustness strategy. In particular, we applied an antiRDSA approach that perturbs data points using the same technique employed to generate the adversarial evaluation set, while preserving their original labels. As a result, our augmented training set includes multiple correctly labeled, perturbed adversarial examples. The final robust model is an ensemble of four classifiers combined with averaging. Each classifier incorporates distinct feature embedding layers for the three physically different variables: transverse momentum ( p_{T} ), azimuthal angle ( \phi ), and pseudorapidity ( \eta ). The classifiers differ in their input dropout rates and training datasets, which correspond to two separate augmentation phases. The full code for data augmentation, model architecture and training can be found in the Colliding with Adversaries GitHub repository . Algorithm 1 antiRDSA Data Generation from Feature Distributions Input: Dataset D with 87 features Output: List of generated variants V GenData\leftarrow[\ ] Compute histograms for each feature in D with n_{\text{bins}} bins for each selected sample x in D do for i=1 to 50 do x^{\prime}\leftarrow x Randomly select n_{\text{vars}} feature indices \{f_{1},\ldots,f_{n_{\text{vars}}}\} for each feature index f in \{f_{1},\ldots,f_{n_{\text{vars}}}\} do Sample value v_{f} from empirical distribution of feature f x^{\prime}[f]\leftarrow v_{f} end for Append (x^{\prime},\text{label}(x)) to V end for end for 2 Problem Statement Given a dataset D with finite number of |D|=n data points d\in\mathbb{R}^{87}\times\{0,1\} , our objective is to generate a larger dataset of size N\gg n in order to train a robust model F:\mathbb{R}^{87}\to\{0,1\} that minimizes the following metric: S=\frac{\textit{Clean Accuracy}+\textit{Adversarial Accuracy}}{2} (1) Here, Clean Accuracy and Adversarial Accuracy represent the proportion of correctly classified instances (including both true positives and true negatives) in two separate hidden evaluation sets. Although examples of Clean and Adversarial test sets were provided, improvements on these sets did not fully transfer to the corresponding hidden evaluation sets on the platform. In particular, Adversarial Accuracy showed a significant decrease, likely by design, to assess the generalization capabilities of the robust methodology. 3 Data Generation The data generation methodology is largely based on the Random Distribution Shuffle Attack (RDSA) [ 6 ] , which was employed by the competition committee to create adversarial examples using a TopoDNN model. As the original algorithm relies on TopoDNN predictions to generate adversaries, our modified version of RDSA (so called antiRDSA ) excluded the model query step and produced several large data points to assist in training. This data points contain a significant number of perturbed inputs, each labeled with the correct class. Consequently, the resulting data consist of many examples that resemble adversarial instances but are annotated with the true label. The final augmented training sets were generated using data from the HuggingFace repository TSaala/CollidingAdversaries . The generation algorithm was applied to the Train, Val, and Test splits twice with different parameter settings. Table 1 presents the parameters used for generating DataGen1 and DataGen2. The column Source indicates the HuggingFace dataset split used as the basis for each generation phase. The number of variants per sample is fixed at 50, and the subset size always matches the full length of the respective "Source" dataset. Table 1: Description statistics for the two data generation cases. Name Source nBins nVars Size( \times 10^{6} ) DataGen1 Train 100 5 5 Val 200 5 1.25 Test 200 5 1.25 DataGen2 Train 100 10 5 Val 200 10 1.25 Test 200 10 1.25 In Table 2 , the final training datasets are presented. These are heavily augmented versions of the Hugging Face datasets. DataAug1 and DataAug2 correspond to the training sets used for the successful ensemble models. Table 2: Overview of the final augmented datasets used for training. The "Total Size" column reflects the combined size of the original HuggingFace dataset and the synthetic data generated as described in Table 1 . Name HuggingFace data Generated Data Size( \times 10^{6} ) DataAug1 Train+Val+Test DataGen1 7.65 DataAug2 Train+Val+Test DataGen1+DataGen2 15.15 4 Robust Model The architecture adopted for this robust model follows the structure of feature embeddings combined with a simple MLP (Multi-Layer Perceptron) for classification, consistent with the approach proposed in [ 1 ] . The feature embedding component performs a non-linear transformation of each of the 87 scalar input features into a representation vector. This process can be formally described using f_{e}:\mathbb{R}\rightarrow\mathbb{R}^{8} . An abstract picture of the overall architecture is shown in Figure 1 . Figure 1: Robust model architecture schema. While state-of-the-art methods employ periodic, bin-based, or stochastic embedding mechanisms [ 1 , 8 , 2 , 5 ] , such approaches could not be applied due to constraints imposed by the competition format. Instead, we implemented a simpler two-layer ReLU-activated embedding, using separate weights for each of the three input feature types: p_{T} , \phi , and \eta . The embedding of each of the 87 features is defined as: \boldsymbol{x_{e}}=f_{e}(x\mid W_{\text{1}}^{t},W_{\text{2}}^{t})=W_{\text{2}}^{t}\text{ReLU}(W_{\text{1}}^{t}x) (2) where x\in R , \boldsymbol{x_{e}}\in R^{8} , W_{\text{1}}^{t}\in\mathbb{R}^{16} , W_{\text{2}}^{t}\in\mathbb{R}^{8\times 16} , and t\in\{\eta,\phi,p_{T}\} . In the Dense Fusion Tail, the representation vectors of all features are concatenated into a single vector of dimension D=87\cdot 8 , and passed to an MLP classifier with one hidden layer of size 256, using the \tanh activation function. The full model reads as: F(\boldsymbol{x})=W_{out}tanh(W_{hidden}(f_{e}(x_{i}))_{i=1}^{87}) (3) where W_{hidden} and W_{out} the trainable parameters of the first and second layer of the MLP classifier. Dropout with p=0.2 and Gaussian noise with standard deviation \sigma=0.01 are applied to the hidden layers of both the MLP and the embedding network. Additional dropout is also applied to the raw input data. The final model is an averaging ensemble of 2+2 such networks. One pair uses input dropout p=0.075 , and the other uses p=0.125