Detecting Concept Drift in Evolving Malware Families Using Rule-Based Classifier Representations

Tomáš Kalný 1 , Martin Jureček 1 and Mark Stamp 2 1 Faculty of Information Technology Czech Technical University, Thakurova 9, Prague, Czech 2 Department of Computer Science, San Jose State University, San Jose, CA, USA { kalnyto1, martin.jurecek } @fit.cvut.cz, [email protected] · 2026

Read Detecting Concept Drift in Evolving Malware Families Using Rule-Based Classifier Representations by Tomáš Kalný 1 , Martin Jureček 1 and Mark Stamp 2 1 Faculty of Information Technology Czech Technical University, Thakurova 9, Prague, Czech 2 Department of Computer Science, San Jose State University, San Jose, CA, USA { kalnyto1, martin.jurecek } @fit.cvut.cz, [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22629.txt.

Introduction

Kalný, Jureček, and Stamp detect drift in malware sorting with tree rules. Models trained across time windows on EMBER2024 gauge drift by comparing rule patterns with feature weight, prediction match, stable activation, and reach, tracking accuracy loss and distribution shift. Tests across six families use fixed and cluster windows in family-vs-benign and family-vs-family settings, against RIPPER and Transcendent. Fixed two-month windowing with Pearson correlation proves best, the setup where pairs produce positive drift-accuracy links. Methods work together: no approach rules across all pairs.

Catalog record

CREATORTomáš Kalný 1 , Martin Jureček 1 and Mark Stamp 2 1 Faculty of Information Technology Czech Technical University, Thakurova 9, Prague, Czech 2 Department of Computer Science, San Jose State University, San Jose, CA, USA { kalnyto1, martin.jurecek } @fit.cvut.cz, [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38443
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22629

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Detecting Concept Drift in Evolving Malware Families Using Rule-Based Classifier Representations Tomáš Kalný 1 , Martin Jureček 1 and Mark Stamp 2 1 Faculty of Information Technology Czech Technical University, Thakurova 9, Prague, Czech 2 Department of Computer Science, San Jose State University, San Jose, CA, USA { kalnyto1, martin.jurecek } @fit.cvut.cz, [email protected] Abstract This work proposes a structural approach to concept drift detection in malware classification using decision tree rulesets. Classifiers are trained across temporal windows on the EMBER2024 dataset, and drift is quantified by comparing extracted rule representations using feature importance, prediction agreement, activation stability, and coverage metrics. These metrics are correlated with both accuracy degradation and data distribution shift as complementary drift indicators. The approach is evaluated across six malware families using fixed-interval and clustering-based windowing in family-vs-benign and family-vs-family settings, and compared against RIPPER and Transcendent baselines. Results show that fixed two-month windowing with feature-level Pearson correlation is the most reliable configuration, being the only one where all family pairs produce positive drift–accuracy correlations. The methods are complementary — no single approach dominates across all pairs. 1 INTRODUCTION Malware evolution remains a major challenge for cybersecurity, as attackers continuously adapt through obfuscation, packing, encryption, and code modification to evade detection [ Singh et al., 2012 ] . This ongoing arms race has reduced the effectiveness of traditional signature- and anomaly-based approaches, leading to widespread adoption of machine learning methods [ Yan et al., 2023 ] . Although these methods perform well in controlled settings, their accuracy degrades over time due to concept drift [ Jordaney et al., 2017 ] . Concept drift refers to changes in the statistical properties of the target variable over time [ Lu et al., 2018 ] , driven by factors such as malware evolution and adversarial obfuscation [ Jiang et al., 2024 ] . Without proper handling, drift leads to significant performance degradation, motivating the need for effective detection and adaptation mechanisms [ Chow et al., 2023 ] . Existing approaches include statistical monitoring, training with adversarial future samples, and representation learning techniques [ Lu et al., 2018 , Jordaney et al., 2017 , Chen et al., 2023 , He et al., 2024 , Fernando and Komninos, 2022 ] . Rule-based models provide interpretable decision logic and have been successfully applied in malware classification [ Blount et al., 2011 , D’Angelo et al., 2021 ] . However, they remain susceptible to concept drift and require mechanisms to maintain reliability over time. This work addresses drift detection in malware classification through structural analysis of decision tree rulesets, aligning with the growing demand for explainable security solutions [ Manthena et al., 2025 ] . From an IT security perspective, reliable drift detection is critical for maintaining the effectiveness of deployed systems. In operational environments such as endpoint protection and SOCs, undetected drift can create exploitable blind spots. The proposed approach provides both quantitative indicators of model degradation and interpretable insights into how detection logic evolves, supporting analysts in validation and threat investigation while enabling more adaptive and trustworthy cybersecurity systems. The work focuses on answering the following questions: • Can changes in decision tree rules be used as meaningful drift indicators? • Do such drift indicators correlate with performance degradation or data distribution shifts? • How does drift detection differ between malware vs. benign and malware family vs. malware family classification settings? • What is the minimal temporal resolution is required to observe meaningful drift signals? The remainder of this paper is organized as follows. Section 2 reviews related work, Section 3 provides background on concept drift in malware, Section 4 describes the proposed method, Section 5 presents experimental results, and Section 6 concludes the paper. 2 RELATED WORK Jordaney et al. introduced the Transcend framework [ Jordaney et al., 2017 ] , which detects out-of-distribution samples using conformal evaluation. Rather than relying on classifier confidence scores, Transcend computes independent p-values per class via non-conformity measures, making it model-agnostic and less prone to overconfident predictions on drifted samples. The framework was later extended by Barbero et al. [ Barbero et al., 2022 ] with improved calibration. We compare against Transcend directly in Section 5 . Chow et al. [ Chow et al., 2023 ] investigated the root causes of concept drift in Android malware samples using the same data set as Transcend framework. Their methodology involved identifying points of interest where drift occurred by comparing the predictions of a base model against oracle models trained on subsets of future test data. This enabled them to determine which malware families contributed the most significantly to drift and to assess the corresponding impact on classifier performance. Interestingly, the results showed that benign samples are not the main source of drift and have very little impact on performance. Dolejš et al. [ Dolejš and Jureček, 2022 ] explored the explainability and interpretability of ML-based malware detection systems. Their study focused on Windows PE files from the EMBER dataset and employed rule-based models I-REP and RIPPER for better explainability and their ability to handle noisy data. To evaluate interpretability, the authors proposed two metrics: Human Most Understandable Model and Interpretability Entropy. In their experiments, five machine learning algorithms were first trained on static features; their predictions were then used to train rule-based models, reconstructing the decision making process through rule sets. The results demonstrated that the best performing combination was to use RIPPER on Gaussian Naive Bayes (GNB) predictions, achieving an accuracy of 98.49 percent covering most of the predictions. This highlights the potential of rule-based post-processing to provide transparency in otherwise opaque classifiers. Jurečková et al. used rule-based classifier RIPPER to detect concept drift in 6 malware families using EMBER dataset and MAB-malware adversarial generator to simulate drift and get a ground-truth moment when drift has occurred. Applying the same rule-based classifier allowed authors to directly compare features of original and evolved samples based on conditions that the samples meet and rule set distance function. Authors tested multiple feature dimensionalities from 3 to 100 and reached overall 92.08% accuracy of detecting drift across all 6 families. [ Jurečková and Jureček, 2026 ] . Stamp et al. [ Mishra and Stamp, 2025 ] propose a lightweight clustering-based approach for concept drift detection in setting that does not require class labels. They apply MiniBatch K-Means to temporally-ordered batched from KronoDroid dataset and track changes in silhouette coefficient between consecutive batch pairs. Their approach has been validated using three scenarios - static retraining (baseline), periodic retraining and drift-aware retraining across four classifiers. With drift-aware retraining the authors were able to reduce the number of models trained by approximately 40\% while achieving accuracy within 0.5% of periodic retraining. Ceschin et al. proposed updating both the classifier and the feature selector when there is a certain level of drift [ Ceschin et al., 2023 ] . The authors studied whether drift remains across datasets. Compared to just retraining the classifier, the proposed ”Fast and Furious” solution achieved an improvement of 22.05% and 8.77% for the F1 score in the Drebin and AndroZoo datasets, respectively. Other works such as FeSA [ Fernando and Komninos, 2022 ] study the creation of an optimal feature selection architecture for ransomware classification when exposed to concept

Read the complete text