Cluster Analysis and Concept Drift Detection in Malware
Aniket Mishra Mark Stamp · 2025
Read Cluster Analysis and Concept Drift Detection in Malware by Aniket Mishra Mark Stamp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14135.txt.
Introduction
Aniket Mishra and Mark Stamp hunt for drift in malware families in a 2025 paper. Malware evolves, and a detector trained on last year's samples quietly decays as the code's traits shift, a change called concept drift. Catching the moment of drift tells defenders when to retrain.
The pair cluster samples from a time-stamped Android malware collection into batches and watch a clustering quality score. Dips in that score flag likely drift points. They then test four standard classifiers under three policies: never retrain, retrain on a schedule, and retrain when drift is flagged. The drift-aware policy, guided by the clustering signal, is the contender the experiments judge.
Catalog record
| CREATOR | Aniket Mishra Mark Stamp |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14135
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cluster Analysis and Concept Drift Detection in Malware Aniket Mishra Mark Stamp Abstract Concept drift refers to gradual or sudden changes in the properties of data that affect the accuracy of machine learning models. In this paper, we address the problem of concept drift detection in the malware domain. Specifically, we propose and analyze a clustering-based approach to detecting concept drift. Using a subset of the KronoDroid dataset, malware samples are partitioned into temporal batches and analyzed using MiniBatch K K -Means clustering. The silhouette coefficient is used as a metric to identify points in time where concept drift has likely occurred. To verify our drift detection results, we train learning models under three realistic scenarios, which we refer to as static training, periodic retraining, and drift-aware retraining. In each scenario, we consider four supervised classifiers, namely, Multilayer Perceptron (MLP), Support Vector Machine (SVM), Random Forest, and XGBoost. Experimental results demonstrate that drift-aware retraining guided by silhouette coefficient thresholding achieves classification accuracy far superior to static models, and generally within 1% of periodic retraining, while also being far more efficient than periodic retraining. These results provide strong evidence that our clustering-based approach is effective at detecting concept drift, while also illustrating a highly practical and efficient fully automated approach to improved malware classification via concept drift detection. 1 Introduction In many applications of machine learning models, the underlying data is not static, and hence the features that a model was trained on might change over time. Such a change in features is generically referred to as concept drift. It is well known that malware writers modify existing malware for use in new attacks and to obfuscate malware in an attempt to evade various detection methods [ 19 , 20 ] . This process of malware evolution can result in gradual or sudden changes in the features that machine learning models rely on to detect malware, thereby reducing the effectiveness of such models. Hence, concept drift detection is vitally important in the malware domain, yet this topic appears to have received limited attention in the malware research literature. Traditionally, malware detection relied primarily on signature-based techniques. Due to their inherently static nature, signatures tend to fail under even relatively minor cases of concept drift [ 12 ] . On the other hand, machine learning based techniques, such as Hidden Markov Models (HMM), Support Vector Machines (SVM), Convolutional Neural Networks (CNN), and Random Forest classifiers, are generally more robust [ 1 ] . Consequently, machine learning techniques have become the focus of malware detection research [ 10 ] . However, these methods will also eventually fail once malware features sufficiently evolve beyond the training data. It is well known that there are many obfuscation techniques available that easily defeat signature scanning [ 2 ] , and it is not difficult to adapt such techniques to defeat machine learning based techniques [ 18 ] . Due to the widespread use of machine learning for malware detection, and the ease with which malware can be modified—either for the purpose of obfuscation or due to the inherent evolutionary nature of malware—concept drift is a vitally important topic in the malware field. An obvious approach to concept drift detection is to statistically monitor features over time. However, it is important to automate the process of concept drift detection, and hence the use of learning models to monitor features is a reasonable approach. Such an approach has been previously considered, with HMM and SVM models used for concept drift detection in malware classification models [ 24 , 34 , 35 ] . In this paper, we use a clustering based approach to detect concept drift. Specifically, we partition the sample of a malware family into temporal subsets. We then analyze consecutive pairs of subsets using MiniBatch K -Means clustering [ 26 ] . The silhouette coefficient is used to quantify changes between consecutive clusterings, which enables us to detect points in time where significant concept drift has likely occurred. We then verify that concept drift is being detected by considering various model retraining scenarios, which we now introduce. We train various machine learning models, and use these models to classify the samples of a given family. To determine the effectiveness of our clustering-based concept drift detection strategy, we consider the following three scenarios. Static training — A model is trained on the initial subset of samples, and this model is used to classify all remaining samples, without any retraining. Periodic retraining — A model is trained on the initial subset of samples, and the model is retrained at regular periodic intervals. A trained model is used for classification only until the next model is trained. Drift-aware retraining — This is similar to the periodic retraining scenario, except that retraining is triggered by concept drift detection, rather than regular time intervals. For each of the three scenarios described above, we experiment with four classifiers. Specifically, under each scenario we train a Multilayer Perceptron (MLP) neural networks [ 28 ] , Support Vector Machines (SVM) [ 29 ] , Random Forests [ 27 ] , and XGBoost models [ 37 ] . We determine the accuracy of each of these models under each of the three retraining scenarios. If we are accurately detecting concept drift, we expect that drift-aware retraining will yield strong results, while also being more efficient than the periodic retraining scenario, in the sense of requiring significantly fewer models to be trained. While many malware datasets are available, few have reliable timestamps associated with samples. Without such timestamps, any malware classification results are questionable, due to the fact that future samples are almost certainly used to train models that are then used to classify earlier samples, which is generally not realistic. In any case, accurate timestamps are absolutely essential for concept drift research. In this paper, we use the KronoDroid dataset [ 11 ] , since each sample in this dataset includes a timestamp, and these timestamps appear to be accurate. The remainder of this paper is organized as follows. In Section 2 , we discuss relevant background topics, including MiniBatch K -Means and silhouette coefficients, and we introduce each of the four models that we use for classification. Section 3 contains an overview of previous research into concept drift detection within the malware realm. Section 4 provides implementation details for our experiments. Section 5 presents our experimental results for each model across each of our three retraining scenarios. Finally, Section 6 summarizes our findings and highlights potential directions for future research. 2 Background In this section, we discuss relevant background topics. First, we introduce the topics of supervised and unsupervised learning. Then we discuss MiniBatch K -Means clustering in some detail, followed by a brief introduction to each of the four learning techniques used in our experiments. Finally, we discuss the silhouette coefficient in some detail, as it is fundamental to our concept drift detection strategy. 2.1 Supervised and Unsupervised Learning Supervised learning refers to models that are trained on labeled datasets. Most popular classifiers are supervised techniques. Such methods have proven effective at detecting malware but, of course, all are adversely affected by concept drift. In this paper, we train various models as a