CITADEL: A Semi-Supervised Active Learning Framework for Malware Detection Under Continuous Distribution Drift

Md Ahsanul Haque, Md Mahmuduzzaman Kamol, Ismail Hossain, Suresh Kumar Amalapuram, Vladik Kreinovich, Mohammad Saidur Rahman · 2025

Read CITADEL: A Semi-Supervised Active Learning Framework for Malware Detection Under Continuous Distribution Drift by Md Ahsanul Haque, Md Mahmuduzzaman Kamol, Ismail Hossain, Suresh Kumar Amalapuram, Vladik Kreinovich, Mohammad Saidur Rahman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11979.txt.

Introduction

Md Ahsanul Haque and four co-authors present CITADEL, a malware detector designed for a world where Android threats mutate monthly and labels cannot keep up. Nearly three hundred thousand new samples appear each month, expert labeling does not scale, and detectors rot as both malicious and benign apps drift in behavior.

Semi-supervised active learning uses the vast unlabeled pool instead of ignoring it, while asking experts only where their labels pay. Earlier drift defenses stayed fully supervised and expensive, and generic semi-supervised methods assume smooth input transformations that high-dimensional binary app features violate. Long-term, real-world benchmarks are the test the framework sets for itself.

Catalog record

CREATORMd Ahsanul Haque, Md Mahmuduzzaman Kamol, Ismail Hossain, Suresh Kumar Amalapuram, Vladik Kreinovich, Mohammad Saidur Rahman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-11979

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CITADEL: A Semi-Supervised Active Learning Framework for Malware Detection Under Continuous Distribution Drift Md Ahsanul Haque, Md Mahmuduzzaman Kamol, Ismail Hossain, Suresh Kumar Amalapuram, Vladik Kreinovich, Mohammad Saidur Rahman Abstract Android malware evolves rapidly, leading to concept drift that degrades the performance of traditional machine learning (ML)-based detection systems. While recent approaches incorporate active learning and hierarchical contrastive loss to handle this drift, they remain fully supervised, computationally expensive, and perform poorly on real-world datasets with long temporal spans. In particular, our evaluation highlights these limitations, particularly on LAMDA, a 12-year longitudinal dataset exhibiting substantial distributional shifts. Moreover, manual expert labeling cannot scale with the daily emergence of over 450,000 new malware samples, leaving most samples unlabeled and underutilized. To address these challenges, we propose CITADEL, a robust semi-supervised active learning framework for Android malware detection. To bridge the gap between image-domain semi-supervised learning and binary feature representations of malware, we introduce malware-specific augmentations, Bernoulli bit flips and masking, that simulate realistic drift behaviors. CITADEL further integrates supervised contrastive loss to improve boundary sample discrimination and combines it with a multi-criteria active learning strategy based on prediction confidence, L p L_{p} -norm distance, and boundary uncertainty, enabling effective adaptation under limited labeling budgets. Extensive evaluation on four large-scale Android malware benchmarks—APIGraph, Chen-AZ, MaMaDroid, and LAMDA demonstrates that CITADEL outperforms prior work, achieving F1 score of over 1%, 3%, 7%, and 14% respectively, using only 40% labeled samples. Furthermore, CITADEL shows significant efficiency over prior work incurring 24 × 24\times faster training and 13 × 13\times fewer operations. Availability . The code is available at https://github.com/IQSeC-Lab/CITADEL.git . I Introduction The Android ecosystem, with over 3 billion active devices, has become a primary target for malware developers [ 1 , 2 ] . The AV‑TEST Institute reports around 5 million new Android malware and potentially unwanted applications (PUAs) annually [ 3 ] , posing a growing challenge to reliable threat detection. Traditional methods such as sandbox analysis and signature matching are labor-intensive, brittle to obfuscation, and struggle to scale [ 4 , 5 ] . As a scalable alternative, machine learning (ML)-based detection systems have gained widespread adoption in both academia and industry [ 6 , 7 , 8 ] , including integration by vendors such as Avast [ 9 ] . These systems learn from structural and behavioral features, and have demonstrated strong performance and generalization [ 10 , 11 ] . Fig. 1 : Concept drift adaptation performance comparison among Chen-AL [ 11 ] , MORSE [ 12 ] , and our proposed semi-supervised active learning system, CITADEL, on four Android malware benchmark datasets—APIGraph [ 13 ] , Chen-AZ [ 11 ] , MaMaDroid [ 14 ] , and LAMDA [ 15 ] . A core challenge in ML-based malware detection is concept drift –the change in the statistical properties of malware and benign samples over time. State-of-the-art concept drift adaptation method leverage active learning (AL) with hierarchical contrastive learning and uncertainty-based sample selection [ 11 ] . Though effective on short-span benchmarks—yielding 92.4% F1 on the 7-year APIGraph dataset [ 13 ] , its performance drops sharply on longer temporal spans, dropping to 43% on the 12-year LAMDA benchmark [ 15 ] and further to 30% on a 12-year curated dataset derived from MaMaDroid [ 14 ] feature (see Figure 1 ). Furthermore, with over 450,000 new malware samples emerging daily [ 16 ] , producing high-quality labels for these enormous volume is time, resource, and budget intensive; human analysts can review only around 80 samples per day [ 17 ] , and vendors may take weeks to agree on newly discovered variants [ 18 , 19 ] . Existing concept drift adaptation methods [ 20 , 11 ] rely heavily on supervised learning, assuming continuous access to labeled data and focusing primarily on short-term evaluations. Such assumptions do not hold in realistic, long-term drift scenarios , where labeled data are scarce and the malware distribution evolves unpredictably. These challenges highlight the need for semi-supervised learning (SSL), which can leverage the abundance of unlabeled samples to maintain adaptability and performance in dynamic, label-scarce environments [ 21 ] . To address long-term malware concept drift adaptation under limited labeling budgets, we propose CITADEL, a SSL framework adapted from FixMatch [ 22 ] , specifically tailored for Android malware detection under distribution shift. Although prior work utilize FixMatch [ 12 ] , their goal is to tackle label noise and data imbalance, which does not address the challenges of concept drift. Moreover, FixMatch is originally designed for computer vision domain and it suffers significantly to offer even reasonable performance for malware detection (see Table III ). As such, we improve it for malware feature representations with domain-relevant transformations—Bernoulli bit flip and Bernoulli feature mask. In practice, there is no deterministic pattern describing how feature distributions evolve over time [ 7 ] , as new malware families may stop using certain API calls, permissions, or intent filters, while adopting others. As such, we hypothesize that Bernoulli-based transformations would be better fit to model the unpredictable nature of adversary induced distribution shifts in malware evolution. To simulate the uncertainty of adversary induced drift, we adopt a probabilistic approach using the Bernoulli distribution to randomly select features for modification. In Bernoulli bit flip, a randomly chosen subset of binary features (such as API calls or permissions) is flipped turning a previously used feature “off” or an unused one “on.” This simulates behavioral changes where malware starts or stops using specific functionalities. For Bernoulli feature mask deactivates a randomly selected subset of features, representing the disappearance of certain patterns (such as deprecated API calls or obsolete permissions) in newer malware variants. Since static features cannot capture entirely new APIs introduced in the future, this feature-space perturbation provides a principled way to simulate evolving distributions. Our analysis show that CITADEL learns feature representations that effectively capture temporal drift. Adapting to such evolving patterns requires AL to selectively query the most informative samples [ 11 ] . Furthermore, malware drift is often abrupt and unpredictable, making such ordered progression ineffective. Many drifted samples tend to lie near the decision boundary—regions where the model is most uncertain and prone to misclassification [ 23 , 24 ] . Additionally, outlier samples often appear as distant points in the latent space, further challenging accurate classification [ 20 ] . To address these issues, we propose a multi-criteria sample selection strategy that prioritizes: (i) low-margin samples (small confidence differences between top predictions), (ii) samples with high L_{p} -norm distances, and (iii) low-confidence predictions. Together, these criteria target samples that are both ambiguous and influential for improving decision boundaries. Moreover, our analysis shows that boundary samples where benign and malware features overlap are particularly challenging to classify. To better handle such drifted and ambiguous cases, we introduce an auxiliary objective that promotes better separation of such ambiguous cases, complementing the semi-supervised loss. Figure 3 illustrates the overall architecture of CITADEL. Our extensive evaluation shows that CITADEL attains strong performance, achieving F1 scores of 93.5% on APIGraph, 82.7% on Chen-AZ, 44.9% on MaMaDroid, and 77.7% on LAMDA. In addition to accuracy, CITADEL provides substantial efficiency gains, offering up to 24 \times faster training

Read the complete text