McNdroid: A Longitudinal Multimodal Benchmark for Robust Drift Detection in Android Malware

Md Mahmuduzzaman Kamol, Jesus Lopez, Saeefa Rubaiyet Nowmi, Emilia Rivas, Md Ahsanul Haque, Edward Raff, Aritran Piplai, Mohammad Saidur Rahman · 2026

Read McNdroid: A Longitudinal Multimodal Benchmark for Robust Drift Detection in Android Malware by Md Mahmuduzzaman Kamol, Jesus Lopez, Saeefa Rubaiyet Nowmi, Emilia Rivas, Md Ahsanul Haque, Edward Raff, Aritran Piplai, Mohammad Saidur Rahman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06894.txt.

Introduction

Md Mahmuduzzaman Kamol and seven co-authors release McNdroid, a longitudinal benchmark for Android malware detection under concept drift. Malware evolves, defenders' models age, and studying that decay needs data organized across time and feature types. McNdroid spans 2013 to 2025, skipping 2015, and describes each app three ways: static features from manifests and code, dynamic behavior from sandbox runs, and function-call graph features.

With time-separated training and test splits, standard and deep detectors degrade clearly as the gap grows. Combining all three modalities beats any single one over long horizons, while agreement between modalities also fades, showing drift corrodes their consistency too. Family evolution and explanation shifts are analyzed, and data, splits, and code are public.

Catalog record

CREATORMd Mahmuduzzaman Kamol, Jesus Lopez, Saeefa Rubaiyet Nowmi, Emilia Rivas, Md Ahsanul Haque, Edward Raff, Aritran Piplai, Mohammad Saidur Rahman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06894

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

McNdroid: A Longitudinal Multimodal Benchmark for Robust Drift Detection in Android Malware Md Mahmuduzzaman Kamol, Jesus Lopez, Saeefa Rubaiyet Nowmi, Emilia Rivas, Md Ahsanul Haque, Edward Raff, Aritran Piplai, Mohammad Saidur Rahman Abstract Machine learning (ML) in real-world systems must contend with concept drift, adversarial actors, and a spectrum of potential features with varying costs and benefits. Malware naturally exhibits all of these complexities, but for the same reason, it is challenging to curate and organize data to study these factors. We present McNdroid, to our knowledge the largest longitudinal multimodal Android malware benchmark for malware detection and drift analysis. McNdroid spans 2013–2025, excluding 2015, and represents each application with three aligned modalities–static features from manifests and smali code, dynamic behavioral features from sandbox execution, and graph-based features from function-call graphs. Using temporally separated splits, we evaluate standard ML and deep-learning detectors across increasing train–test time gaps. Results show clear temporal degradation, while multimodal fusion outperforms the best single modality across long-term temporal gaps. Cross-modal agreement also declines over time, suggesting that drift affects both individual feature spaces and the consistency among modalities. We further analyze modality-specific drift, malware-family evolution, and temporal changes in model explanations. We publicly release McNdroid, benchmark splits, and code to support reproducible research on temporal generalization and robust multimodal learning in security-critical, non-stationary settings. Data: https://huggingface.co/datasets/IQSeC-Lab/McNdroid Code: https://github.com/IQSeC-Lab/McNdroid/ 1 Introduction Malware detection is a large-scale and continuously evolving machine-learning (ML) problem [ 2 , 71 , 18 , 6 , 14 ] . ENISA identifies malware as a major cybersecurity threat [ 23 ] , and services such as VirusTotal process about 1.8 million samples per day [ 75 ] . Traditional methods, including sandbox analysis, hand-crafted features, and signature matching, require substantial manual effort and often struggle with obfuscation and rapidly changing malware [ 59 , 66 ] . Although ML detectors can reduce reliance on manual rules, they face a different challenge–both benign and malicious software evolve over time, causing models trained on historical data to degrade as deployment distributions shift, a problem known as model aging or concept drift [ 49 , 3 , 90 , 11 , 62 ] . Evaluating this degradation requires benchmarks that capture more than one view of an application. Static features provide broad coverage but can be affected by obfuscation, repackaging, API substitution, and structural manipulation [ 6 , 90 , 34 , 89 , 91 , 32 ] . Dynamic traces capture runtime behavior [ 69 , 82 ] , while program graphs capture application structure and dependencies [ 28 , 15 , 31 , 89 ] ; however, both are costly to extract at scale. A useful benchmark should therefore provide aligned static, dynamic, and graph-based views over time, enabling evaluation of how each modality changes and fails under malware evolution . Existing Android malware benchmarks provide useful foundations, but do not fully support multimodal analysis of malware evolution. DREBIN [ 6 ] enabled large-scale Android malware detection, and TESSERACT [ 62 ] and APIGraph [ 90 ] introduced temporal evaluation, but these benchmarks remain limited in coverage, representation, or long-term family-level analysis. LAMDA [ 32 ] , the closest related benchmark, provides 12 years of Android malware data but primarily uses static DREBIN-style features. Such static-only temporal benchmarks cannot reveal whether degradation stems from static artifacts, runtime behavior, program structure, or malware-family shifts. Hidden spatio-temporal biases can also lead to overly optimistic conclusions [ 19 ] . These gaps motivate a temporally structured multimodal benchmark with aligned static, dynamic, and graph-based views [ 28 , 15 , 31 , 89 ] . Table 1 summarizes this gap by comparing existing APK benchmarks across characterization features, modality coverage, dataset scale, temporal span, artifact release, and dataset composition. Existing multimodal benchmarks such as MULTIBENCH and MultiZoo support representation learning, fusion, robustness, and reproducible evaluation across several domains [ 54 , 53 , 13 , 87 , 88 , 33 , 38 , 47 , 48 , 50 , 40 , 4 , 74 ] . However, they are not designed for naturally occurring temporal shift, where modalities, labels, and cross-modal relationships evolve together. This limits their use for evaluating multimodal generalization under realistic deployment shift. Android malware evolution offers a natural setting for this gap. Apps can be represented through static, dynamic, and graph-based modalities, while distributions shift as ecosystems, malware families, APIs, and attacker strategies evolve [ 8 , 85 , 24 ] . This makes malware evolution a useful testbed for studying multimodal models under realistic deployment shift, including fusion, modality robustness, graph learning, long-tailed labels, and continual adaptation. We therefore introduce McNdroid, a large-scale benchmark for temporal multimodal evaluation in Android malware detection. McNdroid supports time-aware evaluation by training models on historical samples and testing them on future samples from shifted distributions [ 21 ] . Unlike single-modality benchmarks, it provides aligned static, dynamic, and graph-based views for each application, enabling analysis of how different modalities change and degrade over time. By preserving chronology, McNdroid supports realistic evaluation of model aging, adaptation, fusion, and generalization under deployment-like shift [ 19 ] . It also serves a broader testbed for multimodal learning under evolving and adversarial distributions. In summary, our key contributions are: • We introduce McNdroid, a large-scale benchmark for temporal multimodal Android malware detection, with 858,859 samples and 1,354 malware families. • We provide three modalities–static, dynamic, and graph-based– for each application, capturing application artifacts, runtime behavior, and program structure. • We provide a time-aware evaluation splits that train models on historical samples and test them on future samples, enabling realistic analysis of concept drift, modality-specific degradation, adaptation, and family-level evolution. • We release pre-extracted feature representations and benchmark protocols to support reproducible research on multimodal fusion, graph learning, long-tailed classification, modality robustness, and generalization under non-stationary malware distributions. Contributions in the Appendices. We include additional analyses and supporting experiments in the appendices: dataset statistics (Appendix A ), comparison with prior multimodal datasets (Appendix B ), a motivating GodFather malware case study (Appendix C ), model descriptions (Appendix D ), multimodal fusion strategies (Appendix E ), extended temporal analysis (Appendix F ), feature-space visualizations (Appendix G ), feature-importance analysis (Appendix H ), sensitivity to missing modalities (Appendix I ), prediction uncertainty under label drift (Appendix J ), additional concept-drift adaptation results (Appendix K ), unsupervised family structure analysis (Appendix L ), continual learning (Appendix M ), malware-family temporal stability (Appendix N ), computational resources (Appendix O ), broader impacts (Appendix P ), and dataset documentation (Appendix Q ). 2 Related Work Malware Datasets and Benchmarks. Large-scale Android malware datasets are essential for training and evaluating ML-based detectors. DREBIN [ 6 ] remains one of the most widely used Android malware datasets based on static features. Other work has explored dynamic and graph-based representations, including MaMaDroid [ 58 ] , MalScan [ 79 ] , and MalNet [ 28 ] . However, malware benchmarks can rapidly become outdated due to evolving obfuscation and dropper techniques [ 62 ] , and may suffer from sampling bias, data snooping, label noise, mixed-source inconsistencies, and unrealistic evaluation protocols [ 5 ] . Prior work such as TESSERACT [ 62 ] and Arp et al. [

Read the complete text