Integrating APK Image and Text Data for Enhanced Threat Detection: A Multimodal Deep Learning Approach to Android Malware
Md Mashrur Arifin, Maqsudur Rahman, Nasir U. Eisty · 2026
Read Integrating APK Image and Text Data for Enhanced Threat Detection: A Multimodal Deep Learning Approach to Android Malware by Md Mashrur Arifin, Maqsudur Rahman, Nasir U. Eisty (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08959.txt.
Introduction
Md Mashrur Arifin, Maqsudur Rahman, and Nasir Eisty build a tool to spot bad apps on Android phones. New bad apps hide well, and past apps give no true guide. One strong trick turns app code into an image and lets a sight net read it. But past work oft skips app text facts, such as what rights an app asks for.
The team joins image facts with text facts in one deep net. They also test how image type and size shift the score. That test was oft left out in past work. A reader in phone safety gets a fuller spot tool. It reads both the look of code and the words an app shows to the store.
Catalog record
| CREATOR | Md Mashrur Arifin, Maqsudur Rahman, Nasir U. Eisty |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08959
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Integrating APK Image and Text Data for Enhanced Threat Detection: A Multimodal Deep Learning Approach to Android Malware Md Mashrur Arifin, Maqsudur Rahman, Nasir U. Eisty Abstract As zero-day Android malware attacks grow more sophisticated, recent research highlights the effectiveness of using image-based representations of malware bytecode to detect previously unseen threats. However, existing studies often overlook how image type and resolution affect detection and ignore valuable textual data in Android Application Packages (APKs), such as permissions and metadata, limiting their ability to fully capture malicious behavior. The integration of multimodality, which combines image and text data, has gained momentum as a promising approach to address these limitations. This paper proposes a multimodal deep learning framework integrating APK images and textual features to enhance Android malware detection. We systematically evaluate various image types and resolutions across different Convolutional Neural Networks (CNN) architectures, including VGG, ResNet-152, MobileNet, DenseNet, EfficientNet-B4, and use LLaMA-2, a large language model, to extract and annotate textual features for improved analysis. The findings demonstrate that RGB images at higher resolutions (e.g., 256x256, 512x512) achieve superior classification performance, while the multimodal integration of image and text using the CLIP model reveals limited potential. Overall, this research highlights the importance of systematically evaluating image attributes and integrating multimodal data to develop effective malware detection for Android systems. I Introduction Malware targeting the Android ecosystem is becoming increasingly common, highlighting the urgent need for robust security measures to protect users and sensitive data [ 1 ] . This threat extends beyond individual users to governments and corporations [ 2 ] since sophisticated zero-day malware is evolving at an alarming pace. Malware detection conventionally relies on static or dynamic analysis, and is often vulnerable to obfuscation techniques, which let intruders conceal the real purpose of their programs [ 3 ] . This limitation has increased the demand for developing strategies that go beyond traditional techniques and offer novel perspectives on threat identification. The investigation of image-based deep learning methods for malware detection has gained momentum in recent years [ 4 ] . When viewed as images, APK files highlight specific structural and pattern-based traits that separate dangerous applications from the safe ones. Though promising, this method is still early-stage. Detection performance heavily depends on image attributes like RGB or grayscale, and the optimal image characteristics remain unclear. Specifically, the effectiveness of different types of images, such as RGB and grayscale images, and their respective resolutions (e.g., 128x128, 256x256, and 512x512) has not been comprehensively evaluated. This lack of clarity hinders the development of robust image-based malware detection systems, as varying image formats and resolutions can substantially impact model performance. Moreover, deep learning models only depends upon image based technique often ignore the valuable insights that may be obtained from textual elements found in the manifest files, permissions, and metadata of APKs. The integration of textual data extracted from APK files with image data through multimodal models presents a promising avenue for enhancing malware detection capabilities. While several studies have leveraged language models for textual analysis [ 5 ] , the synergistic potential of combining image and text modalities remains underexplored. Therefore, empirical investigations are needed to assess whether this integration truly enhances or detracts from malware detection accuracy. To investigate this gap, we formulate two research questions: RQ1: How do different image processing techniques and resolutions (e.g., RGB vs. grayscale) impact the effectiveness of distinguishing between benign and malicious Android applications? RQ2: How does integrating image and textual data in a multimodal framework affect the performance of Android malware detection systems? We developed and evaluated a novel prompt-based multimodal approach that integrates both image and text data, offering key insights and practical recommendations for detecting malicious Android applications. Our main contributions are: • Analyzed RGB and Greyscale images at three resolutions (e.g., 128x128, 256x256, 512x512) for Android malware detection, using eight CNN architectures to identify the optimal image attributes. Our results show that RGB images with 256x256 or 512x512 resolutions have balanced accuracy and computational efficiency. • Developed a novel framework combining APK images and prompt-generated text annotations, integrating image and text features using the CLIP model. However, CLIP did not outperform standalone image-based models, with ResNet proving more effective overall. • Provided a limited multimodal dataset comprising diverse attributed images and their corresponding textual annotations, supporting the ongoing enhancement of this dataset. II Related Works Image-Based Malware Detection. An early study introduced the MADRF-CNN model, which converted DEX files into RGB images and achieved 96.9% identification accuracy [ 6 ] , while another study also reported high detection rates using CNNs on color images without relying on textual data [ 7 ] . These studies have shown the effectiveness of CNN-based models for detecting Android malware by converting APK files into images, but they often overlook a systematic evaluation of how image variations like color format and resolution affect detection accuracy. Text-Based Malware Detection. Textual features such as permissions, API calls, and system logs have proven valuable for malware detection, with models such as HYDRA achieving over 99% accuracy by combining these elements with image features [ 8 ] , and hybrid models using GRU and DBN also showing strong performance [ 9 ] . While text-based approaches are effective, they often miss visually distinct patterns that image-based analysis can identify, underscoring the importance of integrating textual and visual data for comprehensive malware detection. Multimodal Approaches Integrating Image and Text Data. Multimodal approaches combine text and image data and promise to improve malware detection [ 10 ] . Ullah et al. [ 11 ] reached 99.27% accuracy by integrating image features with control flow graph-based API analysis. Zhang et al. [ 12 ] achieved 98.9% detection on encrypted traffic using CNNs and deep forest classifiers. These methods enhance detection accuracy and resilience to obfuscation by fusing visual and semantic features. The literature highlights the need to evaluate image attributes in CNNs and combine text and image-based methods for detecting advanced Android malware. This observation supports our study of using multimodal data to improve detection performance and address challenges like obfuscation and resource constraints. III Research Approach III-A Data Collection We collected data on malware and benign APKs from two dataset sources: CIC-AndMal2017 [ 13 ] and CICMalDroid 2020 [ 14 ] . The collected malware includes Adware, Scareware, Banking, and Smsmalware, alongside benign APKs. In total, we collect 4303 malware APKs and 4039 benign APKs. III-B Investigation for Finding the Effective Image Attributes To find the answer for RQ1 , we start by transforming APK Files into two image representations, such as grayscale and RGB, as shown in Fig. 1 . Both image representations were produced at several resolutions: 128x128, 256x256, and 512x512 pixels. Upon completion of the image conversions, we conducted a performance study by training and testing eight CNN models [ 15 ] . The examined models were VGG-16, VGG-19 [ 16 ] , ResNet-50, 101, 152 [ 17 ] , MobileNet-V2 [ 18 ] , DenseNet-169 [ 19 ] , and EfficientNet-B4 [ 20 ] . Each model has unique advantages. VGG models are simple and function as benchmarks, while ResNet models identify complex patterns via deep architectures. MobileNet-V2 is a lightweight and efficient model, ideal for