Multimodal Techniques for Malware Classification

Jonathan Jiang Mark Stamp · 2025

Read Multimodal Techniques for Malware Classification by Jonathan Jiang Mark Stamp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10956.txt.

Introduction

Jonathan Jiang and Mark Stamp test multimodal machine learning for malware classification in this 2025 paper. Their test files are Windows Portable Executable files, the standard format for programs on that system. Such files split into a header and other sections, each with its own structure. The team trained three model types on features from the header alone, from the other sections alone, and from the whole file.

They then built combined models that take the output scores of the single part models as their inputs. Nine header and section pairings were tried this way. The best combined model beat the best single model in their tests. The authors read this as evidence that distinct file parts carry distinct signals worth modeling apart. They present the staged approach as a practical gain for sorting harmful programs from harmless ones.

Catalog record

CREATORJonathan Jiang Mark Stamp
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-10956

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multimodal Techniques for Malware Classification Jonathan Jiang Mark Stamp Abstract The threat of malware is a serious concern for computer networks and systems, highlighting the need for accurate classification techniques. In this research, we experiment with multimodal machine learning approaches for malware classification, based on the structured nature of the Windows Portable Executable (PE) file format. Specifically, we train Support Vector Machine (SVM), Long Short-Term Memory (LSTM), and Convolutional Neural Network (CNN) models on features extracted from PE headers, we train these same models on features extracted from the other sections of PE files, and train each model on features extracted from the entire PE file. We then train SVM models on each of the nine header-sections combinations of these baseline models, using the output layer probabilities of the component models as feature vectors. We compare the baseline cases to these multimodal combinations. In our experiments, we find that the best of the multimodal models outperforms the best of the baseline cases, indicating that it can be advantageous to train separate models on distinct parts of Windows PE files. 1 Introduction Rapid development in technology has changed the way humans use and acquire knowledge and interact with society, leading to an increased reliance on personal computers and smart devices. In recent decades, valuable information has become available on the Internet and on personal computers, and such data is a natural target for cybercriminals [ 1 ] . Cybercrime and malware go hand-in-hand, and hence malware detection and classification are vital concerns in cybersecurity. Windows Portable Executable (PE) files are the most common victims of malware attacks. Due to their popularity, malware creators often choose to attack PE file formats [ 21 ] . Traditional signature-based detection methods are fast, efficient, and accurate for known threats. However, due to their dependency on predefined patterns or signatures of known malware, they lack adaptability and are vulnerable to evasion techniques. Malware that can change its code structure while maintaining malicious functionality can easily escape from the signature-based antivirus scanning [ 12 ] . As a result, machine learning and deep learning techniques have become mainstays in the malware detection field. In this research, we apply machine learning techniques to the problem of Windows PE malware classification using a multimodal approach. In this context, multimodal means that we apply machine learning techniques that combine multiple types of data, with the goal of improving the accuracy of the system. Specifically, in this paper, we train learning models on different parts of PE files, then train another machine learning model with the probability vectors of the component models serving as features. While copious previous research has trained trained a wide variety learning models on a wide range of features, (byte sequences, opcode sequences, API calls, various graph structures, features derived from code analysis, metadata, and so on, there is relatively little research that attempts to directly utilize the structure inherent in PE files [ 24 , 39 , 44 ] . This research expands upon traditional methods by focusing on the structural characteristics of PE files, which are composed of headers and various additional sections (heretofore referred to simply as sections) . We extract features from PE headers and from the PE sections. Then we train models just using the header-based features, we train models just using the sections-based features, and we train models using features from both the header and sections (i.e., the entire PE file). We then train multimodal learning models using the output of the header and section models as the feature vectors. In this context, the output of a model refers to the probability vector generated by the output layer of the model. We then compare the results of these different cases, namely header-based models, section-based models, models trained on the entire PE file, and multimodal models trained on the output of header and sections based models. Note that in the multimodal cases, the training of the header based model and the sections based model can be viewed as a feature engineering step, with the output of these models yielding additional features that may be more informative, as compared to the original features used to train the component models. For the header-based, sections-based models, and the models trained on the entire PE file, we experiment with Support Vector Machines (SVM), Long Short-Term Memory (LSTM) models, and Convolutional Neural Networks (CNN). For the multimodal models we use SVMs to combine the output of the header-based and sections-based models. The remainder of this paper is organized as follows. Section 2 introduces relevant background topics, including an overview of the PE file format and the learning models employed in our experiments. In Section 3 we discuss representative examples of relevant related work. Section 4 presents our experiment, including dataset preparation, feature extraction, model design, hyperparameter tuning, and so on. In this section, we also compare and analyze our results. Section 5 summarizes the key findings of this research and provides some suggestions for further work. 2 Background The Portable Executable (PE) file format is the standard for Windows executables. Due to their ubiquity, PE files are the predominant target for malware creators. According to a 2020 report from Kaspersky, nearly 90% of all malware detected daily occurred in PE files [ 20 ] . Given the frequency of this format in malware attacks, understanding the structure and functionality of PE files may be advantageous for malware analysis. Furthermore, a deep understanding of PE file structure facilitates the extraction of useful features for machine learning-based malware detection. Next, we provide an overview of the PE file format, which is followed by an introduction to the three types of machine learning models considered in this research. 2.1 Overview of the PE File Format The PE file format is derived from the Microsoft Common Object File Format (COFF). It is a highly modular and structured file format that ensures portability and compatibility on various Windows platforms [ 5 ] . Compared to a single contiguous memory-mapped file, PE files utilize header information that provides detailed instructions to the Windows dynamic linker, enabling it to load code (including required libraries) into designated memory locations with the appropriate permissions. This approach is designed to ensure performance and safety during execution. Common PE format executable extensions include .exe , .dll , .scr , and .sys . While all of these file types adhere to the PE structure, each type include unique metadata or characteristics to support their specific use cases [ 10 ] . An example layout of the Windows PE file is shown in Figure 1 . Note that the PE file includes the DOS Header, DOS Stub, PE File Header (aka NT header), Section Table, and Sections. Next, we briefly discuss each of these components of a PE file. Figure 1 : Structure of a Portable Executable (PE) file [ 33 ] DOS Header — The DOS Header is the first data structure in a PE file. It provides backward compatibility with MS-DOS applications, which were applications designed to run in the Microsoft Disk Operating System (MS-DOS) environment during the beginning of 1980. The DOS Header occupies the first 64 bytes of the file, followed by a DOS stub

Read the complete text