A Benign Activity Extraction Method for Malignant Activity Identification using Data Provenance
Taishin Saito · 2025
Read A Benign Activity Extraction Method for Malignant Activity Identification using Data Provenance by Taishin Saito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19370.txt.
Introduction
Taishin Saito tackles a clutter problem in hunting cyber intruders. Security tools can chain together related computer events into a dependency graph, which should expose an attack's path. In practice the graph explodes, because countless normal operations by legitimate users get tangled into the chain.
The proposed method learns the shapes of routine activity from system logs, using language processing and similarity checks, then strips those benign patterns out of the graph. On a large public dataset from DARPA, routine patterns covered roughly seven to thirty-nine percent of all activity. Removing patterns learned from a sliver of the logs shrank the search space by up to about half, making real attacks easier to spot.
Catalog record
| CREATOR | Taishin Saito |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19370
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Benign Activity Extraction Method for Malignant Activity Identification using Data Provenance Taishin Saito Abstract Author: ([email protected]) Supervisor: Dr./Prof. Kuniyasu Suzaki ([email protected]) This thesis was submitted as partial fulfilment of a MSc degree in Informatics Graduate School of Information Security Institute of Information Security Yokohama, Japan Abstract In order to understand the overall picture of cyber attacks and to identify the source of cyber attacks, a method to identify malicious activities by automatically creating a graph that ties together the dependencies of a series of related events by tracking Data Provenance has been developed. However, the problem of dependency explosion, in which a large number of normal computer system operations such as operations by authorized users are included in the dependencies, results in a huge generated graph, making it difficult to identify malicious activities. In this paper, we propose a method to reduce the search space for malicious activities by extracting and removing frequently occurring benign activities through natural language processing of log data and analysis of activities in the computer system using similarity judgments. In the evaluation experiment, we used the DARPA TC Dateset, a large-scale public dataset, to evaluate the effectiveness of the proposed method on the dependency explosion problem. In addition, we showed that about 6.8 to 39% of the activities in a computer system could be defined as patterns of benign activities. In addition, we showed that removing benign activities extracted from a portion of the log data (approximately 1.4% to 3.2% in size) can significantly reduce the search space (up to approximately 52%) in large data sets. CONTENTS LIST OF FIGURES LIST OF TABLES Chapter 1 Introduction 1.1 Background In recent years, cyber attacks on organizations have been becoming increasingly complex and sophisticated. In particular, the damage caused by targeted attacks and ransomware has been escalating, making it difficult to counter such threats using traditional defense mechanisms alone. Under these circumstances, as cyber attacks continue to advance, efforts to completely prevent intrusions by attackers are facing significant challenges. Figure 1.1 illustrates the number of ransomware detections by detection layer, based on data published in 2023 [ 1 ] . Traditionally, ransomware was often detected through emails or the web, suggesting that ransomware attacks were predominantly conducted via large-scale spam email campaigns containing malicious links or other bulk-distribution methods over email and the web. However, in recent years, it has been reported that a significant portion of ransomware detections occur as files within endpoints, indicating that attackers have successfully breached initial defenses, allowing ransomware to reach deeper into computer systems [ 1 ] . One of the factors contributing to these intrusions is the use of customized attack techniques in advanced targeted attacks, which enable attackers to evade intrusion detection systems [ 2 ] . Figure 1.2 shows the number of attacks detected in 2023, categorized by MITRE ATT&CK tactics [ 1 ] . Among the tactics defined in MITRE ATT&CK [ 3 ] , which is a framework for classifying attackers’ strategies, techniques, and procedures, those classified under ”Defense Evasion” were detected the most frequently. This suggests that attackers are focusing their efforts on evading detection by security tools. Furthermore, in recent years, there has been an increase in interactive attacks conducted manually by human operators without relying on malware, leading to an increase in stealthy and sophisticated attacks that are difficult to detect [ 4 ] . Another major factor that allows intrusions is the inability to effectively analyze the vast number of alerts generated daily by intrusion detection systems. Since it is difficult to completely prevent intrusions, methods for promptly investigating the root cause of an attack once an intrusion has been identified are actively being explored. When an attack is detected, investigations are conducted using log collection and forensic techniques. However, there is a shortage of security professionals with the necessary technical expertise to analyze the overwhelming number of alerts generated by intrusion detection systems, often exceeding the number that analysts can handle [ 5 ] [ 6 ] . Given the limitations of manual analysis by security analysts, Data Provenance-based analysis is increasingly being adopted to facilitate rapid investigation of attack activities [ 16 ] . Data Provenance analysis automatically correlates event dependencies within a computer system based on log data and outputs them as a graph. This allows security teams to visualize a sequence of events as a continuous attack activity, thereby simplifying the previously manual analysis process [ 14 ] . In other words, by visualizing the dependencies of processes, files, and other entities as a dependency graph, analysts can conduct investigations more efficiently. Furthermore, to detect attacks that traditional detection systems—based on individual files, processes, and other isolated entity information—fail to recognize, provenance-based Endpoint Detection and Response (EDR) systems have been developed, utilizing dependency relationships between entities within a computer system to enhance attack detection [ 10 ] [ 11 ] [ 12 ] [ 13 ] [ 22 ] . However, a major challenge in utilizing Data Provenance is the ”dependency explosion” problem. When linking events within a computer system using simple rule-based correlation, benign activities unrelated to the attack may also be included in large volumes, leading to the generation of enormous graphs. Ideally, the generated graph should consist solely of attack-related activities, but due to the dependency explosion issue, analysts must analyze massive graphs that contain both benign and malicious events, imposing a significant burden on their workload. Therefore, it is necessary to address the dependency explosion issue in Data Provenance-based graphs and generate optimized graphs where unnecessary dependencies have been removed while preserving attack-related dependencies. Numerous approaches have been proposed to mitigate dependency explosion. Existing methods primarily focus on identifying and excluding individual benign events from the analysis or extracting malicious activities [ 10 ] [ 18 ] [ 19 ] [ 20 ] [ 21 ] . However, identifying individual benign events is challenging because the classification of an event as benign depends on an organization’s policies and the specific characteristics of its computer systems, making it difficult to apply universally across all systems. Additionally, extracting only malicious activities requires continuously updating knowledge to keep up with evolving attack techniques. Even when anomaly-based detection methods that do not rely on predefined malicious activity patterns are used, they still require periodic retraining to accommodate changes in benign behavior, such as login attempts to newly deployed legitimate servers. Figure 1.1 : Ransomware Detection Layers (Left: Email, Center: Web, Right: File) [ 1 ] Figure 1.2 : Detection Counts by MITRE ATT&CK Tactics [ 1 ] 1.2 Purpose and Contribution The objective of this study is to address the issue of dependency explosion in order to facilitate the analysis of attack activities. Furthermore, this study aims to develop a method that can adapt to the unique activity patterns of an organization’s computer system while reducing dependencies without requiring frequent retraining. To achieve this, we propose a method that leverages natural language processing and similarity analysis to extract benign activities within a computer system and remove them from the dependency graph. Contributions of This Study The contributions of this study are as follows: We propose a method to extract frequently occurring benign activities from log data and