Applications of Positive Unlabeled (PU) and Negative Unlabeled (NU) Learning in Cybersecurity
Robert Dilworth, Charan Gudla · 2024
Read Applications of Positive Unlabeled (PU) and Negative Unlabeled (NU) Learning in Cybersecurity by Robert Dilworth, Charan Gudla (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-06203.txt.
Introduction
Robert Dilworth and Charan Gudla survey a learning style that fits security data well. Their paper, from twenty twenty-four, covers positive-unlabeled and negative-unlabeled learning. These methods train from a few known bad cases plus a sea of unlabeled ones. Medicine and marketing use them, but security has barely tried.
Labels in security are scarce and lopsided, which is the exact gap these methods fill. The authors frame four uses: intrusion alerts, flaw ranking, malware hunting, and threat feeds. Each gets a formal problem setup with math backing. Scaling to real-time feeds and shifting attacks remain open hard spots. The paper ends with paths to close those gaps.
Catalog record
| CREATOR | Robert Dilworth, Charan Gudla |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-06203
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Applications of Positive Unlabeled (PU) and Negative Unlabeled (NU) Learning in Cybersecurity Robert Dilworth, Charan Gudla Abstract . This paper explores the relatively underexplored application of Positive Unlabeled (PU) Learning and Negative Unlabeled (NU) Learning in the cybersecurity domain. While these semi-supervised learning methods have been applied successfully in fields like medicine and marketing, their potential in cybersecurity remains largely untapped. The paper identifies key areas of cybersecurity–such as intrusion detection, vulnerability management, malware detection, and threat intelligence–where PU/NU learning can offer significant improvements, particularly in scenarios with imbalanced or limited labeled data. We provide a detailed problem formulation for each subfield, supported by mathematical reasoning, and highlight the specific challenges and research gaps in scaling these methods to real-time systems, addressing class imbalance, and adapting to evolving threats. Finally, we propose future directions to advance the integration of PU/NU learning in cybersecurity, offering solutions that can better detect, manage, and mitigate emerging cyber threats. 1. Introduction Cybersecurity is a critical field, tasked with protecting digital assets from attacks. Traditional supervised learning methods require both positive (attack) and negative (non-attack) labels for building robust models. However, in many cybersecurity scenarios, negative labels are difficult to acquire, or the data is heavily skewed towards positive examples. Positive Unlabeled (PU) Learning and Negative Unlabeled (NU) Learning offer a way to address these challenges by using limited labeled data and a large pool of unlabeled data. This paper explores how these semi-supervised learning techniques can be applied to various subfields of cybersecurity, from intrusion detection to threat hunting. 2. Contributions of the Body of Work The primary contribution of this paper is the systematic identification and exploration of PU and NU Learning applications in cybersecurity. This work: • Identifies subfields within cybersecurity that could benefit from PU and NU Learning. • Provides a theoretical framework to justify the applicability of these methods. • Discusses existing research and identifies key gaps in the literature. • Proposes potential future research directions in these areas. 3. Research Questions The research addresses the following key questions: • In which subfields of cybersecurity can PU and NU Learning provide tangible improvements over traditional implementations? • How can PU and NU Learning be conceptually justified in the context of cybersecurity? • What are the limitations and challenges of applying these methods to cybersecurity datasets? 4. Paper Structure 5. Background 5.1. Positive Unlabeled Learning PU Learning involves training a binary classifier using only positive and unlabeled data. The goal is to develop a model that distinguishes between positive (attack) and negative (non-attack) classes, with the negative class largely hidden in the unlabeled data. Mathematically, this can be modeled as minimizing the classification risk: (1) R(f)=\mathbb{E}_{x\in P}[\ell(f(x),1)]+\mathbb{E}_{x\in U}[\ell(f(x),-1)] where P is the set of positive examples, U is the unlabeled set, and \ell is the loss function. 5.2. Negative Unlabeled Learning In NU Learning, the negative class is known, and the goal is to identify the positive class within the unlabeled data. This is useful in scenarios like anomaly detection, where the majority class is non-anomalous, but anomalies (positive class) need to be identified from unlabeled data. This can be formulated as: (2) R(f)=\mathbb{E}_{x\in N}[\ell(f(x),-1)]+\mathbb{E}_{x\in U}[\ell(f(x),1)] where N is the negative (benign) set, and U is the unlabeled set. 5.3. Cybersecurity Cybersecurity encompasses a wide range of subfields, each focusing on protecting various aspects of digital systems and information. As the digital landscape becomes increasingly complex, so do the types of threats, requiring specialized approaches to mitigate potential attacks. Positive Unlabeled (PU) and Negative Unlabeled (NU) Learning offer new possibilities for solving classification problems where labeled data is scarce, and the majority of data is unlabeled. This section provides an overview of the major subfields of cybersecurity and discusses the potential for applying PU and NU Learning to these areas. 5.3.1. Cryptography Cryptography involves the design and analysis of secure communication protocols and algorithms, with the primary goals of ensuring confidentiality, integrity, and authentication of data. In formal terms, cryptographic systems rely on transformations T_{k} , where k is a cryptographic key, that take plaintext data P and convert it into ciphertext C : (3) C=T_{k}(P) Decryption reverses this process: (4) P=T_{k}^{-1}(C) The security of cryptographic systems depends on the intractability of discovering P without access to the key k . PU learning could be applied to anomaly detection in cryptographic usage, identifying irregular patterns in encrypted communication to detect unauthorized decryption attempts or cryptographic key misuse. 5.3.2. Network Security Network security focuses on protecting computer networks from attacks, ensuring data transmitted across the network remains secure. This typically involves implementing firewalls, Intrusion Detection Systems (IDS), and secure network protocols. Network traffic can be represented as sequences of packets \{p_{i}\} , each containing information about source, destination, and data payload: (5) p_{i}=(s_{i},d_{i},D_{i}) where s_{i} and d_{i} represent the source and destination, and D_{i} is the data. Network intrusion detection can be framed as a PU learning problem, where known malicious traffic forms the positive class, and all other traffic remains unlabeled. NU learning could also be applied to label benign traffic and identify anomalies. 5.3.3. Application Security Application security involves the identification and mitigation of vulnerabilities in software applications to prevent unauthorized access, data breaches, and other cyberattacks. Each application A has a set of potential vulnerabilities \{V_{1},V_{2},\dots,V_{n}\} , where the goal is to detect and mitigate each V_{i} . PU learning could be used to detect unknown vulnerabilities by learning from a small set of known positive vulnerabilities and treating all other software behaviors as unlabeled data. This could significantly improve vulnerability management by focusing on code patterns that resemble known flaws. 5.3.4. Incident Response and Forensics Incident response deals with detecting, analyzing, and responding to security incidents, while forensics focuses on collecting and preserving digital evidence for legal investigations. Formally, incident logs can be denoted as a sequence of events E=\{e_{1},e_{2},\dots,e_{n}\} , where each e_{i} contains information about timestamps, users, and actions: (6) e_{i}=(t_{i},u_{i},a_{i}) Given the rarity of security breaches, incident response could benefit from NU learning by focusing on identifying positive instances of attacks within a dataset dominated by negative (normal) activity logs. Forensics, similarly, could use PU learning to identify anomalies in system behavior logs for proactive evidence gathering. 5.3.5. Risk Management Risk management in cybersecurity involves identifying, assessing, and mitigating potential threats to an organization’s assets, operations, and reputation. The risk level R for a given asset can be modeled as a function of threat likelihood L(T) , impact I , and vulnerability V : (7) R=L(T)\times I\times V In practice, risk management processes are data-intensive and can benefit from PU learning to classify unknown risks based on patterns identified in previously assessed threats, while NU learning can identify unknown negative risks based on minimal positive samples. 5.3.6. Security Operations (SIEM and SOAR) Security operations involve real-time monitoring and response to security events through systems like Security Information and Event Management (SIEM) and Security Orchestration, Automation, and Response (SOAR). Let A=\{a_{1},a_{2},\dots,a_{n}\} represent the actions taken in response to detected threats T=\{t_{1},t_{2},\dots,t_{m}\} . Real-time data monitoring generates alerts based on predefined threat patterns, but false positives are common. PU learning can refine SIEM alerts by classifying which events are actual threats, using a small set of labeled