From Attack Descriptions to Vulnerabilities: A Sentence Transformer-Based Approach Journal: Journal of Systems and Software
Refat Othman, Diaeddin Rimawi, Bruno Rossi, Barbara Russo · 2025
Read From Attack Descriptions to Vulnerabilities: A Sentence Transformer-Based Approach Journal: Journal of Systems and Software by Refat Othman, Diaeddin Rimawi, Bruno Rossi, Barbara Russo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02077.txt.
Introduction
Refat Othman, Diaeddin Rimawi, Bruno Rossi, and Barbara Russo link attack descriptions to known vulnerabilities with sentence transformer models. Vulnerabilities are public flaws cataloged in CVE reports, and tying an attack to its flaw speeds incident response. Manual mapping cannot keep pace with disclosure volume. The team evaluates fourteen leading sentence embedding models on this matching task.
One model leads on technique descriptions, with strong precision and recall scores. About half of its flagged flaws also appear linked to attacks in the official repositories. Manual checks uncover hundreds of predicted links missing from those repositories entirely. Automating the link thus sharpens detection and shrinks the window where flaws stay exploitable. The study covers both validation and discovery value.
Catalog record
| CREATOR | Refat Othman, Diaeddin Rimawi, Bruno Rossi, Barbara Russo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02077
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Attack Descriptions to Vulnerabilities: A Sentence Transformer-Based Approach Journal: Journal of Systems and Software Refat Othman, Diaeddin Rimawi, Bruno Rossi, Barbara Russo Abstract In the domain of security, vulnerabilities frequently remain undetected even after their exploitation. In this work, vulnerabilities refer to publicly disclosed flaws documented in Common Vulnerabilities and Exposures (CVE) reports. Establishing a connection between attacks and vulnerabilities is essential for enabling timely incident response, as it provides defenders with immediate, actionable insights. However, manually mapping attacks to CVEs is infeasible, thereby motivating the need for automation. This paper evaluates 14 state-of-the-art (SOTA) sentence transformers for automatically identifying vulnerabilities from textual descriptions of attacks. Our results demonstrate that the multi-qa-mpnet-base-dot-v1 (MMPNet) model achieves superior classification performance when using attack Technique descriptions, with an F 1 -score of 89.0, precision of 84.0, and recall of 94.7. Furthermore, it was observed that, on average, 56% of the vulnerabilities identified by the MMPNet model are also represented within the CVE repository in conjunction with an attack, while 61% of the vulnerabilities detected by the model correspond to those cataloged in the CVE repository. A manual inspection of the results revealed the existence of 275 predicted links that were not documented in the MITRE repositories. Consequently, the automation of linking attack techniques to vulnerabilities not only enhances the detection and response capabilities related to software security incidents but also diminishes the duration during which vulnerabilities remain exploitable, thereby contributing to the development of more secure systems. 1 Introduction Cybersecurity represents a fundamental challenge in the protection of modern systems, which are continually exposed to evolving and complex cyber threats [ 1 ] . Once a cyberattack manifests, immediate action is essential to detect and mitigate the vulnerabilities exploited during an incident. When these vulnerabilities are not quickly identified and linked to the attack, systems remain exposed to malicious activities, resulting in substantial financial and operational losses. In fact, cyberattacks are expected to cost organizations $3 trillion in 2015, $6 trillion in 2021, and more than $10.5 trillion annually by 2025 [ 2 ] . Moreover, an attacker targets an organization’s system over a thousand times a week on average [ 3 ] . However, cybersecurity professionals can leverage Cyber Threat Intelligence (CTI) to proactively defend against cyberattacks [ 4 ] . In this context, well-structured cybersecurity knowledge repositories are crucial for effective defense. These resources assist security analysts in understanding and tracing connections between a system’s vulnerabilities and the methods used to exploit them. The MITRE Corporation has created a collection of resources, such as Adversarial Tactics, Techniques, and Common Knowledge (ATT&CK) [ 5 ] , Common Attack Pattern Enumeration and Classification (CAPEC) [ 6 ] , Common Weakness Enumeration (CWE) [ 7 ] , and Common Vulnerabilities and Exposures (CVE) [ 8 ] . ATT&CK provides tactics, techniques, and procedures (TTPs) used by cyber attackers. CAPEC represents a publicly available catalog of common attack patterns helping to understand how attackers can exploit weaknesses [ 6 ] . In addition, CAPEC is structured as a list of information about the attack, including techniques for the attack, potential outcomes, and mitigations [ 9 ] . CWE is a community-developed collection of typical weaknesses in software, coding errors, and security flaws. CVE is a standardized dictionary of common terms for publicly known cybersecurity vulnerabilities. All these initiatives aim to enhance the efficiency of identifying, finding, and fixing vulnerabilities by providing a unified naming system [ 10 , 11 ] . The CVE entries are widely used, but CVE issues often lack contextual information about the attack techniques that may exploit them [ 12 , 13 ] . MITRE repositories such as ATT&CK, CAPEC, CWE, and CVE provide valuable and structured knowledge. However, because these repositories are normally maintained manually and evolve independently, they often lack cross-references between related entities. For example, many CVE reports contain detailed vulnerability descriptions but rarely indicate which attack techniques might exploit them, while ATT&CK entries describe adversary behaviors without explicitly citing the CVEs they could trigger. Consequently, analysts who need to trace from an observed technique to actionable CVE identifiers encounter a fragmented search process that is time-consuming and prone to omissions. Given the scale of these resources, with 625 ATT&CK Techniques and more than 295,000 CVEs [ 8 ] , manual mapping is infeasible. This burden is compounded by the complexity and rapid evolution of cyber threats, which introduce latency and inconsistencies in manual curation and leave essential links missing or outdated. As a result, vulnerabilities may remain undetected even after exploitation, and delays in linking attacks to the exploited vulnerabilities hinder timely response and remediation. Systematically linking ATT&CK techniques to CVE vulnerabilities would provide immediate, actionable insights for decision-makers. Therefore, automating this process is crucial, as it accelerates threat mitigation, supports timely decision-making, and strengthens defensive mechanisms. A key insight underlying our work is that when an attack description and a vulnerability report share semantically similar characteristics, such as affected software components, exploited behaviors, or observable consequences, then it is possible to infer a context link between them using sentence transformers. For instance, ATT&CK Technique T1566.001 (Spearphishing Attachment) involves adversaries delivering emails with malicious file attachments to deceive users and execute payloads. This behavior semantically aligns with several CVEs that exploit similar deception techniques, including spoofed file types, misleading download dialogs, and inconsistently rendered file names (e.g., CVE-2001-0398 , CVE-2002-0722 , CVE-2004-1104 , CVE-2005-1575 , and CVE-2005-0243 ). These semantic overlaps suggest that the link between attack techniques and vulnerabilities can be inferred by analyzing the linguistic similarity between their textual descriptions. Thus, our solution leverages transformer-based sentence models, which are pre-trained to understand semantic relationships between textual inputs. These models encode both attack and vulnerability descriptions into fixed-size embeddings in a shared vector space. Computing cosine similarity between these embeddings to predict the links between attack and vulnerability descriptions can help define how closely these embeddings relate in the vector space, allowing for the discovery of meaningful links that can be missed manually. To address this challenge, our previous work introduced VULDAT [ 14 ] , a tool for linking MITRE ATT&CK techniques to CVE vulnerabilities using MPNet-based sentence embeddings. While effective, VULDAT focused only on Technique descriptions and evaluated nine transformer models. In this paper, we propose a more comprehensive solution that extends VULDAT by evaluating 14 state-of-the-art (SOTA) transformer models for automated vulnerability detection from cyberattack text. Our approach leverages the SOTA sentence transformers to link the textual description of an attack (Tactic, Technique, Procedure, and Attack Pattern) to the textual description of CVE reports, demonstrating the model’s effectiveness in both validating known links and discovering new links in the MITRE repositories. Through automation, our approach reduces the time and effort required for vulnerability identification and provides timely, actionable data that enables cybersecurity professionals to respond to threats more quickly and effectively. To validate our approach, we have built an annotated dataset with explicit links found in MITRE repositories. Our approach’s dataset and source code are available on GitHub [ 15 ] . Thus, we intend to answer the following research questions: 1. RQ 1 : (Transformers’ comparison) Which combination of attack information and sentence transformer model achieves the best performance in detecting