VLAI: A RoBERTa-Based Model for Automated Vulnerability Severity Classification
Cédric Bonhomme, Alexandre Dulaunoy · 2025
Read VLAI: A RoBERTa-Based Model for Automated Vulnerability Severity Classification by Cédric Bonhomme, Alexandre Dulaunoy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03607.txt.
Introduction
Cédric Bonhomme and Alexandre Dulaunoy introduce VLAI in this 2025 paper, a model that grades how severe a software flaw is, straight from its written description. Security teams now score flaws by hand with a shared scoring system, which is slow and uneven. A model that reads the text first could speed up triage and make early grades more alike across teams.
VLAI builds on RoBERTa, a language model, and was fine-tuned on more than 600,000 real flaws. It predicts the severity class with over eighty-two percent accuracy. Both the model and its training data are open source. The tool already runs inside the Vulnerability-Lookup service, where it helps staff sort new flaws before hand scoring.
Catalog record
| CREATOR | Cédric Bonhomme, Alexandre Dulaunoy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03607
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VLAI: A RoBERTa-Based Model for Automated Vulnerability Severity Classification Cédric Bonhomme, Alexandre Dulaunoy Abstract This paper presents VLAI, a transformer-based model that predicts software vulnerability severity levels directly from text descriptions. Built on RoBERTa, VLAI is fine-tuned on over 600,000 real-world vulnerabilities and achieves over 82% accuracy in predicting severity categories, enabling faster and more consistent triage ahead of manual CVSS scoring. The model and dataset are open-source and integrated into the Vulnerability-Lookup service. Topics: Measuring vulnerabilities, Exploits or exploitation , Decision science of vulnerability management 1 Introduction Thousands of new software vulnerabilities are disclosed every year, often initially with only a brief textual description and without an official severity score. Security experts later analyze these vulnerabilities and assign severity ratings using standards like the Common Vulnerability Scoring System (CVSS). However, this manual assessment process can take days, leaving a critical gap where defenders must prioritize vulnerabilities without clear guidance. To bridge this gap, we present VLAI (Vulnerability Lookup AI) – an NLP model that predicts a vulnerability’s severity directly from its description, before any official score is available. Our approach leverages a fine-tuned RoBERTa transformer [ 10 ] to classify vulnerability descriptions into severity categories, enabling security analysts to obtain an immediate estimated severity (the “VLAI score”) based solely on the description. The entire solution is open-source and integrated into the Vulnerability-Lookup service, providing the community with timely severity estimates and a continuously improving model. 2 Related Work Early efforts to automate vulnerability severity estimation used classical NLP and machine learning techniques. For example, statistical models have been trained on vulnerability descriptions to predict CVSS metrics or scores with varying success. Recent advances in deep learning have enabled more accurate predictions: Shahid et al. (2021) [ 13 ] used BERT-based classifiers (in a system called CVSS-BERT) to determine the full CVSS vector from a description, and reported that the computed severity scores were very close to the actual scores assigned by human experts. Industry practitioners have also shown interest in this problem; for instance, PRIOn developed NLP models to predict CVSS base scores and vectors from text, citing the delay in official scoring and the need for faster risk assessment. Our work follows this line of research by fine-tuning a Transformer-based model on an even larger consolidated dataset of vulnerabilities, and is, to our knowledge, one of the first open and continuously updated deployments of such a model integrated into a public vulnerability lookup service. Recent research has also explored the use of semantic similarity techniques for structured vulnerability classification. Kota et al. [ 9 ] proposed a novel approach to predict CWE identifiers from CVE descriptions using a cross-encoder architecture. Their method leverages the hierarchical structure of the MITRE CWE taxonomy and trains separate cross-encoder models for each layer of the CWE tree. By combining these models with a binary classifier, they achieved an overall test accuracy of 72.1% and a macro-averaged F1 score of 0.735 across nearly 14,000 CVE entries. This work demonstrates the potential of semantic text similarity and layered classification strategies for automating weakness identification, complementing efforts focused on severity classification. 3 System Architecture and Data Pipeline Figure 1: Automated pipeline for dataset creation and model training in the Vulnerability-Lookup AI system. A more detailed presentation of the Vulnerability-Lookup internal architecture can be found in [ 2 ] . The pipeline consists of four main stages, executed on a regular schedule to keep the model up-to-date: 1. Data Collection: Security advisories from multiple sources are imported into the Vulnerability- Lookup platform /citeVulnerabilityLookup on an ongoing basis (hourly). These sources include official feeds and repositories such as the CVE Program, NVD APIs, GitHub Security Advisories, PyPI security advisories, and vendor CSAF feeds (details in Dataset section). All collected advisories are stored in a centralized database (using a KV storage, kvrocks). 2. Dataset Generation: Each day, a snapshot of the accumulated vulnerability data is transformed into a training dataset for the model. We extract each vulnerability’s unique ID, description text, associated CPEs (affected product identifiers), and any available CVSS scores (v2, v3.0, v3.1, etc.). This dataset is saved in a standardized format (Parquet) and uploaded to the Hugging Face Hub (as the CIRCL/vulnerability-scores dataset) for transparency and community access. The dataset currently contains 610k entries split into a training set ( 550k) and test set ( 60k), and it grows as new vulnerabilities are disclosed. 3. Model Training: Using the freshly built dataset, the severity classification model is retrained (fine- tuned) daily on our GPU servers. We leverage the open-source VulnTrain tool to orchestrate fine- tuning of a RoBERTa-base model [ 10 ] on this data. The training process (detailed in Section Model and Training) typically runs for 5 epochs on two NVIDIA L40S GPUs, completing in approximately 6 hours for the full dataset. After training, the updated model and tokenizer artifacts are saved. 4. Deployment: The newly trained model checkpoint is automatically uploaded to the Hugging Face Model Hub under the organization’s repository [ 6 ] . This allows the community to access the latest model version immediately. The model is also integrated into the online Vulnerability-Lookup service, so that users querying a vulnerability with no known CVSS will see the VLAI-predicted severity alongside other information. This continuous cycle ensures that both the data and the model keep pace with the evolving vulnerability landscape. 4 Dataset The CIRCL/vulnerability-scores dataset [ 4 ] [ 11 ] is a comprehensive collection of vulnerability descriptions and their associated severity scores. It compiles data from multiple respected sources in the security community, providing a rich and diverse training corpus. The current sources are: CVE Program (enriched with data from vulnrichment and Fraunhofer FKIE), GitHub Security Advisories, PySec advisories, CSAF feeds from Red Hat, CISCO and CISA. All these sources are configured by default in Vulnerability-Lookup. The sources of data include (but are not limited to): • CVE Program (NVD): The official MITRE CVE list and NIST’s National Vulnerability Database entries, enriched with additional data from projects like vulnrichment and Fraunhofer FKIE [ 7 ] . These records supply standardized descriptions and CVSS scores assigned by NVD analysts if present. • GitHub Security Advisories (GHSA): Vulnerability advisories from the GitHub Advisory Database: covering security issues in open-source packages (often with CVE IDs and sometimes CVSS v3 scores provided by maintainers or GitHub). • PyPI Security Advisories: Reports of Python package vulnerabilities (PyPI), which contribute additional descriptions of software flaws not always captured in NVD. • CSAF Feeds: Machine-readable security advisories in CSAF format from vendors such as Red Hat and Cisco, which include detailed vulnerability information and vendor-assigned severities. Each entry in the dataset [ 4 ] [ 11 ] represents a single vulnerability and includes several fields: a unique identifier (e.g. CVE-IDs, GHSA IDs, vendor bulletin IDs), a short title, the full textual description of the vulnerability, a list of associated CPE names (affected product identifiers), and the CVSS base scores in various versions If multiple CVSS versions exist for a given record (e.g., both v2 and v3), all are recorded. Not all vulnerabilities have an official score at first; many advisories (especially from third-party sources or very recent disclosures) have a non-defined value in these score fields, indicating no