AI-Based Software Vulnerability Detection: A Systematic Literature Review Journal: CSUR CCS: Security and privacy Software and application security CCS: General and reference Surveys and overviews

Samiha Shimmi, Hamed Okhravi, Mona Rahimi · 2025

Read AI-Based Software Vulnerability Detection: A Systematic Literature Review Journal: CSUR CCS: Security and privacy Software and application security CCS: General and reference Surveys and overviews by Samiha Shimmi, Hamed Okhravi, Mona Rahimi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-10280.txt.

Introduction

Samiha Shimmi, Hamed Okhravi, and Mona Rahimi published a systematic literature review in twenty twenty-five of artificial intelligence methods for finding software vulnerabilities. Traditional detectors lean on static analysis and hand-written rules; the field has swung toward learned models. The review covers studies from twenty eighteen to twenty twenty-three.

The authors build a taxonomy of techniques, feature representations, and embedding methods across the literature. Ninety-one percent of studies used AI-based approaches, with graph-based models — which read code as structured graphs — the most common. They flag weak points in data set quality, reproducibility, and interpretability. Underexplored directions like federated learning and quantum neural networks get highlighted as a research road map.

Catalog record

CREATORSamiha Shimmi, Hamed Okhravi, Mona Rahimi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-10280

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI-Based Software Vulnerability Detection: A Systematic Literature Review Journal: CSUR CCS: Security and privacy Software and application security CCS: General and reference Surveys and overviews Samiha Shimmi, Hamed Okhravi, Mona Rahimi Abstract . Software vulnerabilities in source code pose serious cybersecurity risks, prompting a shift from traditional detection methods (e.g., static analysis, rule-based matching) to AI-driven approaches. This study presents a systematic review of software vulnerability detection (SVD) research from 2018 to 2023, offering a comprehensive taxonomy of techniques, feature representations, and embedding methods. Our analysis reveals that 91% of studies use AI-based methods, with graph-based models being the most prevalent. We identify key limitations, including dataset quality, reproducibility, and interpretability, and highlight emerging opportunities in underexplored techniques such as federated learning and quantum neural networks, providing a roadmap for future research. 1. Introduction Software vulnerabilities have been an ever-growing problem over the past decades ( cve [n. d.] ) , and despite the vast body of work on software vulnerability detection (SVD) techniques (a.k.a. sanitization techniques) ( Song et al. 2019 ) , new and more effective techniques are still needed in this area. Software vulnerabilities can have large-scale, damaging impacts as demonstrated, among others, by the infamous vulnerabilities in Apache Log4j2 ( NVD 2024a ; NVD 2024b ) that affected more than 35K Java packages ( Zhang et al. 2023e ) . Such vulnerabilities are often identified and enumerated in databases such as the Common Vulnerabilities and Exposures (CVEs) 1 1 1 https://cve.mitre.org/ for individual vulnerabilities, and Common Weakness Enumeration (CWE) 2 2 2 https://cwe.mitre.org/ for vulnerability categories. According to the CVE database, the number of reported CVEs has grown substantially over time. In 1999, only 321 CVE records were reported, whereas in 2023, the total reported record has increased to 29k ( MITRE 1999 ) . This substantial increase demonstrates, despite decades of research in this area, effective and scalable SVD techniques are still a major need for cybersecurity. Perhaps unsurprisingly, with the recent significant growth in artificial intelligence (AI)-based techniques and their application to security, AI has been applied to the SVD as well. Transformers, first introduced in 2017, revolutionized the field by enabling AI models to learn patterns in sequential data, such as text or code, and handle tasks like translation or summarization ( Vaswani et al. 2017 ) . BERT, introduced in 2018, builds on transformers by understanding the meaning of words within their surrounding context, making it particularly powerful for natural language processing tasks ( Devlin et al. 2018 ) . Large language models (LLMs) have pushed this capability even further, generating human-like text and answering complex questions ( Brown et al. 2020 ) . Graph Neural Networks (GNNs) ( Scarselli et al. 2008 ) provide another dimension by learning from data structured as graphs, such as code dependency networks or social connections, enabling the detection of intricate patterns and relationships . Self-supervised learning allows AI models to identify useful structures in data without relying on manually labeled examples, making it possible to leverage vast, unlabeled datasets ( IBM [n. d.] ) . Automated Machine Learning (AutoML) ( Feurer et al. 2015 ) simplifies the process of building and tuning models, enabling non-experts to harness machine learning’s power. Explainable AI (XAI) ( Ribeiro et al. 2016 ) ensures that the decisions made by AI systems are transparent and understandable, fostering trust and enabling humans to interpret results. Federated Learning (FL) ( McMahan et al. 2017 ) , introduced in 2017, offers a privacy-preserving way to train AI models directly on users’ devices rather than on centralized data servers, reducing the need to share sensitive information ( McMahan et al. 2017 ) . Although several conventional and systematic literature reviews exist in the SVD domain ( Eberendu et al. 2022 ; Nazim et al. 2022 ; Liu et al. 2012 ; Malhotra 2015 ; Shahriar and Zulkernine 2012 ; Jie et al. 2016 ) , and were insightful in their time, they do not fully capture this significant, recent body of literature on AI-based SVD. According to Hanif et al. ( Hanif et al. 2021 ) , traditional approaches such as static analysis, dynamic analysis, pattern matching, taint analysis, and statistical methods represented roughly 25.6% of the reviewed studies. This share is relatively modest, and since earlier surveys have already addressed these conventional methods ( Pistoia et al. 2007 ; Liang et al. 2018 ; Zaazaa and El Bakkali 2020 ) , our focus is on more recent advancements, particularly those leveraging cutting-edge ML and DL-based SVD techniques. Recent surveys like ( Hanif et al. 2021 ; Liu et al. 2019b ; Zeng et al. 2020a ; Nazim et al. 2022 ; Eberendu et al. 2022 ) exist but not without limitations. Some existing surveys ( Zeng et al. 2020a ; Liu et al. 2019b ; Nazim et al. 2022 ) are conventional and do not follow systematic literature review principles. They often lack specific inclusion and exclusion protocols, resulting in missing critical information such as the number of papers reviewed, the year range considered, and potentially overlooking relevant studies. Consequently, these surveys may not provide comprehensive data necessary for drawing robust conclusions. Even for systematic reviews, the number of papers analyzed is small in some cases. For instance, Nazim et al. ( Nazim et al. 2022 ) only examined 10 papers, and thus the data provided, although helpful, might not depict the whole picture. Another gap in the existing surveys is a systematic taxonomy. Although several existing surveys ( Eberendu et al. 2022 ; Ghaffarian and Shahriari 2017a ) provided different types of basic categorization, in order to know the current practices and find the gap in the existing research, it is essential to have a comprehensive categorization based on several dimensions such as techniques used, feature representation method used, embedding methods used, etc. A comprehensive taxonomy would allow researchers to grasp the landscape of AI techniques and methodologies, facilitating the identification of trends, innovations, and under-explored areas. Additionally, it provides a structured framework for comparing different approaches, enhancing the clarity and depth of future research endeavors. One existing work worth mentioning is Hanif et al. ( Hanif et al. 2021 ) where the authors provided a detailed taxonomy. However, the perspectives they selected were based on research interest and also the categorization provided for ML-based approaches only cover four basic categories which are insufficient for more comprehensive analysis. Similarly, Harzevili et al. ( Shiri Harzevili et al. 2024 ) provide a broad taxonomy covering various data types and model categories. However, a more detailed and fine-grained classification is still needed, particularly for deep learning–based approaches. Our three-dimensional analysis—spanning DL techniques, feature representation methods, and embedding strategies—extends prior work by introducing a more structured and comprehensive taxonomy tailored to DL-based vulnerability detection in source code. This framework also enables us to highlight insights and challenges for future research in the field. Considering these gaps, we conducted a systematic literature review with specific inclusion and exclusion criteria, analyzing 98 recent papers published between 2018 and 2023 focused on AI-based source code vulnerability detection . Our initial analysis involved characterizing the approaches along several dimensions: the availability of their data and models, their primary detection

Read the complete text