LLM vs. SAST: A Technical Analysis on Detecting Coding Bugs of GPT4-Advanced Data Analysis

Madjid G. Tehrani, Eldar Sultanow, William J. Buchanan, Mahkame Houmani, Christel H. Djaha Fodja · 2025

Read LLM vs. SAST: A Technical Analysis on Detecting Coding Bugs of GPT4-Advanced Data Analysis by Madjid G. Tehrani, Eldar Sultanow, William J. Buchanan, Mahkame Houmani, Christel H. Djaha Fodja (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15212.txt.

Description

Madjid Tehrani, Eldar Sultanow, and colleagues pit a large language model against traditional code scanners in a 2025 security study. Static application security testing tools have flagged coding bugs for decades with rule-based checks, thorough but noisy. A general model with advanced data analysis can read code flexibly, yet its reliability as a vulnerability hunter was unproven.

The technical comparison runs both approaches on the work of finding real coding flaws. Knowing where a conversational model matches or misses the old scanners tells security teams whether to add it as a second reader or keep it away from audits.

Catalog record

CREATORMadjid G. Tehrani, Eldar Sultanow, William J. Buchanan, Mahkame Houmani, Christel H. Djaha Fodja
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-15212

Browse the full library · About the Tower of Babel