From Coverage to Causes: Data-Centric Fuzzing for JavaScript Engines Journal: Information and Software Technology
Kishan Kumar Ganguly, Tim Menzies · 2025
Read From Coverage to Causes: Data-Centric Fuzzing for JavaScript Engines Journal: Information and Software Technology by Kishan Kumar Ganguly, Tim Menzies (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18102.txt.
Introduction
Kishan Kumar Ganguly and Tim Menzies steer bug hunting in JavaScript engines away from sheer coverage. Fuzzers feed endless random inputs to find crashes, but chasing new code paths wastes effort on dull inputs and can skip the risky ones. Past fixes leaned on hand made rules that age fast.
Learning from old V8 engine bugs, the team had a language model propose telling traits of risky inputs, then kept 41 of the best. A trained scorer with over 85 percent precision and under 1 percent false alarms flags inputs worth deep testing. A quarter of the traits did most of the work. The shift from coverage to causes could speed up finding real flaws.
Catalog record
| CREATOR | Kishan Kumar Ganguly, Tim Menzies |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-18102
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Coverage to Causes: Data-Centric Fuzzing for JavaScript Engines Journal: Information and Software Technology Kishan Kumar Ganguly, Tim Menzies Abstract Context: Exhaustive fuzzing of modern JavaScript engines is infeasible due to the vast number of program states and execution paths. Coverage-guided fuzzers waste effort on low-risk inputs, often ignoring vulnerability-triggering ones that do not increase coverage. Existing heuristics proposed to mitigate this require expert effort, are brittle, and hard to adapt. Objective: We propose a data-centric, LLM-boosted alternative that learns from historical vulnerabilities to automatically identify minimal static (code) and dynamic (runtime) features for detecting high-risk inputs. Method: Guided by historical V8 bugs, iterative prompting generated 115 static and 49 dynamic features, with the latter requiring only five trace flags, minimizing instrumentation cost. After feature selection, 41 features remained to train an XGBoost model to predict high-risk inputs during fuzzing. Results: Combining static and dynamic features yields over 85 % 85\% precision and under 1 % 1\% false alarms. Only 25% of these features are needed for comparable performance, showing that most of the search space is irrelevant. Conclusion: This work introduces feature-guided fuzzing, an automated data-driven approach that replaces coverage with data-directed inference, guiding fuzzers toward high-risk states for faster, targeted, and reproducible vulnerability discovery. To support open science, all scripts and data are available at https://github.com/KKGanguly/DataCentricFuzzJS . 1 Introduction The complexity of modern software has induced a plethora of variability, largely expanding the time and effort required for exhaustive testing. Fuzzing or Fuzz Testing, which is a technique to find bugs or vulnerabilities, reduces this time and effort by automating generation of inputs in order to exercise unexpected program behavior Li et al. 2018 , Chen et al. 2018 . Coverage-guided fuzzers generate new inputs or mutate existing inputs to reach unexplored program paths. However, its success depends on the assumption that new paths correlate with new vulnerabilities Lemieux and Sen 2018 . This is inefficient for a complex system like JS engines because a lot of computational resources are spent exploring new but low-risk paths since: 1. It is blind to the high-risk paths Chen et al. 2020 , Li et al. 2018 , Wang et al. 2024 . Since coverage-guidance ignores events that are not tied to new edges or blocks, it fails to prioritize an input that triggers risky JS engine behavior (e.g. JIT bailouts, stressing the garbage collector etc.). 2. It destroys high-risk semantically-rich patterns of an input Park et al. 2020 , Wang et al. 2024 , Wang et al. 2025 . This is because mutating an input towards exploring new paths can eliminate the potential high-risk behaviors it contains. Later in this paper, we offer experimental results that coverage-driven search fails to retain most of the vulnerability-inducing seeds while repeatedly exploring low-risk regions. To overcome this limitation, fuzzing needs a guidance signal that captures how likely an input is to expose a vulnerability. In the literature, researchers have addressed the drawbacks of coverage guidance using expert-designed heuristics Wang et al. 2024 , Wang et al. 2023 , Park et al. 2020 , Wachter et al. 2025 , Bernhard et al. 2022 , He et al. 2021 , Lee et al. 2020 . Apart from the manual effort involved, these heuristics often target specific bug classes or are not systematically derived from and validated against a diverse set of historical vulnerabilities. For example, DIE Park et al. 2020 focuses on preserving "aspects", which they identify as data types and structures, in order to prevent coverage-guided mutations from destroying high-risk behaviors. This was later shown not to generalize to other classes of vulnerabilities Wang et al. 2025 , suggesting the existence of additional "aspects". OPTFuzz Wang et al. 2024 introduced "optimization path coverage," which is effective for finding JIT vulnerabilities but cannot be applied to discover many other types of JS engine bugs. Another line of work aims to reduce the search space by generating more semantically valid inputs Han et al. 2019 , Wang et al. 2019 , Dinh et al. 2021 , Groß et al. 2023 , Lee et al. 2020 , Ye et al. 2021 , Xu et al. 2024a , Wen et al. 2023 . For example, Fuzzilli Groß et al. 2023 proposed the FuzzIL Intermediate Representation (IR) to increase semantic correctness. While this line of work improves validity, it can still produce semantically correct but low-risk inputs which leads to inefficient exploration. Our novelty lies in reducing this inefficiency by shifting from manual heuristics to a systematic, data-centric methodology for feature discovery and validation. In this work, we leverage the reasoning capabilities of LLMs for automated feature generation. We design a prompting strategy to analyze and generate a diverse set of 115 static and 49 dynamic features (high-risk patterns) from historical vulnerabilities. Applying feature selection via EXtreme Gradient Boosting (XGBoost) model, we show that only 25% of the combined feature set can predict 160 historical vulnerability-inducing inputs with over 85\% precision and <1\% false alarm rate in a time-controlled study. Our automated feature collection strategy not only reduces the total feature search space but also significantly lowers the instrumentation effort, as the generated dynamic features come from just five V8 trace flags the LLM recommended through our prompting pipeline. A time-restricted prudence check at the end shows that a fuzzer guided by this minimal feature set finds real crashes faster. The primary challenge to this approach is the vast search space of possible features. Each JS input can be analyzed by countless static code features. Moreover, its execution can generate gigantic trace data. This raises the following questions: how to systematically extract and select the most valuable features from this noise, and how to measure their effectiveness in discovering JS engine vulnerabilities? To answer these, we pose the following questions. RQ1 How to systematically derive a set of static and dynamic features most indicative of vulnerabilities in JS engine? RQ2 How effective is the guidance model in terms of predictive performance? RQ3 Do both static and dynamic features contribute to its performance? RQ4 What is the minimal feature set beyond which additional features yield diminishing returns? RQ5 Can the feature-guided fuzzing process find real bugs? RQ6 What is the runtime overhead of collecting these features? Overall, our contributions are as follows. 1. We present a novel LLM-guided static and dynamic feature generation technique from historical vulnerability-triggering JS inputs. 2. Our feature importance analysis, which eliminates 75% of the features without losing predictive performance, shows that traditional fuzzers, which treat all code properties as equally important, spend a lot of time mutating irrelevant codes . 3. To reduce instrumentation effort, we introduce a new class of dynamic features from LLM-ranked, vulnerability-relevant trace flags which are not widely utilized in prior work. We show that these features work as high-recall detectors and combining these creates a synergistic effect with about 3\times gain in precision/recall. 4. We develop and validate a predictive guidance model using time-aware cross-validation that mimics real-world presentation of bugs over time. 5. We demonstrate how this predictive model and the features can be utilized in fuzzing. 6. We release our curated dataset of extracted features and experimentation scripts 1 1 1 https://github.com/KKGanguly/DataCentricFuzzJS to support reproducibility and future research.