VCDiag: Classifying Erroneous Waveforms for Failure Triage Acceleration
Minh Luu, Surya Jasper, Khoi Le, Evan Pan, Michael Quinn, Aakash Tyagi, Jiang Hu · 2025
Read VCDiag: Classifying Erroneous Waveforms for Failure Triage Acceleration by Minh Luu, Surya Jasper, Khoi Le, Evan Pan, Michael Quinn, Aakash Tyagi, Jiang Hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03590.txt.
Introduction
Minh Luu and co-authors present VCDiag, a tool that sorts failed chip tests by their likely cause, in a paper from 2025. Checking why a chip design failed is slow work done by hand. Engineers read specs, logs, and wave traces to find the fault. Machine learning has helped other test tasks, but not this sorting step for large designs.
The tool reads the wave data saved from a failed run. It picks the key signals and shrinks the data by more than a hundred fold, while keeping what matters. A classifier then ranks the parts of the design most likely at fault. In the largest test, the true fault sat in the top three ranked parts more than ninety-four times in a hundred. The tool fits many design styles and test setups.
Catalog record
| CREATOR | Minh Luu, Surya Jasper, Khoi Le, Evan Pan, Michael Quinn, Aakash Tyagi, Jiang Hu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03590
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VCDiag: Classifying Erroneous Waveforms for Failure Triage Acceleration Minh Luu, Surya Jasper, Khoi Le, Evan Pan, Michael Quinn, Aakash Tyagi, Jiang Hu Abstract Failure triage in design functional verification is critical but time-intensive, relying on manual specification reviews, log inspections, and waveform analyses. While machine learning (ML) has improved areas like stimulus generation and coverage closure, its application to RTL-level simulation failure triage, particularly for large designs, remains limited. VCDiag offers an efficient, adaptable approach using VCD data to classify failing waveforms and pinpoint likely failure locations. In the largest experiment, VCDiag achieves over 94% accuracy in identifying the top three most likely modules. The framework introduces a novel signal selection and statistical compression approach, achieving over 120x reduction in raw data size while preserving features essential for classification. It can also be integrated into diverse Verilog/SystemVerilog designs and testbenches. I Introduction Design functional verification (DFV) is critical for ensuring chips meet specifications, avoiding costly errors, and protecting companies’ reputations. However, traditional methods struggle with modern design complexities. Verification now consumes more engineering resources than design itself, reflected by a rising verification-to-design engineer ratio [ 1 ] . Furthermore, verification engineers spend 47% of their time debugging, a 6% increase over four years [ 2 ] , contributing to 75% of projects missing deadlines and only 14% avoiding a respin due to functional failures [ 1 ] . As design complexity grows, innovative debugging tools and methodologies are urgently needed.” Failure triage, an important initial step during the debugging process, involves evaluating, prioritizing, and sorting bugs to mitigate critical issues first. At RTL level, coarse-grain debugging is used during the evaluation phase to approximate the root cause’s location, narrowing it down to a likely design module or group of modules. Though pioneering SAT-based techniques [ 3 , 4 , 5 ] have demonstrated promising results, their focus on formal verification limits scalability for large IPs and SoCs, where simulation-based verification dominates. ML-powered approaches for simulation rely on log files [ 6 ] or proprietary tools [ 7 ] , making them dependent on specific testbench configurations and hampering reproducibility. Most importantly, few studies evaluate triage techniques on large RTL designs [ 8 ] , and the scarcity of publicly available benchmarks further limits progress toward practical, industry-ready solutions. Given these challenges, our work proposes a scalable and testbench-agnostic approach to accelerate coarse-grain debugging and, by extension, failure triage. Our method leverages Value Change Dump (VCD) waveform data, which captures rich temporal and structural design behavior during simulation and is widely supported by industry-standard tools. By mining this data directly, we avoid reliance on proprietary infrastructure or non-robust log parsing. To this end, we present VCDiag, a VCD mining framework for ML-driven classification of failing waveforms to likely RTL modules. VCDiag advances existing research by offering three key contributions: 1. A novel approach to failure classification : We train ML models on failing waveforms labeled with buggy RTL modules. Once errors are identified in logs, these models help engineers analyze the temporal and structural context within waveforms to infer the most probable failure source, enabling quicker and more accurate coarse-grain debugging. 2. An adaptable and modular infrastructure : VCD, part of the IEEE Verilog standard [ 9 ] , is widely supported by commercial and open-source tools, providing a reliable bridge between verification environments and ML infrastructure. This makes VCDiag adaptable to diverse designs, including those using industry-standard Universal Verification Methodology (UVM) testbenches. The tool is built entirely on open-source libraries [ 10 , 11 , 12 ] and evaluated on publicly available designs [ 13 ] [ 14 ] to support reproducibility and future benchmarking. 3. Efficient VCD extraction and processing method : Large VCD file sizes can make datasets unwieldy, so we propose a multi-step pipeline for efficient VCD extraction and processing. The process begins with an AST-based crawler that builds a lookup table to guide a signal selector in filtering relevant signals for extraction. The extracted data is then trimmed, compressed, and formatted into compact training and testing sets. For large designs, we utilize XGBoost [ 15 ] to rank signal importance and reduce dimensionality. Additionally, the framework supports multi-core parallelization to enhance throughput and efficiency. We evaluated VCDiag on advanced RTL designs, including OpenTitan [ 13 ] IPs and the FabScalar processor [ 14 ] . On the largest benchmark, VCDiag achieves 77% top-1 and 94% top-3 accuracy in identifying failure-causing modules. The processing pipeline reduces data size by 123x, from 308GB to 2.5GB, and multi-core parallelism allows simulation, extraction, and processing of 1,600 bug scenarios (over 15,000 VCDs) in under 36 hours on a 32-core system. II Previous Work BugMD [ 8 ] detects post-silicon CPU bugs in FabScalar [ 14 ] by aligning architectural states with a golden reference and extracting mismatch features for bug signature generation. Using synthetic gate-level bug injection and a random forest classifier, it achieves 70% top-1 and 90% top-3 accuracy across twelve CPU regions. Since post-silicon timing data and gate-level bug injection are unavailable pre-synthesis, we target a similar problem at the RTL level. We adopted FabScalar’s RTL design, applied comparable metrics, and developed a targeted RTL bug generation tool. Our approach matches or exceeds BugMD’s reported results on FabScalar and consistently performs well across a broader set of modern, open-source designs, demonstrating its scalability and applicability. III Problem Formulation A Verilog/SystemVerilog module defines the behavior of a hardware block through internal logic and signal interactions. Modules communicate via well-defined interfaces and can be composed hierarchically to build complex digital systems. During simulation, the complete design, referred to as the Design-Under-Test (DUT), is exercised by testbenches that apply inputs and check outputs. When a mismatch is detected, the testbench flags the failing cycle and logs diagnostic details. DFV engineers then isolate the failing test case, review the logs, and inspect relevant waveforms against the design specification to identify anomalies and locate the root cause. For our analysis, the simulation halts upon detecting the first error, and the resulting VCD waveform captures DUT behavior at every simulation tick from initialization to failure. Each waveform is labeled with the module responsible for the failure and serves as a behavioral signature for training ML models as shown in Figure 1 . A separate model is trained and tested for each design to learn its unique behavior. We formulate this as a multivariate time-series classification (MTSC) problem, where a waveform is represented as X\in\mathbb{R}^{T\times d} , with T time steps and d signal measurements per step. The objective is to learn a model f:\mathbb{R}^{T\times d}\to\{1,2,\dots,M\} that maps a failing waveform to the corresponding module label Y . Fig. 1 : Failure signature classification. By using VCDs as the sole input, VCDiag remains independent of the DUT and testbench, ensuring compatibility with any Verilog/SystemVerilog design or simulator without modification. To maintain this generality, future integration of logs or design specs will require standardized outputs or novel feature extraction methods for ML training. IV Proposed Framework Fig. 2 : VCDiag framework This section describes our methodology for extracting structured features from raw VCDs, collecting labeled waveform data from regression runs, and generating synthetic bugs to support model training. We then present the ML models evaluated and