CERBERUS: Crack Evaluation & Recognition Benchmark for Engineering Reliability & Urban Stability
Justin Reinman, Sunwoong Choi · 2025
Read CERBERUS: Crack Evaluation & Recognition Benchmark for Engineering Reliability & Urban Stability by Justin Reinman, Sunwoong Choi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-21909.txt.
Introduction
Justin Reinman and Sunwoong Choi present a test set for finding cracks in bridges and walls. Their paper is from two thousand twenty-five. Crack checks keep roads and buildings safe, but training a vision model needs many labelled images. Real crack photos are slow to gather and hard to repeat.
Their set, CERBERUS, makes fake crack images and builds three-way scenes in a game engine. One scene is a plain wall fly-by, and one is an underpass with hard light and shapes. They test a known detection model with mixes of fake and real data. The mix does best on real images. The set is free for others to use and rerun.
Catalog record
| CREATOR | Justin Reinman, Sunwoong Choi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-21909
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CERBERUS: Crack Evaluation & Recognition Benchmark for Engineering Reliability & Urban Stability Thanks: Palisades Charter High School, Pacific Palisades, CA, USA. Thanks: Mechanical and Aerospace Engineering, UCLA, CA, USA. Justin Reinman, Sunwoong Choi Abstract CERBERUS is a synthetic benchmark designed to help train and evaluate AI models for detecting cracks and other defects in infrastructure. It includes a crack image generator and realistic 3D inspection scenarios built in Unity. The benchmark features two types of setups: a simple Fly-By wall inspection and a more complex Underpass scene with lighting and geometry challenges. We tested a popular object detection model (YOLO) using different combinations of synthetic and real crack data. Results show that combining synthetic and real data improves performance on real-world images. CERBERUS provides a flexible, repeatable way to test defect detection systems and supports future research in automated infrastructure inspection. CERBERUS is publicly available at https://github.com/justinreinman/Cerberus-Defect-Generator . I Introduction Infrastructure deterioration is a critical issue, with 7.5% of bridges in the United States classified as being in poor condition in 2021 [ 1 ] . Urban areas are particularly vulnerable to the consequences of failing infrastructure despite serving as vital economic hubs, contributing about 91% of the United States’ gross domestic product (GDP) and containing trillions of dollars in land value. The five largest cities alone accounted for 23% of the nation’s GDP, highlighting their economic importance. However, aging and deteriorating infrastructure poses a significant risk, with projections estimating that neglecting necessary repairs and replacements could cost the U.S. GDP up to $10 trillion by 2039 [ 2 ] . This estimate includes losses from reduced goods production, disrupted supply chains, fewer jobs, and lower wages, while also affecting essential services such as transportation, water, electricity, and sanitation – ultimately harming public health and quality of life [ 3 ] . Timely visual inspections are crucial for assessing structural issues such as cracks, spalling, and corrosion, which can compromise the integrity of these structures if left unaddressed [ 6 ] [ 7 ] . However, traditional inspection methods can be labor-intensive, costly, and difficult to conduct in remote or hazardous locations. To address these challenges, drones have been increasingly utilized to assist in structural assessments [ 4 ] . Machine learning presents an opportunity to automate defect detection in these drone inspections, often functioning alongside human supervisors to improve efficiency and accuracy [ 5 ] . While prior research [ 11 ] - [ 14 ] has explored machine learning applications for crack detection, many studies rely on ad-hoc small datasets, making it difficult to compare techniques or evaluate their real-world performance. The lack of standardized benchmarks hinders progress in developing more robust and scalable solutions. What is needed is a repeatable yet realistic benchmark suite to provide a reliable comparison point for evaluating machine learning-based defect detection techniques. We chose to create a synthetic suite because of the flexibility afforded over real world recording. It should be used as an intermediate step in training a machine model, before ultimately tested in a real world environment, as we demonstrate in this paper. In particular, we propose a synthetic benchmark suite that provides: • a defect recognition framework for repeatable visual scenarios • the flexibility to create different structural materials, defect placement, and challenging distractions • a full suite of sample scenarios that challenge existing objection detection infrastructures II Simulation Setup In the construction of CERBERUS, we created a crack generator, designed visual scenarios in Unity, and ultimately tested the benchmark suite using YOLO. II-A Crack Generator Machine learning relies on large amounts of robust training data. Rather than only using a database of existing cracks, we created a pixel-by-pixel crack generator written in C to provide diverse yet realistic training data for defect detection models. By procedurally generating cracks, we can vary features such as branching, thickness, coloration, and direction, ensuring a wide range of variations for our learning models. We built the crack generator on top of the libattopng [ 9 ] C library for uncompressed png generation. The crack generator creates 640 x 640 pixel images with randomized color values. The crack generator picks a random starting point in the image and a random starting direction. The crack generator colors 2-4 pixels at that location (depending on the randomly selected crack thickness), and then continues to draw the hairline crack pixel by pixel in the current direction. The main loop of the crack generator randomly inserts pertubations (small movements in horizontal or vertical directions) and changes in direction to model the jagged nature of hairline cracks. The generator randomly determines the overall length of the crack and once that length has been reached, the model may randomly generate offshoots (branches) from the crack. The crack is eventually bordered by a gradient of color values to create a more realistic transition to the crack, modeling a wearing away of material at the edges of the crack. Figure 1 demonstrates four cracks generated as part of the training set. Fig. 1: Exemplary cracks generated for CERBERUS II-B Unity Unity [ 8 ] is a development platform that provides a flexible environment for creating interactive 3D applications. In our project, we utilized Unity 2022.3 to develop CERBERUS, leveraging its rendering pipeline and shader capabilities to create realistic defect simulations. We used the dolly camera in Unity to create predefined drone travel paths through the virtual environment. Additionally, Unity enabled efficient video dumping, allowing us to capture high-quality footage of defect visualizations for further analysis and machine learning training. This functionality was essential for generating a dataset of defect examples, ensuring consistency and reproducibility in our benchmarking process. We used Unity’s HD Render Pipeline and videos were created using Unity’s Recorder in FHD 1080p at a 16:9 aspect ratio. II-C You Only Look Once (YOLO) YOLO [ 10 ] is an object detection algorithm optimized for real-time performance. It employs a single neural network to simultaneously predict object locations and class probabilities, enabling fast and efficient image analysis for real-time applications. We used YOLO11 for defect recognition in our evaluation, training for 200 epochs on different data sets with separate training and validation sets to assess model performance. Our crack generator outputs training, validation, and testing image files and YOLO formatted labels. For the synthetic data used in this study, the crack generator labels the data by automatically finding the bounding box around the randomly generated crack. For the real world data used in this study, we created labels manually. For this study, we used a split of 80% training data, 10% validation data, and 10% testing data. III CERBERUS Benchmark scenarios provided by CERBERUS can be divided into two categories based on inspection difficulty: (1) the Drone Fly-By Scenario (Section A), and (2) the Underpass Scenario (Section B). The Drone Fly-By Scenario represents simple wall visual inspection tasks, where a drone moves laterally to scan the wall surface. In contrast, the Underpass Scenario involves box culvert inspections, characterized by varying lighting conditions and a broader range of defect locations. These two scenarios enable benchmarking of AI models for crack detection under realistic visual inspection conditions. III-A Drone Fly-By Scenario The Fly-By portion of CERBER simulates a drone flying parallel to