Automated Road Distress Detection Using Vision Transformers and Generative Adversarial Networks

Cesar Portocarrero Rodriguez *, Laura Vandeweyen, Yosuke Yamamoto · 2025

Read Automated Road Distress Detection Using Vision Transformers and Generative Adversarial Networks by Cesar Portocarrero Rodriguez *, Laura Vandeweyen, Yosuke Yamamoto (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-13145.txt.

Introduction

Cesar Portocarrero Rodriguez, Laura Vandeweyen, and Yosuke Yamamoto aim computer vision at America's crumbling roads. The civil engineers' society grades United States infrastructure a C and its roads a D, yet inspection still leans on manual surveys and laser rigs that are slow and costly. With vehicles now streaming visual data constantly, the authors test whether modern segmentation models can map road distress, cracks and damage, automatically, and whether synthetic training data helps.

They first generate road images with generative adversarial networks and measure their value for training, then compare a convolutional network against MaskFormer, a transformer-based mapping model. The synthetic data improved results, and MaskFormer beat the rival model on both mean average precision and intersection over union. The practical pitch is triage: continuous, cheap detection from ordinary road imagery would let repair agencies spend repair budgets where the damage is.

Catalog record

CREATORCesar Portocarrero Rodriguez *, Laura Vandeweyen, Yosuke Yamamoto
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-13145

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Automated Road Distress Detection Using Vision Transformers and Generative Adversarial Networks Cesar Portocarrero Rodriguez *, Laura Vandeweyen, Yosuke Yamamoto Abstract The American Society of Civil Engineers has graded America’s infrastructure condition as a C, with the road system receiving a dismal D. Roads are vital to regional economic viability, yet their management, maintenance, and repair processes remain inefficient, relying on outdated manual or laser-based inspection methods that are both costly and time-consuming. With the increasing availability of real-time visual data from autonomous vehicles, there is a significant opportunity to harness computer vision (CV) for advanced road monitoring, offering insights to guide infrastructure rehabilitation efforts. This project explores the application of state-of-the-art CV techniques for road distress segmentation. It begins by evaluating the use of synthetic data generated through Generative Adversarial Networks (GANs) to assess the effectiveness of such data for model training. The study then applies Convolutional Neural Networks (CNNs) for road distress segmentation and subsequently implements the vision transformer model MaskFormer, identifying areas for potential improvement in road monitoring. Results demonstrate that GANs are a viable method for generating synthetic data, significantly enhancing the performance of CV models. Further, MaskFormer shows promise in this task, as it outperforms the CNN model in two metrics: mAP50 and IoU. keywords road distress; computer vision; GANs; transformers † † firstpage: 1 † † volume: 1 † † issue: 1 † † articlenumber: 0 † † year: 2025 † † copyright-year: 2025 † † hreflink: https://doi.org/ † † titlecitation: Automated Road Distress Detection Using Vision Transformers and Generative Adversarial Networks † † authornames: Cesar Portocarrero Rodriguez, Laura Vanderweyen and Yosuke Yamamoto † † authorcitation: Portocarrero Rodriguez, C.; Vanderweyen, L.; Yamamoto, Y. † † address: 1 Stanford University, Department of Civil and Environmental Engineering † † corresponding: Correspondence: [email protected] † † reftitle: References \secondnote These authors contributed equally to this work. 1 Introduction In 2025, the American Society of Civil Engineers attributed a score of C to America’s infrastructure conditions 2 . The solution to this problem, as well as its safety and cost implications, requires leveraging technology to improve management programs and prioritize maintenance operations, asset replacement, and investment. Technological initiatives, however, cannot be general; they must be tailored to the type of infrastructure being studied. This specific research paper focuses on road infrastructure. The road system, in particular, received a score of D, as 40% of the system today is in poor or mediocre conditions. Each year, there are 11K deaths and $3B in damages due to poor road conditions. Additionally, it is 14 times more expensive for public agencies to reconstruct roads than it is to perform preventive maintenance over its life cycle 16 . Despite the importance of infrastructure maintenance to sustain the economy and provide a great return on taxpayer money, inspection processes remain archaic. Public institutions in charge of the transportation system often have to execute manual road inspections, whereby an engineer drives the road and stops at relevant locations to document a particular defect. As expected, this process is considerably time-consuming and cost-inefficient due to the high number of manhours required. Further, the repetitive nature of the job means that human workers grow rapidly weary during the process, leading to a decrease in accuracy and an increase in misannotations when documenting cracks, potholes, and other sources of road distress. To improve the performance in predicting road deterioration, state government agencies such as CalTrans also rely on additional tools such as laser scanners 17 . Laser inspections, however, are usually performed only once per year since they require a dedicated driver, an engineer, and a specialized vehicle heavily equipped with machinery. The data collected through this laser detection process allows the International Road Roughness Index (IRR) to be derived at N discrete points per mile of lane-road. In addition to its cumbersome deployment, the performance of laser technology for road distress detection leaves much to be desired. Public utility transportation engineers complain that the laser data sometimes does not differentiate between open cracks and cracks that have already been sealed. In response, recent years have seen the development of research seeking to apply computer vision solutions to the problem of road distress detection 8 ; 20 ; 6 ; 9 . The development of semantic segmentation algorithms for road assessments has the potential to significantly improve maintenance programs of transportation systems. In this project, we used road images form the National Department of Transport Infrastructure (NDTI) to explore the application of SOTA techniques such as CNNs, GANs, and vision transformers to output road distress categories, namely cracks, potholes, damaged markings, and guardrails. 2 Related work 2.1 Generative adversarial networks GANs (Generative Adversarial Networks) are a popular deep learning framework consisting of two neural networks: a generator and a discriminator that compete against each other. It was introduced by Ian Goodfellow in 2014 7 . GANs have been extensively researched and applied to various domains, including image synthesis, text generation, and video generation. They have shown remarkable success in generating realistic and diverse samples by leveraging an adversarial learning process 12 . However, GAN training can be challenging, often suffering from mode collapse and instability issues. Many techniques have been proposed to address these challenges, such as Wasserstein GANs, progressive growing, and spectral normalization. GANs continue to be an active area of research, with ongoing efforts to improve training stability, sample quality, and application versatility. It is worth noting that GANs have not been used to upsample road imagery data to date. 2.2 Vision transformers Transformers were first introduced for machine translation in the domain of natural language processing. They are characterized by their encoder-decoder structure without recurrence and the adoption of self-attention 18 . In the field of computer vision, the Vision Transformer (ViT) was introduced as an adaptation of the original architecture for image classification. Images are split into patches and then the ViT can extract global features throughout the layers. Results showed that the ViT was able to surpass the performance of SOTA CNN architectures 5 . In the context of road infrastructure, the first experiment with vision transformers was carried out for road surface condition detection. Although the performance of this model is remarkably high, with an F1-score of 0.9671, it is worth noting that it is limited to a classification problem that only contemplates 3 classes: heavy rain, light rain, and no rain. Further, the performance benefits of an artificial spatial self-attention network to model the relationship between adjacent images 1 . Regarding distress detection on road infrastructure, the literature is limited to binary classification tasks involving two classes: cracked and healthy asphalt. A ViT-based framework proposed by Asadi et al. achieved an IoU of 61%, an increase of 3.8% compared to the best-performing CNN-based model 3 . It is important to note that this model was trained using online datasets that are artificially centered on cracks, minimizing the noise. A second experience was carried out by Xiao et al. using hybrid-window attentive vision transformers 19 . This framework, named CrackFormer, aims to extract feature semantics locally and globally with dense and sparse windows, respectively. The results show that CrackFormer performs significantly well, with an F1-score of 0.9364. However, similar to the previous research,

Read the complete text