Data-Driven Analysis of Crash Patterns in SAE Level 2 and Level 4 Automated Vehicles Using K-means Clustering and Association Rule Mining

Jewel Rana Palit, PE, RSP1(Corresponding Author) Traffic Engineer/Project Manager-II Collier County Government Traffic Management Center 2695 Francis Ave Unit D, Naples, Fl, 37221 Email: [email protected] Vijayalakshmi K Kumarasamy, Ph.D. Department of Computer Science and Engineering Universi · 2025

Read Data-Driven Analysis of Crash Patterns in SAE Level 2 and Level 4 Automated Vehicles Using K-means Clustering and Association Rule Mining by Jewel Rana Palit, PE, RSP1(Corresponding Author) Traffic Engineer/Project Manager-II Collier County Government Traffic Management Center 2695 Francis Ave Unit D, Naples, Fl, 37221 Email: [email protected] Vijayalakshmi K Kumarasamy, Ph.D. Department of Computer Science and Engineering Universi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22589.txt.

Introduction

Jewel Rana Palit, Vijayalakshmi K Kumarasamy, and Osama A. Osman mine United States federal crash records to learn how automated vehicles crash. Cars at automation levels two and four promise fewer human-error crashes, yet reported behavior sometimes deviates from expected safety outcomes. Earlier studies leaned on small, California-centered datasets; this one analyzes over 2,500 crash reports filed with the National Highway Traffic Safety Administration across both automation levels.

Their two-stage system first clusters the records into four behavioral groups with k-means, using timing, location, and environmental factors. Association rule mining then extracts readable relationships inside each cluster, linking crash patterns to lighting, road surface, vehicle dynamics, and weather. The authors aim the findings at developers, regulators, and policymakers shaping deployment strategy.

Catalog record

CREATORJewel Rana Palit, PE, RSP1(Corresponding Author) Traffic Engineer/Project Manager-II Collier County Government Traffic Management Center 2695 Francis Ave Unit D, Naples, Fl, 37221 Email: [email protected] Vijayalakshmi K Kumarasamy, Ph.D. Department of Computer Science and Engineering Universi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22589

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-Driven Analysis of Crash Patterns in SAE Level 2 and Level 4 Automated Vehicles Using K-means Clustering and Association Rule Mining Jewel Rana Palit, PE, RSP1(Corresponding Author) Traffic Engineer/Project Manager-II Collier County Government Traffic Management Center 2695 Francis Ave Unit D, Naples, Fl, 37221 Email: [email protected] Vijayalakshmi K Kumarasamy, Ph.D. Department of Computer Science and Engineering University of Tennessee at Chattanooga Chattanooga, TN, USA 37403 Email: [email protected] Osama A. Osman, Ph.D, PE ORCiD: https://orcid.org/0000-0002-5157-2805 Chief Scientist Center of Urban Informatics and Progress Chattanooga, TN, USA 37403 Email: [email protected] Abstract \AuthorHeaders J.R. Palit et al 2025 1 Abstract Automated Vehicles (AV) hold potential to reduce or eliminate human driving errors, enhance traffic safety, and support sustainable mobility. Recently, crash data has increasingly revealed that AV behavior can deviate from expected safety outcomes, raising concerns about the technology’s safety and operational reliability in mixed traffic environments. While past research has investigated AV crash, most studies rely on small-size California-centered datasets, with a limited focus on understanding crash trends across various SAE Levels of automation. This study analyzes over 2,500 AV crash records from the United States National Highway Traffic Safety Administration (NHTSA), covering SAE Levels 2 and 4, to uncover underlying crash dynamics.A two-stage data mining framework is developed. K-means clustering is first applied to segment crash records into 4 distinct behavioral clusters based on temporal, spatial, and environmental factors. Then, Association Rule Mining (ARM) is used to extract interpretable multivariate relationships between crash patterns and crash contributors including lighting conditions, surface condition, vehicle dynamics, and environmental conditions within each cluster. These insights provide actionable guidance for AV developers, safety regulators, and policymakers in formulating AV deployment strategies and minimizing crash risks. Keywords : Automated Vehicles, SAE Level, Crash Analysis, K-means Clustering, ADS, ADAS, Association Rule Mining. 2 Introduction Over the last decade, traffic accidents have claimed 3,50,000 lives in the USA, with 40,990 fatalities in 2023 alone [ 1 ] . Traffic accidents often result from human errors such as speeding, fatigue, and inattention, which are major contributors to fatal crashes. According to the National Highway Traffic Safety Administration (NHTSA), adopting automated vehicle (AV) technology could substantially reduce human errors, thereby decreasing crash frequency [ 2 ] . Additionally, AVs can play a key role in creating more mobile and environmentally sustainable traffic flow. With safety in mind, vehicles are currently equipped with different automation systems to assist drivers. These include Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS) [ 2 ] . ADAS encompasses features such as Adaptive Cruise Control (ACC), Blind Spot Detection, and Lane Departure Warning, which support the driver during vehicle operation. In contrast, ADS involves higher levels of automation, allowing the system to manage driving without human intervention under specified conditions. The Society of Automotive Engineers (SAE) and NHTSA categorize these advanced technologies into six levels of automation, ranging from Level 0 (no automation) to Level 5 (full automation). ADAS corresponds to Levels 1 and 2, while ADS represents automation Levels 3, 4, and 5 [ 2 , 3 ] . Despite the promise of enhanced safety and advanced assistance options available, AVs are not immune to traffic crashes, particularly when interacting with heterogeneous road users in mixed traffic settings. Even under ideal conditions, AVs have been involved in crashes, raising concerns and posing significant challenges to AV commercialization [ 4 , 5 ] . Researchers have observed that AV crashes do not follow typical traffic crash patterns, underscoring the importance of thoroughly understanding these patterns to identify limitations and improve the technology [ 5 ] . To reveal the hidden patterns in these AV crashes, scholars have employed various data mining, statistical analysis, clustering, text mining techniques, etc. In 2015, Schoettle et al. conducted a preliminary statistical analysis of crash reports from self-driving vehicles operated by Google, Delphi, and Audi in California. They found that AVs had a higher crash rate per million miles compared to conventional vehicles. This study’s findings are constrained by an extremely small sample size ( N=11 ) [ 6 ] . Favaro et al. used traditional statistical analysis to investigate the California Department of Motor Vehicle (CA DMV) dataset. Their study indicated that rear-end collisions are the most frequent collision type. However, this study was also subjected to a limited sample size ( N=26 ) and a single geographic location [ 7 ] . Moreover, the limitations include reliance on predefined fields and manual review bias, as well as missing data for critical factors such as weather, lighting, and road conditions in crash narratives before their formal inclusion in the database in 2018 [ 8 ] . To overcome the limitations of basic statistical methods in effectively understanding the crash pattern, Alambeigi et al. investigated the California DMV crash database using a Probabilistic Topic Modeling (PTM) approach. They identified five key crash scenarios from 114 AV crashes, with the most prevalent being rear-end collisions at intersections and driver-initiated transition crashes, highlighting critical safety concerns in AV operation and human-machine interactions [ 8 ] . Though topic modeling provides insights from crash narratives, it is often prone to context sensitivity and offers a more generalized view of themes, potentially overlooking detailed and specific relationships. To deal with this shortcoming, supervised machine learning methods and Bayesian analysis, in addition to statistical and text analytics methods, have been used by several scholars [ 9 , 10 , 11 ] . Kutela et al. used the supervised machine learning classifiers and Text Network Analysis (TNA) to investigate vulnerable road user (VRU) involvement in 252 AV crashes of the CA DMV, revealing crashes having positive relationships with crosswalks at intersections, signals, etc. [ 11 ] . However, using Supervised Machine Learning (ML) methods for such a small-scale dataset could not facilitate extensive analysis for exploring hidden patterns of these crashes. Lee et al. used a Probabilistic Bayesian approach and TNA to investigate AV crash patterns and showed that AVs are more vulnerable to rear-end collisions in autonomous driving mode than in conventional mode [ 12 ] . They also proved that manual disengagement tends to occur more often when an autonomous vehicle engages with a transit vehicle shortly before a collision. However, the Probabilistic Bayesian model used in the study is computationally intensive. Probabilistic Bayesian approach also requires the specification of prior distributions or modeling assumptions, which can introduce subjectivity and potential bias [ 13 ] . Several studies used clustering methods to ignore subjectivity in capturing AV crash patterns. Das et al. applied clustering analysis to understand AV crash patterns considering turning movement, manner of collisions, etc. [ 14 ] . They explored six different collision patterns by analyzing 151 California DMV crash reports through Bayesian Clustering approaches [ 14 ] . However, such clustering approaches struggle with capturing complex and evolving patterns over time [ 15 ] . Clustering reveals co-occurring item groupings but does not explain their interrelationships. To understand how different factors in AV crashes affect each other, recent studies in AV have adopted Association Rule Mining (ARM), a data mining method that identifies interesting relations between different variables, either alone or in conjunction with clustering [ 16 ] . By analyzing the co-occurrence of different items in the

Read the complete text