Nexar Dashcam Collision Prediction Dataset and Challenge

Daniel C. Moura, Shizhan Zhu, Orly Zvitia · 2025

Read Nexar Dashcam Collision Prediction Dataset and Challenge by Daniel C. Moura, Shizhan Zhu, Orly Zvitia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03848.txt.

Introduction

Daniel Moura, Shizhan Zhu, and Orly Zvitia release, in 2025 work, a public dashcam set and contest for foretelling crashes. Dashcams catch real traffic strife that staged tests miss. Their set holds fifteen hundred clips, each near forty seconds, drawn from a wide range of road scenes.

Each clip is tagged with its event kind, light and weather, and scene type, from city to highway. For crash and near-crash clips, tags also mark the crash point and the first point where a sharp eye could call it. Contest models must score how likely a crash looms, graded at three lead times, the longest a second and a half out. Early, sound calls win. The set is open, with bars on ill use.

Catalog record

CREATORDaniel C. Moura, Shizhan Zhu, Orly Zvitia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-03848

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nexar Dashcam Collision Prediction Dataset and Challenge Daniel C. Moura, Shizhan Zhu, Orly Zvitia Abstract This paper presents the Nexar Dashcam Collision Prediction Dataset and Challenge, designed to support research in traffic event analysis, collision prediction, and autonomous vehicle safety. The dataset consists of 1,500 annotated video clips, each approximately 40 seconds long, capturing a diverse range of real-world traffic scenarios. Videos are labeled with event type (collision/near-collision vs. normal driving), environmental conditions (lighting conditions and weather), and scene type (urban, rural, highway, etc.). For collision and near-collision cases, additional temporal labels are provided, including the precise moment of the event and the alert time, marking when the collision first becomes predictable. To advance research on accident prediction, we introduce the Nexar Dashcam Collision Prediction Challenge, a public competition on top of this dataset. Participants are tasked with developing machine learning models that predict the likelihood of an imminent collision, given an input video. Model performance is evaluated using the average precision (AP) computed across multiple intervals before the accident (i.e. 500 ms, 1000 ms, and 1500 ms prior to the event), emphasizing the importance of early and reliable predictions. The dataset is released under an open license with restrictions on unethical use, ensuring responsible research and innovation. 1 Introduction Traffic accidents cause significant loss of life and financial damage worldwide each year. Preventing various types of traffic accidents, such as vehicle collisions, vehicle-pedestrian collisions, and single-vehicle loss of control, can save lives and protect assets. Research in autonomous driving and ADAS (Advanced Driver Assistance Systems) [ 15 , 9 ] shows promising potential for improving driving safety. This progress is driven by the widespread adoption of dashcams, which provide a field of view comparable to or even more comprehensive than that of a human driver. Early anticipation of imminent traffic accidents [ 7 ] adds significant value to autonomous driving systems. These systems can continuously analyze dashcam footage in real-time, aiming to make timely and confident predictions about potential accidents affecting the vehicle or occuring nearby. Table 1 : Summary of the existing datasets and their properties: total number of video clips and frames, availability of attributes annotations, resolution, S/R (synthetic or real), and if open-sourced (“A” indicates academic use only). MMAU [ 11 , 12 ] also provides re-annotations the CCD [ 4 ] , DoTA [ 54 , 55 ] and A3D [ 56 ] datasets. #Clips #Frames Attr. Res. S/R Open source DAD [ 7 ] 1,750 175K - 720 \times 1280 R A SA [ 58 ] 1,733 173K - 720 \times 1280 R - EpicFail [ 58 ] 3,000 \approx 300K - - R A VIENA 2 [ 2 ] 15K 2.25M - 1280 \times 1920 S ✓ NIDB [ 25 , 47 ] 6,244 1.3M - - R - A3D [ 56 ] 1,500 208K ✓ 1 1 1 Re-annotated by MMAU [ 12 ] . 720 \times 1280 R - 2 2 2 The YouTube videos following the URLs are no longer available. CTA [ 57 ] 1,935 853K - 720 \times 1280 R ✓ CCD [ 4 ] 4,500 225K ✓ 720 \times 1280 R ✓ DADA-2000 [ 13 ] 1,962 649K ✓ 660 \times 1584 R ✓ GTACrash [ 26 , 27 ] 11,381 228K - 400 \times 710 S ✓ YTCrash [ 26 , 27 ] 222 4,440 - 400 \times 710 R ✓ ROL [ 24 ] 1,000 100K - 720 \times 1080 R ✓ TRA [ 33 ] 2,000 40-200K - \geq 720 \times 1280 R A DeepAccident [ 52 ] - 57K ✓ 900 \times 1600 S ✓ DoTA [ 54 , 55 ] 4,990 504K ✓ 3 3 3 Re-annotated by MMAU [ 12 ] . 720 \times 1280 R ✓ CTAD [ 38 ] 1,100 727K ✓ 480 \times 640 S ✓ Nexar 1,500 1.70M ✓ 720 \times 1280 R ✓ Figure 1 : Nexar dataset samples. First column represents Before accident interval , columns 2-4 represent Alert interval , and fifth column represent After accident interval . Within the alert interval, column 2 represents the ”time-of-alert” which is the earliest moment that the driver could intervene to prevent the accident. column 4 represents the ”time-of-accident”, and column 3 represents an intermediate frame between “time-of-alert” and “time-of-accident”. A key challenge in accident prediction is its online nature. Unlike accident detection [ 21 ] , where the entire video sequence is available offline, here the system needs to predict an event (accident) before it occurs. Poor judgment can result in failing to prevent or mitigate an accident (false negative), or taking unnecessary preventive actions (false positive) that may introduce new risks, such as sudden braking. Moreover, anticipation time is critical - detecting an accident too late, even if correct, may render the prediction ineffective. Therefore, both accuracy and anticipation time are crucial. This motivated us to propose an evaluation metric that integrates both aspects into a single score: the Average Precision over different times to the event. Another challenge in accident anticipation is the subjectivity of determining when an accident can be predicted and when preventive action should be taken. This uncertainty complicates dataset construction, leading to multiple temporal labeling definitions, each reflecting different perspectives on when an accident begins [ 24 , 13 , 12 , 56 , 54 , 55 ] . We define the “time of alert” as the earliest moment when a focused human can recognize that a dangerous situation is about to occur. To mitigate subjectivity, we derive the “time of alert” from annotations provided by multiple annotators. This “time of alert” serves as a baseline for setting expectations on when a computer-based model should predict the accident. This paper presents the Nexar Dashcam Crash Prediction Challenge for evaluating early traffic accident anticipation, accompanied by a newly created dataset. Our temporal annotations for accidents and near-collisions divide videos into three intervals (Figure 1 ): 1) Before accident interval , which starts at the beginning of the video and ends at the “time of alert,” the earliest moment a driver should intervene to prevent a possible accident. 2) Alert interval , which starts at the “time of alert” and ends at the “time of accident/near accident,” the actual collision time point and the last moment when anticipation is meaningful. 3) After accident interval , which begins after the collision and extends until the end of the video. Our dataset presents significant domain challenges compared to existing datasets. It includes a substantial portion of highly challenging videos where the alert interval lasts only a few frames, as illustrated in Figure 2 . Additionally, it captures various lighting conditions, weather situations, and road types, along with camera-related artifacts such as reflections, motion blur, fog, and lens flare (Figure 3 ). The rest of the paper is organized as follows. Section 2 reviews the related literature. We introduce the dataset and its annotation process in Section 3 . Section 4 outlines the challenge details. We summarize our contributions in Section 5 and conclude by suggesting potential future directions in Section 6 . 2 Related Work Traffic Accident Anticipation . The challenge presented in this paper concerns Traffic Accident Anticipation (TAA) [ 19 , 58

Read the complete text