Accident Anticipation via Temporal Occurrence Prediction
Tianhao Zhao, Yiyang Zou, Zihao Mao, Peilun Xiao, Yulin Huang, Hongda Yang, Yuxuan Li, Guobin Wu, Yutian Lin · 2025
Read Accident Anticipation via Temporal Occurrence Prediction by Tianhao Zhao, Yiyang Zou, Zihao Mao, Peilun Xiao, Yulin Huang, Hongda Yang, Yuxuan Li, Guobin Wu, Yutian Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22260.txt.
Introduction
Tianhao Zhao leads a ten-author team teaching dashcam systems to forecast a crash instead of merely sensing one. Accident anticipation usually trains a model to score how risky the current frame looks. The training labels call every frame of a crash video dangerous, even the calm opening seconds, so the model learns from a lie and cries wolf.
The team's paradigm predicts accident scores at many future moments at once, from a tenth of a second to two seconds ahead, supervised by the precisely annotated instant the accident actually begins. A snippet-level encoder reads the space-time dynamics of short clips, and a Transformer decoder with dedicated time queries issues all the horizon forecasts together. A tightened evaluation protocol reports how early a correct warning arrives and how many accidents are caught, the two numbers that decide whether anticipation saves anyone.
Catalog record
| CREATOR | Tianhao Zhao, Yiyang Zou, Zihao Mao, Peilun Xiao, Yulin Huang, Hongda Yang, Yuxuan Li, Guobin Wu, Yutian Lin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22260
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Accident Anticipation via Temporal Occurrence Prediction Tianhao Zhao, Yiyang Zou, Zihao Mao, Peilun Xiao, Yulin Huang, Hongda Yang, Yuxuan Li, Guobin Wu, Yutian Lin Abstract Accident anticipation aims to predict potential collisions in an online manner, enabling timely alerts to enhance road safety. Existing methods typically predict frame-level risk scores as indicators of hazard. However, these approaches rely on ambiguous binary supervision—labeling all frames in accident videos as positive—despite the fact that risk varies continuously over time, leading to unreliable learning and false alarms. To address this, we propose a novel paradigm that shifts the prediction target from current-frame risk scoring to directly estimating accident scores at multiple future time steps (e.g., 0.1s–2.0s ahead), leveraging precisely annotated accident timestamps as supervision. Our method employs a snippet-level encoder to jointly model spatial and temporal dynamics, and a Transformer-based temporal decoder that predicts accident scores for all future horizons simultaneously using dedicated temporal queries. Furthermore, we introduce a refined evaluation protocol that reports Time-to-Accident (TTA) and recall—evaluated at multiple pre-accident intervals (0.5s, 1.0s, and 1.5s)—only when the false alarm rate (FAR) remains within an acceptable range, ensuring practical relevance. Experiments show that our method achieves superior performance in both recall and TTA under realistic FAR constraints. Project page: https://happytianhao.github.io/TOP/ 1 Introduction Driving accidents pose a significant threat to public safety, resulting in substantial human casualties and economic losses. This issue often arises when drivers, due to fatigue or distraction, fail to notice potential hazards in their surroundings, ultimately resulting in accidents. Recently, the task of accident anticipation [ 1 , 2 ] has been widely studied to analyze the risk in driving scenarios captured by dashcams in an online manner, assessing the likelihood of an impending accident with a risk score, as shown in Figure 1 (a). If the risk score exceeds a preset threshold, the system can promptly alert the driver to take evasive action, thereby reducing the chances of an accident or mitigating its severity. Previous works [ 3 , 4 , 5 , 6 , 7 , 8 , 9 ] train models to predict frame-wise risk scores using binary supervision: all frames from accident videos are labeled as 1, and all frames from safe videos as 0. To reflect the intuition that risk increases near the crash, these methods typically assign exponentially decaying loss weights to frames based on their temporal distance to the accident—earlier frames receive lower weights, while those near the crash receive higher ones. However, this approach treats risk as a static binary signal, ignoring its dynamic and continuously varying nature. In reality, risk levels differ significantly across frames even within the same accident sequence, and assigning a uniform label of 1 fails to capture these temporal nuances. Such imprecise supervision misguides learning and often leads to unreliable predictions or false alarms. We observe that, unlike ambiguous risk labels, the timestamp of actual accident occurrence can be precisely annotated in real-world driving videos. To leverage this reliable supervision, we shift the prediction target from per-frame risk scores to directly forecasting future accident timing. Specifically, as shown in Figure 1 (b), our model outputs a sequence of accident scores at multiple future time steps \{a_{1},a_{2},\dots,a_{T}\} (e.g., 0.1s, 0.2s, …, 2.0s ahead), where each score a_{t} indicates the model’s confidence that an accident occurs exactly at that time. During training, only the score at the ground-truth accident time is labeled as 1; all others are 0. At inference, an alert is triggered if any score exceeds a preset threshold, indicating an impending collision. This formulation offers two key advantages: (1) it uses precise temporal annotations for more stable and accurate training, and (2) by modeling when an accident may occur—rather than just whether the scene is “risky”—it yields more interpretable and actionable predictions. (a) Previous works (b) Ours Figure 1: Comparison of accident anticipation paradigms. (a) Previous works predict a single risk score for the current frame, which is ambiguous and hard to supervise accurately. (b) Our method predicts a sequence of accident scores at multiple future time steps (e.g., 0.1s, 0.2s, …, 2.0s ahead), where each score indicates the likelihood of an accident occurring exactly at that future time. To implement this paradigm online, we adopt an encoder–decoder architecture that processes current and past frames to predict accident scores for multiple future time steps (e.g., 0.1s, 0.2s, …, 2.0s ahead), as shown in Figure 1 (b). Unlike previous works [ 3 , 4 , 5 , 6 , 7 , 9 ] , which typically use frame-level encoders with RNNs to model temporal dynamics, our method employs a snippet-level encoder that jointly captures spatial and temporal information across short clips of consecutive frames, enabling a comprehensive understanding of object positions, speeds, and motion trajectories. Furthermore, we design a Transformer-based temporal decoder that simultaneously predicts accident scores for all future time steps using distinct learnable temporal queries—each corresponding to a specific future horizon—to explicitly model accident likelihood at each time offset, supporting accurate and efficient frame-by-frame online prediction. To evaluate the effectiveness of accident anticipation methods, previous works [ 3 , 4 , 5 , 6 , 7 , 9 ] primarily use AP (Average Precision), AUC (Area Under the ROC Curve), and TTA (Time-to-Accident). However, we observe that in real-world applications, an excessively high false alarm rate (FAR)—e.g., exceeding 1 false alarm per minute—causes disruptive alerts that are unacceptable; under such conditions, high recall may stem from indiscriminate alarming rather than genuine prediction, rendering recall and TTA misleading. To address this, we propose a novel evaluation protocol that reports mean recall and TTA only when FAR is within an acceptable range. Furthermore, we evaluate recall at different pre-accident intervals (0.5s, 1.0s, and 1.5s before crashes) for a more granular assessment of anticipative capability. Finally, we identify limitations in existing TTA calculations that yield inflated values and propose a more reasonable approach, as detailed in Section 4 . Our contributions can be summarized as follows: • We propose a novel accident anticipation paradigm that shifts from predicting ambiguous per-frame risk scores to directly estimating accident scores at multiple future time steps (e.g., 0.1s, 0.2s, …, 2.0s ahead), leveraging precise accident timestamps as supervision for more accurate and interpretable predictions. • We design an effective encoder–decoder architecture featuring a snippet-level encoder to jointly capture spatial and temporal features from driving scenarios, and a Transformer-based temporal decoder that predicts accident scores for all future time steps simultaneously using dedicated temporal queries, enabling online frame-by-frame anticipation. • We introduce a refined evaluation protocol that computes recall and Time-to-Accident (TTA) only when the false alarm rate (FAR) is within an acceptable range, evaluates recall at multiple pre-accident intervals (0.5s, 1.0s, 1.5s), and adopts an improved TTA calculation method that avoids inflated values, offering a more reliable and practical assessment. 2 Related Work 2.1 Temporal Modeling and Attention-Based Approaches Early works on accident anticipation primarily rely on recurrent architectures to model temporal dynamics in dashcam videos. DSA [ 3 ] introduced the first large-scale dataset (DAD) and combined object-level and frame-level features with an RNN to predict per-frame risk scores, using an exponentially decaying loss that emphasizes frames closer to the accident. Subsequent methods enhanced temporal modeling through attention mechanisms. ACRA [