RiskProp: Collision-Anchored Self-Supervised Risk Propagation for Early Accident Anticipation
Yiyang Zou, Tianhao Zhao, Peilun Xiao, Hongyu Jin, Longyu Qi, Yuxuan Li, Liyin Liang, Yifeng Qian, Chunbo Lai, Yutian Lin, Zhihui Li · 2026
Read RiskProp: Collision-Anchored Self-Supervised Risk Propagation for Early Accident Anticipation by Yiyang Zou, Tianhao Zhao, Peilun Xiao, Hongyu Jin, Longyu Qi, Yuxuan Li, Liyin Liang, Yifeng Qian, Chunbo Lai, Yutian Lin, Zhihui Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27165.txt.
Introduction
Zou and co-authors present RiskProp, a self-supervised method for anticipating car accidents from dashcam video. Prior methods need hand-labeled anomaly onset frames, which are subjective and inconsistent. RiskProp anchors only on the reliably labeled collision frame instead. A future-frame loss lets each frame learn from the model's next-frame prediction. Risk signals thus propagate backward through the clip over time. An adaptive monotonic constraint keeps the risk curve rising toward impact. On CAP and Nexar data, RiskProp reached state-of-the-art accuracy.
Catalog record
| CREATOR | Yiyang Zou, Tianhao Zhao, Peilun Xiao, Hongyu Jin, Longyu Qi, Yuxuan Li, Liyin Liang, Yifeng Qian, Chunbo Lai, Yutian Lin, Zhihui Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36082 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27165
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RiskProp: Collision-Anchored Self-Supervised Risk Propagation for Early Accident Anticipation Yiyang Zou, Tianhao Zhao, Peilun Xiao, Hongyu Jin, Longyu Qi, Yuxuan Li, Liyin Liang, Yifeng Qian, Chunbo Lai, Yutian Lin, Zhihui Li Abstract Accident anticipation aims to predict impending collisions from dashcam videos and trigger early alerts. Existing methods rely on binary supervision with manually annotated “anomaly onset” frames, which are subjective and inconsistent, leading to inaccurate risk estimation. In contrast, we propose RiskProp , a novel collision-anchored self-supervised risk propagation paradigm for early accident anticipation, which removes the need for anomaly onset annotations and leverages only the reliably annotated collision frame. RiskProp models temporal risk evolution through two observation-driven losses: first, since future frames contain more definitive evidence of an impending accident, we introduce a future-frame regularization loss that uses the model’s next-frame prediction as a soft target to supervise the current frame, enabling backward propagation of risk signals; second, inspired by the empirical trend of rising risk before accidents, we design an adaptive monotonic constraint to encourage a non-decreasing progression over time. Experiments on CAP and Nexar demonstrate that RiskProp achieves state-of-the-art performance and produces smoother, more discriminative risk curves, improving both early anticipation and interpretability. Code: https://github.com/xingyueye5/RiskProp/ . 1 Introduction As autonomous vehicles and advanced driver assistance systems continue to evolve, accident anticipation has become increasingly important for improving road safety. Its goal is to predict whether an accident is likely to occur in the near future based on the current driving scene captured by a dashcam. To achieve this, the system continuously estimates a risk score in real time, and if the score exceeds a predefined threshold, an alert is triggered to enable early intervention. This allows both autonomous systems and human drivers to take preventive actions before an accident happens, thereby reducing the risk of collision and enhancing overall driving safety. (a) (b) Figure 1 : Form of supervision of previous works and ours. (a) Most previous methods treat all frames in accident-free videos as negative samples with label 0, and treat frames in accident videos—from the annotated anomaly onset frame to the collision frame—as positive samples with labeled 1. (b) Our method treats the model’s prediction for the next frame as a supervision signal for the current frame, which enables the risk values to propagate gradually backward from the collision frame. Most existing works 5 ; 17 ; 21 ; 43 ; 38 for accident anticipation train models to predict a risk score for each frame by treating the task as supervised learning with binary labels: all frames in accident-free videos are labeled 0, while all frames in accident videos—from the beginning up to collision—are labeled 1, as shown in Fig. 1 (a). To compensate for the fact that risk in pre-collision frames is typically intermediate and evolves gradually, these methods apply exponentially decaying weights to the binary cross-entropy loss, assigning lower penalties to earlier frames. To further improve early anticipation, some works 33 ; 32 adopt adaptive loss weighting schemes, while others 8 ; 26 manually annotate the “anomaly onset” frame for accident videos and adjust loss weights relative to it. However, this binary labeling paradigm is fundamentally flawed: it forces the model to treat all pre-collision frames as equally risky, ignoring the intermediate and scenario-dependent nature of risk evolution—such as slow increases when a driver is distracted versus rapid spikes when a pedestrian suddenly appears. Moreover, the manual annotation of anomaly onset is subjective and inconsistent across annotators, leading to noisy and unreliable supervision. As a result, the model is misled to optimize risk predictions toward inaccurate binary targets rather than reflecting the true, dynamic progression of risk. Given the limitations of handcrafted labels and unreliable manual annotations, we turn to data-driven observations about the nature of risk in driving scenarios. First, we observe that accident anticipation fundamentally aims to predict whether a collision will occur in the future based on current observations. Since future frames contain more definitive evidence about the occurrence of an accident, the model’s risk predictions for these frames are typically more accurate and better aligned with ground truth than those for earlier frames. This suggests that future predictions can serve as reliable pseudo-supervision signals to guide the learning of current risk estimates. Second, we find that in accident videos, the underlying risk tends to follow a non-decreasing trend over time within a long temporal window before collision—reflecting the progressive deterioration of driving safety as hazardous conditions unfold. Building on these observations, we propose RiskProp, a novel collision-anchored self-supervised risk propagation paradigm for early accident anticipation. It generates intermediate risk scores for pre-collision frames by propagating supervision backward from the collision frame without relying on binary labeling schemes or manual anomaly onset annotations. Specifically, as shown in Fig. 1 (b), for accident videos, we assign a hard risk label of 1 only to the collision frame, whose timing is reliably annotated. For all other pre-collision frames in accident videos, we generate soft supervision signals by propagating risk information backward in time instead of fixed binary labels, where the model’s prediction on the next frame (detached from gradient computation) serves as the target for the current frame. This self-supervised temporal regularization enables early frames to receive intermediate and discriminative risk supervision, reflecting the gradual buildup of danger rather than being forced into arbitrary hard labels. For accident-free videos, all frames are assigned a risk label of 0. By design, RiskProp avoids the need for subjective anomaly onset annotation and learns a more nuanced risk progression grounded in temporal consistency. Furthermore, to encourage a plausible long-term trend in risk evolution, we introduce an adaptive monotonic constraint loss that penalizes violations where a later frame is assigned a lower risk than an earlier one within the same sequence. This loss operates over randomly sampled frame pairs and allows short-term fluctuations while promoting an overall non-decreasing pattern consistent with real-world dynamics. Our contributions can be summarized as follows: • We reveal the limitations of binary labeling and manual anomaly onset annotations in accident anticipation, and instead base our approach on two empirical observations: future frames provide more reliable risk cues, and pre-collision risk tends to grow non-decreasingly over time. • We propose RiskProp, a novel collision-anchored self-supervised paradigm that generates intermediate risk scores by propagating supervision backward from the collision frame. It introduces a future-frame regularization loss and an adaptive monotonic constraint loss, eliminating the need for subjective annotations and encouraging early anticipation. • Extensive experiments on two datasets demonstrate that our method achieves state-of-the-art performance and produces risk curves with better temporal consistency and earlier warning capability. 2 Related Work Figure 2 : Overview of our RiskProp framework. The encoder-only model takes a snippet of consecutive frames and predicts the current frame’s risk score. To train such a model without “anomaly onset” labels and with only the objective collision frame label, two losses are proposed: The Future-Frame Regularization Loss uses the next-frame’s detached prediction as a self-supervised target for high-risk signals backward propagation, while the Adaptive Monotonic Constraint Loss imposes a monotonicity constraint to ensure a non-decreasing overall risk trend. And we adopt the Binary Cross-Entropy loss to provide explicit supervision only at the collision frame. This enables stable, physically plausible risk