Use ADAS Data to Predict Near-Miss Events: A Group-Based Zero-Inflated Poisson Approach
Xinbo Zhang 1 , Montserrat Guillen 2 , Lishuai Li 3 , Xin Li 4 , Frank Youhua Chen 1* · 2025
Read Use ADAS Data to Predict Near-Miss Events: A Group-Based Zero-Inflated Poisson Approach by Xinbo Zhang 1 , Montserrat Guillen 2 , Lishuai Li 3 , Xin Li 4 , Frank Youhua Chen 1* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02614.txt.
Introduction
Xinbo Zhang and four co-authors present a 2025 insurance analytics paper predicting near-miss driving events from vehicle telematics and driver-assistance warnings. Near misses give a timely risk signal for usage-based insurance, but weekly counts are mostly zero and drivers differ widely.
The authors show standard models underfit such sparse, uneven data. Their zero-inflated Poisson frameworks learn hidden behaviour groups and fit count models by expectation-maximization, an iterative fitting routine. Data came from a commercial fleet followed for a year, covering millions of kilometres. The grouped models beat baselines and earlier telematics models on fit and on out-of-sample calibration. Sensitivity checks on group count kept the gains. The authors pitch weekly, context-aware pricing that treats driving styles fairly.
Catalog record
| CREATOR | Xinbo Zhang 1 , Montserrat Guillen 2 , Lishuai Li 3 , Xin Li 4 , Frank Youhua Chen 1* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02614
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Use ADAS Data to Predict Near-Miss Events: A Group-Based Zero-Inflated Poisson Approach Xinbo Zhang 1 , Montserrat Guillen 2 , Lishuai Li 3 , Xin Li 4 , Frank Youhua Chen 1* Abstract Driving behavior big data leverages multi-sensor telematics to understand how people drive and powers applications such as risk evaluation, insurance pricing, and targeted intervention. Usage-based insurance (UBI) built on these data has become mainstream. Telematics‐captured near-miss events (NMEs) provide a timely alternative to claim-based risk, but weekly NMEs are sparse, highly zero-inflated, and behaviorally heterogeneous even after exposure normalization. Analyzing multi-sensor telematics and ADAS warnings, we show that the traditional statistical models underfit the dataset. We address these challenges by proposing a set of zero-inflated Poisson (ZIP) frameworks that learn latent behavior groups and fits offset-based count models via EM to yield calibrated, interpretable weekly risk predictions. Using a naturalistic dataset from a fleet of 354 commercial drivers over a year, during which the drivers completed 287,511 trips and logged 8,142,896 km in total, our results show consistent improvements over baselines and prior telematics models, with lower AIC/BIC values in-sample and better calibration out-of-sample. We also conducted sensitivity analyses on the EM-based grouping for the number of clusters, finding that the gains were robust and interpretable. Practically, this supports context-aware ratemaking on a weekly basis and fairer premiums by recognizing heterogeneous driving styles. Email: [email protected], [email protected], [email protected], [email protected], [email protected] I Introduction Driving behavior big data aims at understanding drivers through various telematics methods. The analysis of those data has wide application in various domains, such as evaluating driving risks, deciding insurance premiums, and intervening in driving misbehavior. For example, in recent decades, big data-based usage-based insurance (UBI) became popular. According to [ 19 ] , the UBI market is projected to grow from USD 43.38 billion in 2023 to USD 70.46 billion by 2030. In this paper, we are interested in studying telematics data for near-miss event (NME) prediction. NMEs refer to sudden activities in driving, including acceleration, braking intensity, turning radius, etc. The collation and analysis of NME enables the government to develop road safety standards for automobiles in various conditions and in specific traffic situations. From an industry perspective, NME enables a structural shift from low-frequency, claim-based rating to high-frequency, behavior-aware pricing, accelerating the transition from Pay-As-You-Drive (PAYD) to Pay-How-You-Drive (PHYD) products. Operationally, this shifts focus on safety management from ‘Post-event Claims’ to ‘Pre-event Training’. NMEs can also replace crashes as a risk indicator for risk modeling. Compared with low-severity incident data, the more frequent NMEs provide the possibility of richer behavioral insights. In the big data literature on driving behavior, researchers often focus on driving mobility factors such as time, mileage, and speed, using personal driving information to predict driving risks and improve insurance pricing [ 14 , 3 , 13 ] . Most studies leverage On-Board Diagnostic (OBD) and Global Positioning System (GPS) trajectory data to extract driving behavior features from basic signals. e.g., instant speed, acceleration/braking intensity, frequency of sudden acceleration/braking events, lane departure events, driving time distribution, and road type proportion, etc. The automotive industry has actively addressed driving safety concerns through the implementation of advanced driver assistance systems (ADAS), harnessing Internet of Things (IoT) technologies to automate, optimize, and improve vehicle functions. ADAS systems deliver critical risk-related feedback, alerting drivers to potential threats and, consequently, supporting safer decision-making. [ 32 , 1 , 6 ] . Currently, very few studies have explored driving behavior learning by fully assessing multi‐sensor telematics to characterize near‐miss events and deliver targeted feedback. In driving behavior studies, certain data features pose persistent challenges. Most automobile insurance databases record a large number of policyholders with zero claims, and zero inflation may be exacerbated by reporting incentives (e.g., deductibles or bonus-malus penalties) [ 4 , 5 ] . In contrast, when NMEs are captured in real-time via telematics, all events occurring while the device is active are observed. Nevertheless, zero counts remain frequent at the driver-week level because NMEs are rare within short aggregation windows and drivers differ in exposure. As a result, a standard Poisson model tends to underestimate the probability of zero, motivating zero-inflated specifications and, when necessary, overdispersion-robust variants. Such datasets typically exhibit a long-tailed distribution, characterized by a high concentration of zero counts alongside a sparse but highly uneven spread of non-zero counts. In statistical terms, a long tail means that, beyond the dominant zeros, most non-zero observations are very small, while a tiny fraction of cases may record very high counts, stretching the distribution’s tail. This pattern causes problems when fitting a standard model; the probability of zero events is often underestimated, so adjustments are needed to account for the higher-than-expected zero count. The zero-inflated Poisson (ZIP) model is a natural choice for handling ‘excess zeros’ in claim or near-miss data, which we take to tackle the problem. Furthermore, accurately characterizing driver behavior is essential in driving risk analysis. Different types of vehicles and drivers show distinct patterns: sports car drivers often perform high-risk maneuvers such as rapid acceleration and sharp turns, while conservative drivers favor gentle acceleration and gradual braking. Grouping data before modeling also helps address two common issues: data sparsity and data inconsistency. To overcome these challenges, we propose grouped predictive analytics to group drivers in clusters by style or car model and then fit separate models for each group. Specifically, in this paper, we frame the problem of NME prediction as a time series forecasting problem (on a weekly basis). We propose a Grouped ZIP (G-ZIP) model to handle the “excess of zeros” in the weekly near-miss counts. The model gathers drivers into behaviorally homogeneous groups (e.g., by car model or driving style) and fits a separate ZIP model to each cluster to capture heterogeneity. To address the long-tail distribution of non-zero counts, we develop a Grouped Zero-Inflated Generalized Poisson (G-ZIGP) model that extends G-ZIP to accommodate both excess zeros and overdispersion. Furthermore, we analyze a historical sensor stream ADAS dataset, and a driver profiles UBI dataset to compute personalized premiums, updating rates weekly based on predicted near-miss risk. We conduct experiments on the ADAS-GNCC telematics dataset of 354 drivers in Ireland from April 2021 to March 2022, aggregated to 12,528 driver-weeks with GNSS traces, containing warning-based ADAS event information and 16 contextual attributes [ 21 ] . Our performance achieves improvements over strong baselines in AIC/BIC and RMSE and remains robust under sensitivity analysis, where the number of behavior groups is varied. In conclusion, our approach not only advances automobile telematics risk modeling but also provides actionable insights for insurers and managers through an end-to-end prediction and optimization pipeline. The paper is organized as follows. Section 2 introduces the theoretical foundation and development of related work. Section 3 proposes our main behavior prediction model. Section 4 conducts experiments, and Section 5 concludes the work. II Related Work II-A Driver Behavior Modeling Driver behavior has received considerable attention over recent decades, as extensively reviewed in [ 16 , 23 ] . Researchers have increasingly focused on diverse sensor data and semantic features extracted from various data sources to enhance risk assessments. Early studies predominantly relied on GPS tracking data obtained from vehicles [ 33 ] , smartphone-embedded sensor