Comparing Normalizing Flows with Kernel Density Estimation in Estimating Risk of Automated Driving Systems

1 st Erwin de Gelder, 2 nd Maren Buermann, 3 rd Olaf Op den Camp · 2025

Read Comparing Normalizing Flows with Kernel Density Estimation in Estimating Risk of Automated Driving Systems by 1 st Erwin de Gelder, 2 nd Maren Buermann, 3 rd Olaf Op den Camp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22429.txt.

Introduction

Erwin de Gelder, Maren Buermann, and Olaf Op den Camp compare in 2025 two ways to estimate how often self-driving cars face each kind of traffic scene. Safety testing needs those frequencies to turn test results into a risk number. Guessing a simple curve shape can bias the answer, while flexible methods struggle as variables multiply.

They test normalizing flows, a learning method that warps a simple distribution into a complex one without shape assumptions. Against the classic kernel method, flows cost more computing but resist the blowup that comes with many variables. The flows gave tighter risk estimates with less uncertainty. The authors see them as a useful upgrade for scenario-based safety checks.

Catalog record

CREATOR1 st Erwin de Gelder, 2 nd Maren Buermann, 3 rd Olaf Op den Camp
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22429

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Comparing Normalizing Flows with Kernel Density Estimation in Estimating Risk of Automated Driving Systems Thanks: The research presented in this work has been made possible by the SYNERGIES project. This project is funded by the European Union’s Horizon Europe Research & Innovation Actions under grant agreement No. 101146542. Views and opinions expressed are however those of the authors only and do not necessarily reflect those of the European Union or the European Climate, Infrastructure and Environment Executive Agency (CINEA). Neither the European Union nor the granting authority can be held responsible for them. 1 st Erwin de Gelder, 2 nd Maren Buermann, 3 rd Olaf Op den Camp Abstract The development of safety validation methods is essential for the safe deployment and operation of ADS . One of the goals of safety validation is to prospectively evaluate the risk of \@iaci ADS ADS dealing with real-world traffic. Scenario-based assessment is a widely-used approach, where test cases are derived from real-world driving data. To allow for a quantitative analysis of the system performance, the exposure of the scenarios must be accurately estimated. The exposure of scenarios at parameter level is expressed using \@iaci PDF PDF ( PDF ). However, assumptions about the PDF , such as parameter independence, can introduce errors, while avoiding assumptions often leads to oversimplified models with limited parameters to mitigate the curse of dimensionality. This paper considers the use of NF ( NF ) for estimating the PDF of the parameters. NF are a class of generative models that transform a simple base distribution into a complex one using a sequence of invertible and differentiable mappings, enabling flexible, high-dimensional density estimation without restrictive assumptions on the PDF ’s shape. We demonstrate the effectiveness of NF in quantifying risk and risk uncertainty of \@iaci ADS ADS , comparing its performance with KDE ( KDE ), a traditional methods for non-parametric PDF estimation. While NF require more computational resources compared to KDE , NF is less sensitive to the curse of dimensionality. As a result, NF can improve risk uncertainty estimation, offering a more precise assessment of \@iaci ADS ADS ’s safety. This work illustrates the potential of NF in scenario-based safety. Future work involves experimenting more with using NF for scenario generation and optimizing the NF architecture, transformation types, and training hyperparameters to further enhance their applicability. ADS Automated Driving System FSM Fuzzy Safety Model IQR Inter-Quartile Range KDE Kernel Density Estimation MAF Masked Autoregressive Flow NF Normalizing Flows PDF Probability Density Function I INTRODUCTION \Acp ADS are expected to improve traffic safety, comfort, and congestion by reducing human errors [ 1 ] . While lower-level systems like adaptive cruise control and lane keeping assist are already common, higher-level ADS (SAE Level 3 and 4) are nearing large-scale deployment. Ensuring their safety prior to release is critical. As large-scale road testing is impractical [ 2 ] , prospective methods are required. Scenario-based safety validation has emerged as a widely supported approach in the automotive domain [ 3 , 4 ] . An essential aspect of scenario-based safety validation is risk estimation, where risk is the combination of exposure to a scenario and the consequence of the response to that scenario. \@firstupper \@iaci PDF PDF measures the exposure to different scenarios at the parameter level. However, making assumptions about the PDF , e.g., assuming parameter independence, can introduce errors. Conversely, avoiding such assumptions often results in oversimplified models that include only a limited number of parameters to address the curse of dimensionality. KDE [ 5 , 6 ] is a non-parametric method for estimating the PDF that does not rely on assumptions regarding the shape of the PDF . In the literature, KDE has been utilized to estimate the PDF of scenario parameters for the assessment of ADS [ 7 , 8 ] . However, a notable disadvantage of KDE is its susceptibility to the curse of dimensionality. As an alternative, this paper explores the use of NF [ 9 ] , another non-parametric method for PDF estimation, which has demonstrated promising results for high-dimensional data. In this work, we will compare the use of KDE and NF in estimating the exposure of scenarios at the parameter level and the associated risk estimated using scenarios sampled from the estimated PDF . To the best of our knowledge, NF have not been utilized in the literature on safety assessment methods for ADS . Furthermore, several recent survey papers on scenario generation [ 10 , 11 , 12 , 13 , 14 , 15 ] do not mention the application of NF . Consequently, this study aims to provide an initial perspective on the potential of NF for the safety assessment of ADS . Specifically, this work will address two different aspects of safety assessment. The first part involves comparing the use of NF and KDE in estimating the PDF of scenario parameters, leading to the following research question: Research question 1 . How do NF and KDE compare in estimating the PDF of scenario parameters? The second aspect focuses on comparing NF and KDE in estimating the risk, following the procedure outlined in [ 7 ] . Thus, the second research question is: Research question 2 . When used for scenario exposure modeling, how do NF and KDE compare in quantifying ADS risk? Input PDF of x : p_{x} , estimated using KDE or NF Monte Carlo Sample N_{\mathrm{MC}} times from p_{x} , and do simulations to obtain \mathopen{}\mathclose{{\left\{x_{k},R\mathopen{}\mathclose{{\left(x_{k}}}\right)}}\right\}_{k=1}^{N_{\mathrm{MC}}} Importance density Select N_{\mathrm{C}}<N_{\mathrm{MC}} most critical scenarios and construct p_{x}^{*} using KDE Importance sampling Sample N_{\mathrm{NIS}} times from p_{x}^{*} , and do simulations to obtain \mathopen{}\mathclose{{\left\{x_{k},R\mathopen{}\mathclose{{\left(x_{k}}}\right)}}\right\}_{k=1}^{N_{\mathrm{NIS}}} Result Estimate collision probability, \mathds{E}\mathopen{}\mathclose{{\left[R\mathopen{}\mathclose{{\left(x}}\right)}}\right] , using (3). Fig. 1: Schematic overview of the risk quantification method. This work is structured as follows. Section II first briefly explains the risk quantification method of [ 7 ] , after which we explain how NF and KDE are exploited in this paper. In Section III-A , the case study is first detailed, after which the results aiming to answer the aforementioned research questions are presented. This work concludes with a discussion in Section IV and conclusions and a future outlook in Section V . II METHOD This section first clarifies how we quantify the risk of \@iaci ADS ADS . This also shows that \@iaci PDF PDF is needed to estimate the exposure of scenarios at parameter level. Since the shape of the PDF is generally unknown beforehand, we propose to use a non-parametric method for estimating the PDF . This work employs NF for non-parametric PDF estimation and compares this with the more traditional KDE . Section II-B explains NF and how this work utilizes them and Section II-C provides further details on KDE . II-A Risk quantification As explained in [ 7 ] and in line with the ISO 26262 standard [ 16 ] , risk consists of three components: exposure, severity, and controllability (definitions are in [ 7 , 16 ] ). When calculating severity, the extent of harm in a potential collision should be considered. For the sake of comparing NF with KDE , however, this work treats all collisions equally. Thus, we will express the risk as the probability of a collision

Read the complete text