Enhancing Uncertainty Quantification for Runtime Safety Assurance Using Causal Risk Analysis and Operational Design Domain

Radouane Bouchekir, Michell Guzman Cancimance · 2025

Read Enhancing Uncertainty Quantification for Runtime Safety Assurance Using Causal Risk Analysis and Operational Design Domain by Radouane Bouchekir, Michell Guzman Cancimance (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03515.txt.

Introduction

Radouane Bouchekir and Michell Guzman Cancimance sharpen runtime safety checks for self-driving systems. Their 2025 paper tackles the doubt that haunts learned parts, which also bends with weather and scene. Their boost folds the working setting into the doubt count. Hazard study and fault trees name the setting traits that sway function most.

Those traits join data and model doubt in one Bayesian network. Live setting reads then set the network, yielding a spread of safety estimates with a mean and a wobble. A valet parking object detector shows the method at work.

Catalog record

CREATORRadouane Bouchekir, Michell Guzman Cancimance
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03515

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Uncertainty Quantification for Runtime Safety Assurance Using Causal Risk Analysis and Operational Design Domain Radouane Bouchekir, Michell Guzman Cancimance Abstract Ensuring the runtime safety of autonomous systems remains challenging due to deep learning components’ inherent uncertainty and their sensitivity to environmental changes. In this paper, we propose an enhancement of traditional uncertainty quantification by explicitly incorporating environmental conditions using risk-based causal analysis. We leverage Hazard Analysis and Risk Assessment (HARA) and fault tree modeling to identify critical operational conditions affecting system functionality. These conditions, together with uncertainties from the data and model, are integrated into a unified Bayesian Network (BN). At runtime, this BN is instantiated using real-time environmental observations to infer a probabilistic distribution over the safety estimation. This distribution enables the computation of both expected performance and its associated variance, providing a dynamic and context-aware measure of uncertainty. We demonstrate our approach through a case study of the Object Detection (OD) component in an Automated Valet Parking (AVP). I Introduction The integration of Deep Neural Networks (DNNs) in autonomous systems (AS), such as Automated Valet Parking ( AVP ) [ 7 , 22 ] , has significantly advanced perception and decision-making capabilities. However, these learning-enabled components introduce substantial uncertainty and pose challenges for traditional, static safety assurance methods. This uncertainty arises not only from the model and data but also from dynamic, partially observable environments where safety assumptions may no longer hold at runtime. As a result, static safety assurance can quickly become obsolete, undermining trust in the system’s safe operation [ 6 , 15 ] . To ensure trustworthy behavior, safety assurance must evolve from a static, design-time process into a dynamic, runtime capability that accounts for real-world operational variability. In particular, environmental conditions, such as lighting, weather, and road surface states, can significantly impact the perception and control components of AS, especially those powered by DNNs. Therefore, quantifying how such conditions influence model behavior and propagating their effects into safety arguments is essential for robust runtime assurance [ 20 ] . In this paper, we propose a methodology that enhances traditional uncertainty metrics by explicitly incorporating environmental conditions into the confidence estimation process. Our approach combines Hazard Analysis and Risk Assessment (HARA) with causal modeling techniques to identify environmental and contextual conditions that affect the functionality of safety-critical components. These relationships are encoded in a Bayesian Network (BN) that unifies uncertainty from the model, the data, and the operational context. At runtime, this BN is instantiated using real-time environmental observations, enabling the computation of a posterior distribution over the safety estimate. This distribution yields both the mean estimate (e.g., likelihood of correct behavior) and its variance (uncertainty), providing a dynamic, context-sensitive confidence metric. A key contribution of our approach lies in its formalization strategy. To support machine-interpretable, consistent, and verifiable representations of the Operational Design Domain (ODD), safety arguments, and confidence models, we adopt an ontological framework grounded in Description Logic (DL). This formal representation facilitates automated reasoning, semantic querying, and traceability across assurance artifacts. Furthermore, by aligning our ontology with the ASAM OpenODD [ 1 ] , we ensure semantic coherence and interoperability with emerging safety engineering practices. Specifically, the main contributions of this work are as follows: - Systematic methodology for defining and formalizing ODD. - Confidence model creation that explicitly incorporating environmental conditions into the confidence estimation process. - Runtime monitoring mechanism that dynamically computes confidence scores using instantiated ODD attributes. In the following sections, we structure our work as follows: Section II introduces the AVP case study. Section III details our methodology for quantifying uncertainty. Section IV presents the process for ODD determination and formalization, and Section V illustrates the safety argument pattern and their formalization. Section VI explains the creation and formalization of confidence models. Section VII demonstrates runtime confidence computation, and Section VIII illustrates the implementation details. We conclude in Section IX . II The AVP Case Study This section presents a case study of the Automated Valet Parking ( AVP ) system, developed as part of the FOCETA project 1 1 1 https://www.foceta-project.eu/ . The AVP functionality enables a vehicle to autonomously navigate to and park in an available parking space without human intervention [ 2 ] . In a typical scenario, the driver leaves the car in a designated handover area, after which the AVP system assumes control, computes a safe trajectory, and autonomously drives the car to a free parking spot. Fig. 1: System architecture of the Automated Valet Parking ( AVP ) system. The AVP system architecture, depicted in Fig. 1 , is composed of multiple interacting components. The Planning Component ( PC ) is responsible for generating a collision-free path from the drop-off location to the target parking spot. The Path Follower ( PF ) ensures the vehicle adheres to this predefined path during navigation. To enhance safety, an Emergency Braking mechanism is activated whenever the Object Detector ( OD ) identifies an obstacle within a critical distance. The PF and emergency brake collectively constitute the system’s Control Component ( CC ). Challenges in Safety Assurance. To ensure the safe operation of the AVP system, it must adhere to the following key safety requirement [ 7 , 22 ] : “Safe_OD Req: The ego vehicle shall not collide with pedestrians, unless its velocity is zero.” However, establishing and maintaining a convincing safety argument that demonstrates compliance with Safe_OD is non-trivial. The dynamic and uncertain nature of the operational environment, combined with the inherent limitations of DNNs, poses substantial challenges in guaranteeing safe behavior across all operating scenarios. While a safety case for the AVP system was proposed in [ 22 ] , it lacks a quantitative confidence argumentation framework to rigorously assess the trustworthiness of the claims made. III Methodology Fig. 2: Overview of the proposed approach for DNN uncertainty quantification. The goal of our methodology is to construct a confidence-aware safety argument that accounts not only for the model and data but also for environmental variability. To achieve this, we quantify uncertainty in DNNs by integrating model, data, and environmental uncertainties within a unified BN-based framework. An overview of this methodology is presented in Fig. 2 . The design phase begins with the determination of ODD classes and attributes. This is accomplished through a combination of ability graphs, which capture dependencies between system capabilities and environmental conditions, and risk-based causal analysis. The analysis yields a causal structure that links hazards to specific, measurable operational conditions (e.g., fog, low illumination, surface wetness). These conditions are refined into ODD attributes with clearly defined operational boundaries. The formalization of the resulting ODD is done using DL in alignment with the OpenODD ontology 2 2 2 https://www.asam.net/standards/detail/openodd/ . To support safety argumentation for DNN-based components, we adopt structured safety case patterns [ 24 , 11 , 22 ] . These patterns define assurance goals, represented as claims and supported by corresponding evidence. While such safety arguments are typically static, we extend this process by constructing a confidence model that allows quantification of the trustworthiness of the supporting evidence. This model is realized as a BN constructed from the ODD definitions and risk analysis results, and it captures uncertainties related to data appropriateness, model robustness, and testing adequacy.

Read the complete text