Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics
Bernd Frauenknecht, Lukas Kesper, Daniel Mayfrank, Henrik Hose, Sebastian Trimpe · 2026
Read Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics by Bernd Frauenknecht, Lukas Kesper, Daniel Mayfrank, Henrik Hose, Sebastian Trimpe (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26836.txt.
Introduction
Frauenknecht and four colleagues introduce UPSi, a safety filter that checks safety for reinforcement-learning exploration with probabilistic ensemble neural nets. Old filters leaned on first-principles models or Gaussian processes, limiting scale, while ensemble models lacked strict uncertainty checks. UPSi frames future outcomes as reachable sets and adds a clear certainty rule that blocks model exploitation. Tested in Dyna-style model-based learning on standard safe benchmarks, it lifts exploration safety well over past neural filters while matching standard performance.
Catalog record
| CREATOR | Bernd Frauenknecht, Lukas Kesper, Daniel Mayfrank, Henrik Hose, Sebastian Trimpe |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98144 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26836
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics Bernd Frauenknecht, Lukas Kesper, Daniel Mayfrank, Henrik Hose, Sebastian Trimpe Abstract Predictive safety filters (PSFs) leverage model predictive control to enforce constraint satisfaction during deep reinforcement learning (RL) exploration, yet their reliance on first-principles models or Gaussian processes limits scalability and broader applicability. Meanwhile, model-based RL (MBRL) methods routinely employ probabilistic ensemble (PE) neural networks to capture complex, high-dimensional dynamics from data with minimal prior knowledge. However, existing attempts to integrate PEs into PSFs lack rigorous uncertainty quantification. We introduce the Uncertainty-Aware Predictive Safety Filter (UPSi), a PSF that provides rigorous safety predictions using PE dynamics models by formulating future outcomes as reachable sets. UPSi introduces an explicit certainty constraint that prevents model exploitation and integrates seamlessly into common MBRL frameworks. We evaluate UPSi within Dyna-style MBRL on standard safe RL benchmarks and report substantial improvements in exploration safety over prior neural network PSFs while maintaining performance on par with standard MBRL. UPSi bridges the gap between the scalability and generality of modern MBRL and the safety guarantees of predictive safety filters. 1 Introduction Exploration safety is a major concern in deep reinforcement learning (RL). Predictive safety filters (PSFs) ( Wabersich & Zeilinger 2018 ) use concepts from model predictive control (MPC) ( Rawlings et al. 2024 ) to provide rigorous safety guarantees. During environment interaction, a model of the environment predicts all possible outcomes of the current action over a finite horizon. The PSF aims to find an action sequence such that constraints are satisfied and adapts the RL action if necessary. Despite recent real-world successes ( Bejarano et al. 2025 ) , PSF methods typically rely on model classes common in MPC literature to predict future outcomes, such as first-principles engineering models ( Bejarano et al. 2025 ) or Gaussian processes (GPs) ( Koller et al. 2018 ) , that either demand substantial prior knowledge or scale poorly with data, limiting the broader applicability of PSFs. In contrast, state-of-the-art model-based reinforcement learning (MBRL) approaches ( Janner et al. 2019 ) rely on Bayesian neural network architectures, such as probabilistic ensembles (PEs) ( Lakshminarayanan et al. 2017 ) , to model high-dimensional, nonlinear dynamics from large datasets with minimal prior knowledge. While PEs hold the potential to extend PSF methods to a substantially broader class of systems, existing approaches that incorporate PEs into PSFs ( Gronauer et al. 2024 ; Güzelkaya et al. 2024 ) lack rigorous uncertainty handling and therefore remain heuristic. Building on recent results in uncertainty propagation for PE models ( Frauenknecht et al. 2025 ) , we present the U ncertainty-Aware P redictive S afety F i lter (UPSi) 1 1 1 pronounced: oop-see , a PSF that makes rigorous predictions of future outcomes using a PE dynamics model. As illustrated in Figure 1(a) , UPSi seamlessly integrates into Dyna-style MBRL frameworks like model-based policy optimization (MBPO) ( Janner et al. 2019 ) . Its formulation of future outcomes as reachable sets, depicted in Figures 1(b) and 1(c) , makes it compatible with a broad range of MPC schemes. UPSi aims to combine the scalability of MBRL methods with the rigor of MPC approaches to enforce exploration safety, in particular \bullet we obtain a rigorous notion of reachable sets from a probabilistic neural network model; \bullet we develop an explicit certainty constraint to avoid model exploitation; and \bullet we evaluate UPSi integrated into MBPO on common safe exploration benchmarks. UPSi yields substantial improvements in exploration safety compared to prior neural network PSFs while achieving comparable performance to standard MBPO. (a) UPSi in Dyna-style MBRL. (b) Safety filtering mechanism. (c) Reachable set construction. Figure 1 : Uncertainty-Aware Predictive Safety Filter (UPSi): (a) UPSi leverages the same PE dynamics model used in state-of-the-art MBRL. (b) UPSi enforces safety by ensuring that predicted reachable sets satisfy constraints \mathbb{S} and remain within accurately modeled regions \mathbb{C} . (c) UPSi accounts for uncertainty accumulation and modeling errors e in reachable sets. 2 Background UPSi builds on basics in RL, dynamics modeling, and PSFs that we introduce below. 2.1 Reinforcement Learning Reinforcement learning (RL) addresses sequential decision-making by having an agent learn through interaction with an environment modeled as a Markov decision process (MDP), \mathcal{M}=\{\mathcal{S},\mathcal{A},r,p,\mathbb{I},\gamma\} . At each step t , the agent applies action A_{t}\in\mathcal{A}\subseteq\mathbb{R}^{n_{\mathcal{A}}} in state S_{t}\in\mathcal{S}\subseteq\mathbb{R}^{n_{\mathcal{S}}} , transitions according to S_{t+1}\sim p(\cdot\mid S_{t},A_{t}) , and receives reward R_{t+1}=r(S_{t},A_{t},S_{t+1}) . Starting from S_{0}\sim\mathbb{I} , the objective is to find a policy A_{t}\sim\pi(\cdot|S_{t}) maximizing the expected return discounted by \gamma , i.e., \max_{\pi}\;\mathbb{E}_{\pi}\!\left[\sum_{t=0}^{\infty}\gamma^{t}R_{t+1}\right]. Where required, we use S_{t} , A_{t} , R_{t} for random variables and s_{t} , a_{t} , r_{t} for their realizations. An episode index j is incremented at each environment reset to \mathbb{I} , such that \mathcal{D}^{j} denotes the replay buffer containing all transitions up to episode j . 2.2 Dynamics Modeling We consider stochastic nonlinear systems with additive heteroscedastic process noise of the form \displaystyle S_{t+1}=\mu(S_{t},A_{t})+L(S_{t},A_{t})W_{t}\text{ with }W_{t}\in\mathbb{W}\text{ and }\mathbb{E}[W_{t}]=0 (1) \displaystyle\text{where }\mathbb{W}=\{w\in\mathbb{R}^{n_{\mathcal{S}}}\mid\|w\|_{2}^{2}\leq\epsilon\}\text{ for }\epsilon\geq 0 with nominal dynamics \mu(S_{t},A_{t}) . The process noise W_{t} is bounded within the hyperball \mathbb{W} and scaled by a diagonal covariance matrix \Sigma(S_{t},A_{t})=L(S_{t},A_{t})^{\top}L(S_{t},A_{t}) . PE models ( Lakshminarayanan et al. 2017 ) approximate the dynamics in ( 1 ) via E probabilistic neural networks with parameters \theta_{e} , where e\in\{1,\dots,E\} . The model state is formulated as \hat{S}_{t+1}=\mu_{\theta_{e}}(S_{t},A_{t})+L_{\theta_{e}}(S_{t},A_{t})\hat{W}_{t}\text{ with }\hat{W}_{t}\sim\mathcal{N}(0,I), (2) which comprises nominal dynamics \mu_{\theta_{e}}(S_{t},A_{t}) and the diagonal covariance \Sigma_{\theta_{e}}(S_{t},A_{t})=L_{\theta_{e}}(S_{t},A_{t})^{\top}L_{\theta_{e}}(S_{t},A_{t}) that scales normally distributed process noise \hat{W}_{t} . The PE separates aleatoric uncertainty, representing irreducible process noise, captured by \Sigma_{\theta_{e}} , from epistemic uncertainty due to lack of data, estimated via ensemble disagreement. Assuming sufficient model capacity, epistemic uncertainty correlates with predictive accuracy ( Frauenknecht et al. 2024 ) , enabling the definition of a certain set \mathbb{C}\subseteq\mathcal{S}\times\mathcal{A} within which predictions closely capture the environment dynamics ( 1 ). We denote the certain set of a PE model trained on data \mathcal{D}^{j} as \mathbb{C}^{j} . 2.3 Predictive Safety Filtering and Model Predictive Control PSFs are closely related to MPC ( Rawlings et al. 2024 ) , where a constrained optimal control problem is solved by planning with a dynamics model over a finite horizon N in a receding fashion. At each time step t , MPC computes a control sequence \mathcal{U}_{t}=[u_{0|t},\dots,u_{N-1|t}] and corresponding predicted state sequence \mathcal{Z}_{t}=[s_{0|t},\dots,s_{N|t}] by solving \mathcal{U}^{*}_{t}=\arg\min_{\mathcal{U}_{t}}J(\mathcal{U}_{t},\mathcal{Z}_{t})\quad\text{s.t.}\quad s_{n|t}\in\mathbb{S},\ u_{n|t}\in\mathbb{A},\ s_{N|t}\in\mathbb{T}, (3) where s_{n|t} denotes the predicted state n steps ahead from time t , \mathbb{S}\subseteq\mathcal{S} and \mathbb{A}\subseteq\mathcal{A} are the state and input constraint sets, and \mathbb{T}\subseteq\mathbb{S} is a terminal set within which the system can be stabilized indefinitely, providing infinite-horizon stability guarantees from finite-horizon predictions. PSFs are a special case of MPC where the objective is solely the distance to the RL action, such that J(\mathcal{U}_{t},\mathcal{Z}_{t})=\|a_{t}-u_{0|t}\|_{2} and u_{0|t} only deviates from a_{t} if necessary to satisfy the constraints in ( 3 ). The first PSF input a^{\mathrm{F}}_{t}=u^{*}_{0|t} is applied as a filtered action, and problem ( 3 ) is re-solved upon observing s_{t+1} . Robust MPC addresses systems such as ( 1 ), where the bounded process noise introduces ambiguity. Thus, a control sequence yields a sequence of robustly reachable sets (RRS) as per Definition 1 . Definition 1 (Robust Reachable Set) . Let \mathcal{R}_{n|t}(s_{t},u_{0|t},\dots,u_{n-1|t}):\mathcal{S}\times\mathcal{A}^{n}\rightarrow\mathcal{S} for n\in[1,\dots,N]