Multistep Belief Space Dynamics Learning For Risk-Aware Control

Jason Gibson, Bogdan Vlahov, Patrick Spieler, Evangelos A. Theodorou · 2026

Read Multistep Belief Space Dynamics Learning For Risk-Aware Control by Jason Gibson, Bogdan Vlahov, Patrick Spieler, Evangelos A. Theodorou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12628.txt.

Introduction

Gibson and three colleagues learn how uncertainty evolves for risk-aware vehicle control. As self-driving vehicles move from research to real use, the gap between human and autonomous driving behaviour matters. Predicting how uncertainty unfolds over time, without being overly cautious, has blocked risk-aware planning. Their framework learns distributional dynamics that can be optimised in real time for model predictive control. Ablations on large off-road driving data show the value of the structure, and the model runs on a full-size vehicle.

Catalog record

CREATORJason Gibson, Bogdan Vlahov, Patrick Spieler, Evangelos A. Theodorou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98341
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12628

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multistep Belief Space Dynamics Learning For Risk-Aware Control Jason Gibson, Bogdan Vlahov, Patrick Spieler, Evangelos A. Theodorou Abstract As autonomous vehicles move from a simplified research setting to practical use, there exists a large gap between the dynamic behavior of a human driving and an autonomous system. Risk-aware behavior needs to naturally develop in order to scale to the demands of the real world. A major issue for risk-aware planning and control has been predicting how dynamical uncertainty evolves through time and optimizing plans that account for this without being overly conservative. Here, we present a learning framework to predict distributional dynamics that can be optimized in real time for MPC ( MPC ). We explore the importance of structure when learning distributional dynamics for use in MPC . A rigorous ablation study is conducted on a large dataset of real world off-road driving that shows the impact of deviations from our proposed structure. Furthermore, we deploy our learned model and planning stack on a full sized vehicle in challenging off-road conditions. Our planning architecture is able to naturally regulate the speed of the vehicle based on the environment and consistently demonstrates intelligent behavior over miles of diverse terrain. Video ADMM Alternating Direction Method of Multipliers AR AutoRally CAN Control Area Network CEM Cross-Entropy Method CNN Convolutional Neural Network ConvLSTM Convolutional Long Short Term Memory CS Covariance Steering CVaR Conditional Value-at-Risk DARPA Defense Advanced Research Projects Agency DDP Differential Dynamic Programming EKF Extended Kalman Filter UKF Unscented Kalman Filter EM Expectation Maximization ES Evolutionary Strategies FNN Feedforward Neural Network GMM Gaussian Mixture Model GP Gaussian Process GRU Gated Recurrent Unit GPR Gaussian Process Regression FT Fourier Transform iCEM improved Cross-Entropy Method iFFT inverse Fast Fourier Transform I-LSTM Initialized LSTM IS Importance Sampler KL Kullback Leibler LSTM Long Short-term Memory MBRL Model-Based Reinforcement Learning MC Monte-Carlo MCS Monte-Carlo Samples MOO Multi-Objective Optimization MPC Model Predictive Control MPPI Model Predictive Path Integral MSE Mean Squared Error NLL Negative Log-Likelihood NLN Normal Log-Normal NN Neural Network PC Polynomial Chaos PCA Principle Component Analysis PDF Probability Density Function PSD Power Spectral Density RCNN Region-based Convolutional Neural Network RL Reinforcement Learning RNN Recurrent Neural Network RPN Region Proposal Network SQP Sequential Quadratic Programming VaR Value-at-Risk YOLO You Only Look Once I Introduction Autonomous navigation has been studied extensively in recent years, but most of the work has been devoted to structured environments like on-road autonomous driving [ 27 ] . These structured environments are easy to setup experimentally and can have complicated interaction, but most of the testing in research settings lack the diversity of the real world environment. These issues only increase in complexity when comparing closed-loop performance for these tasks [ 7 ] . Similar issues impact research for off-road driving. Typically, planning and controls systems are tested repeatedly on the same small courses. This can cause algorithms that perform well in these semi-structured environments but may not necessarily translate to the greater variance presented in the real world. Our autonomous agents must be robust to disturbances and perturbations of the environment and should not fail under slight variations [ 6 ] . Fig. 1: Architecture of uncertainty propagation and risk measure computation for Model Predictive Path Integral (MPPI). A Gaussian distribution is propagated through time using both parametric and neural network components. The cost of a trajectory is calculated using a risk measure computed on the empirical distribution of costs generated from sampling using the unscented transform. Our focus is on autonomous off-road driving at high speeds in varied terrain for miles at a time. The environment in which our vehicle operates is diverse, unstructured, and unable to be reproduced in a small-scale test. We want to develop autonomous agents that are able to adapt their behavior to a wide variety of new environments and conditions. Parts of the navigation will be trivial while others will be extremely difficult. We want a system that can adapt between these levels of difficulty and automatically make an informed decision about its trajectory and speed. We focus on an application of navigation to a given GPS waypoint where no prior map exists, which can often be the case during rescue operations or in unmapped areas. Incorporating additional pre-planning is orthogonal to this work and would integrate with our framework as a higher-level planner that would guide our system. This is a domain that will have an outsized impact on disaster response, agricultural, mining, and extraterrestrial exploration, among others [ 18 ] . Fundamentally, off-road autonomous driving is a great application for the development of planning architectures and algorithms because the vehicle cannot avoid the complexity of the real world. Off-road autonomous driving encompasses difficult perceptual problems and cascading errors of that perceptual system must be handled gracefully in the planning stack. Only algorithms that can operate well under a wide variety of conditions can navigate miles of off-road terrain successfully without failure. Our work builds on substantial prior work on autonomous planning and control in the off-road driving space [ 38 , 14 , 12 , 41 , 17 ] . The focus is on the trajectory optimization problem for a fixed horizon and with a learned, uncertainty-aware representation for the dynamics. The standard approach is to formulate this as a trajectory optimization task, and the literature is dominated by sampling-based approaches like MPPI ( MPPI ) [ 46 ] . This is because of the nonlinearity of the off-road dynamics, but mostly the discontinuous or multimodal nature of the cost functions. Sampling-based methods often perform well in challenging tasks, provided that there are sufficient samples to optimize with. The advent of GPUs has made this possible for many vehicles [ 42 ] . Unfortunately, these methods can struggle with being overly aggressive, but we use uncertainty to mitigate this issue. We believe that uncertainty-aware planning is the key to generalization of planning and control. Uncertainty allows the system to make an informed decision and trade off risk and speed in an intelligent manner. This behavior is similar to a human driving in a challenging off-road environment would drive quickly or even aggressively in open areas, while driving slowly and precisely in constrained ones [ 29 ] . Exactly how the driver modulates their speed occurs naturally as a function of the environment and vehicle. Planning and control architectures must be able to replicate this behavior in novel configurations without arduous tuning and heuristics. A core part of being able to optimize with uncertainty in mind is the ability to propagate well calibrated uncertainty through time. We combine parametric and learned approaches to learn the dynamics of the vehicle in a hybrid architecture that is distributional. Parametric approaches focus on using known physics-based equations and tend to generalize well in low data regimes. Unfortunately, they also tend to overly simplify and give poor results for complex interactions. Pure learning approaches tend to outperform parametric approaches for in-distribution data, but can fail when exposed to novel inputs. Hybrid approaches combine the two approaches and will be the focus of this work. They tend to also improve performance computationally since a smaller learned model is needed. Furthermore, dynamics modeling for use in control provides additional complications when

Read the complete text