Bridging Model Predictive Control and Deep Learning for Scalable Reachability Analysis

Zeyuan Feng, Le Qiu, Somil Bansal · 2025

Read Bridging Model Predictive Control and Deep Learning for Scalable Reachability Analysis by Zeyuan Feng, Le Qiu, Somil Bansal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03830.txt.

Introduction

Zeyuan Feng, Le Qiu, and Somil Bansal teach neural networks where a robot can safely go, faster and more stably, in a 2025 paper. Reachability analysis maps the states from which a robot can still avoid danger. The classic solution grinds through a grid and collapses in high dimensions.

Network approximations exist but train badly, since their only teacher is a leftover equation error. The authors instead let model predictive control, a planning method, sketch rough answers at chosen points. The network trains toward those sketches, then its improved answer refines the sketches in turn. Case studies include a two-dimensional drone. The loop promises safety maps for systems too large for grids, with training that converges instead of wandering.

Catalog record

CREATORZeyuan Feng, Le Qiu, Somil Bansal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03830

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Model Predictive Control and Deep Learning for Scalable Reachability Analysis Zeyuan Feng, Le Qiu, Somil Bansal Abstract Hamilton-Jacobi (HJ) reachability analysis is a widely used method for ensuring the safety of robotic systems. Traditional approaches compute reachable sets by numerically solving an HJ Partial Differential Equation (PDE) over a grid, which is computationally prohibitive due to the curse of dimensionality . Recent learning-based methods have sought to address this challenge by approximating reachability solutions using neural networks trained with PDE residual error. However, these approaches often suffer from unstable training dynamics and suboptimal solutions due to the weak learning signal provided by the residual loss. In this work, we propose a novel approach that leverages model predictive control (MPC) techniques to guide and accelerate the reachability learning process. Observing that HJ reachability is inherently rooted in optimal control, we utilize MPC to generate approximate reachability solutions at key collocation points, which are then used to tactically guide the neural network training by ensuring compliance with these approximations. Moreover, we iteratively refine the MPC-generated solutions using the learned reachability solution, mitigating convergence to local optima. Case studies on a 2D vertical drone, a 13D quadrotor, a 7D F1Tenth car, and a 40D publisher-subscriber system demonstrate that bridging MPC with deep learning yields significant improvements in the robustness and accuracy of reachable sets, as well as corresponding safety assurances, compared to existing methods. I Introduction Hamilton-Jacobi (HJ) reachability analysis is one of the most widely used tools for providing formal safety assurances for autonomous systems. It characterizes the unsafe states of the system via Backward Reachable Tube (BRT) – the set of all initial states from which a system failure is inevitable. Thus, the complement of the BRT provides a safe set for the system. Along with the safe set, reachability analysis provides a safety controller for the system that can be used as it is or alongside a nominal (potentially data-driven) controller to maintain safety. In HJ reachability, the BRT computation is framed as an optimal control problem that results in solving a certain Hamilton-Jacobi-Bellman PDE (HJB-PDE) [ 29 , 26 ] . Solving this PDE yields a safety value function that implicitly represents both the BRT and the safety controller. Consequently, a number of methods have been developed to solve the HJB PDE. Traditional methods solve HJB PDE numerically over a grid, which suffers from the so-called “curse of dimensionality” [ 1 ] . Specifically, the computation scales exponentially with the system dimension, making systems of more than 6D intractable. Many techniques for speeding up reachability analysis put restrictions on the type of system allowed and/or assign predefined shapes to the safe set (e.g. ellipsoids, polytopes) [ 8 , 7 , 14 , 19 , 24 , 25 , 11 , 15 ] . However, computing reachable sets for general nonlinear systems remains a challenge. This motivated the recent development of learning-based methods to approximate the HJB-PDE solution [ 30 ] . One line of research leverages Reinforcement Learning (RL) to approximate the safety value function, achieving impressive performance improvements [ 13 , 17 , 18 , 20 ] . Another line of work [ 2 , 34 ] , which this paper aims to enhance, learns value function via self-supervised learning by minimizing the residuals of HJB-PDE. The latter set of approaches, termed DeepReach variants, are rooted in recent advances in Physics-Informed Machine Learning [ 31 , 21 ] and have the theoretical advantage of recovering the exact HJB-PDE solution as the training loss converges to zero [ 16 ] . However, in practice, these methods often converge to suboptimal solutions due to the weak learning signal provided by the residual loss alone. Additionally, as we will demonstrate, this can result in non-physical solutions, where the learned value function significantly deviates from the ground truth, even when training loss appears low. Consequently, these methods exhibit instability and inaccuracies, especially for stiff dynamical systems or problems with complex boundary conditions (i.e., intricate safety specifications). To combat these challenges, [ 32 ] leverages the Hopf formula to generate HJB-VI solutions for linearized dynamics and learns the solution using semi-supervision. However, this method does not synthesize value function labels for the original nonlinear dynamics and relies heavily on the quality of the Hopf solutions. Another method imposes exact safety specification [ 34 ] , but it offers limited improvements, and learning instability for general nonlinear systems remains a key challenge. Fig. 1: We propose a framework that efficiently generates approximate safety value function datasets using a sampling-based MPC approach and integrates these data labels to guide the learning of reachability solutions for high-dimensional autonomous systems. The learned value function is then verified using conformal prediction, providing probabilistic safety assurances for the system under the induced safe policy. To overcome these challenges, we propose a framework that leverages approximate reachability solutions to guide the learning of the safety value function. Our approach is inspired by the success of incorporating data-driven loss terms in Physics-Informed Neural Networks (PINNs) [ 5 ] , which effectively anchors trial solutions at key collocation points alongside PDE residuals, thereby accelerating convergence and guiding learning toward feasible solutions. Specifically, building on the optimal control foundations of HJ reachability, we propose a sampling-based MPC approach to generate approximate solutions for high-dimensional reachability problems. These solutions serve as semi-supervised labels to improve value function learning. Our method is designed to be highly parallelizable on GPUs, allowing for efficient synthesis of large datasets. Moreover, we provide an algorithm to iteratively update the MPC dataset during training using the learned DeepReach policy, progressively improving accuracy and stability of the learned value function. By combining sampling-based MPC with DeepReach-style self-supervised learning, this work integrates the strengths of both approaches – leveraging MPC for efficient and structured dataset generation and DeepReach for reliable safety assurances. To summarize, our overall contributions are: • A novel data-generation approach that efficiently computes approximate HJB-VI solutions using an MPC-based sampling method. • A hybrid training algorithm that balances residual loss with data-driven supervision to improve the convergence of value function learning, while iteratively refining the MPC dataset during training. • Demonstration of the proposed approach on four challenging reachability problems: a 2D vertical drone avoiding ground and ceiling, a 13D quadrotor avoiding a cylindrical obstacle, a 7D F1Tenth car navigating a track, and a 40D publisher-subscriber system, highlighting a significant improvement in accuracy and stability of value function learning. II Preliminaries In this section, we formulate the reachability problem and provide a brief background on HJ reachability. II-A Problem Setup We consider a dynamical system with time-invariant, possibly nonlinear, dynamics: \dot{x}=f(x,u) , where x\in\mathbb{R}^{n} is the state and u\in\mathcal{U}\subset\mathbb{R}^{n_{u}} is the control input. The safety requirement is defined by a Lipschitz-continuous function l:\mathbb{R}^{n}\rightarrow\mathbb{R} , with its sub-zero level set being the failure set, i.e., \mathcal{L}=\{x:l(x)\leq 0\} . For example, in a robotic navigation setting, \mathcal{L} may represent obstacles, while l(x) could be the signed distance function to these obstacles. Our primary goal in this work is to compute the BRT of the system, denoted as \mathcal{B} , which consists of all initial states from which the system will inevitably enter the failure set \mathcal{L} within the time horizon

Read the complete text