Learning for Layered Safety-Critical Control with Predictive Control Barrier Functions

William D. Compton, Max H. Cohen, Aaron D. Ames · 2024

Read Learning for Layered Safety-Critical Control with Predictive Control Barrier Functions by William D. Compton, Max H. Cohen, Aaron D. Ames (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04658.txt.

Introduction

William Compton, Max Cohen, and Aaron Ames teach safety filters to see around the gap between simple and full robot models, in a 2024 paper. Control barrier functions keep machines inside safe bounds, but they are far easier to build for a reduced model than for the real machine. Enforcing the simple model's safety on the full one can break it.

Their predictive barrier checks rollouts of the full model and adds a learned cushion to the safety condition. Proof shows the layered setup stays safe. The cushion is learned in massive parallel simulation with randomized conditions. A hopping robot ran the method in hardware, staying safe without needless caution.

Catalog record

CREATORWilliam D. Compton, Max H. Cohen, Aaron D. Ames
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-04658

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning for Layered Safety-Critical Control with Predictive Control Barrier Functions William D. Compton, Max H. Cohen, Aaron D. Ames Abstract Safety filters leveraging control barrier functions (CBFs) are highly effective for enforcing safe behavior on complex systems. It is often easier to synthesize CBFs for a Reduced order Model (RoM), and track the resulting safe behavior on the Full order Model (FoM)—yet gaps between the RoM and FoM can result in safety violations. This paper introduces predictive CBFs to address this gap by leveraging rollouts of the FoM to define a predictive robustness term added to the RoM CBF condition. Theoretically, we prove that this guarantees safety in a layered control implementation. Practically, we learn the predictive robustness term through massive parallel simulation with domain randomization. We demonstrate in simulation that this yields safe FoM behavior with minimal conservatism, and experimentally realize predictive CBFs on a 3D hopping robot. \SetAlgoLined \coltauthor Caltech, Pasadena, CA, USA keywords safety, control barrier functions, reduced order models, supervised learning 1 Introduction Safety is a primary concern in the construction of modern control architectures. Control Barrier Functions (CBFs) provide a theoretically grounded method for achieving safe behaviors of complex nonlinear systems ( Ames et al., 2014 ) . CBFs have several desirable properties, including nominal robustness properties ( Xu et al., 2015 ) and the ability to filter desired system inputs for safety (safety filtering) ( Ames et al., 2016 ; Ames et al., 2019 ) . These benefits have established CBFs and safety filters as practical tools, commonly used in collision avoidance, and other applications, on various robotic systems ( Wabersich et al., 2023 ) . Yet synthesizing CBFs for arbitrary (often even simple) safety constraints is difficult and impractical for high-dimensional or complex nonlinear systems. Significant prior work exists surrounding constructive methods for CBF synthesis, leveraging different system properties, such as relative degree ( Nguyen and Sreenath, 2016 ) , differential flatness ( Wang et al., 2017 ) , HJ reachability ( Tonkens and Herbert, 2022 ) , backup controllers ( Chen et al., 2021b ) , or learning ( Robey et al., 2020 ) . However, complex systems often will not satisfy required assumptions, and high dimensionality cripples learning or PDE-based methods. Hence, constructive synthesis of CBFs for complex, high-order systems is an open problem ( Cohen et al., 2024b ) . One recent approach to addressing this problem is through layered control architectures ( Matni et al., 2024 ) , which leverage reduced order models in conjunction with existing controllers lower in the control stack. Often, safety constraints depend on a subset of system states; for instance, collisional avoidance problems typically only depend on kinematic configuration, and safety requirements for mobile robots often concern their center of mass positions. A reduced order model (RoM) approximates the dynamics of the full order model (FoM) while capturing all of the states relevant for safety. CBF synthesis can then be carried out on the RoM, and resulting behaviors can be tracked by a tracking controller on the FoM. Under various assumptions regarding the tracking controller, e.g., exponential tracking ( Molnar et al., 2022 ; Singletary et al., 2022 ) or the existence of a simulation function ( Cohen et al., 2024a ) , safety can be extended to the FoM from a reduced set of initial conditions. Yet certifying the assumptions on the tracking controller is, in itself, a hard problem—and calculating the corresponding certificates is even more challenging. In practice, terms in the resulting safety filters are conservatively approximated to achieve safety empirically. The use of RoMs to construct CBFs for safety parallels the planner-tracker paradigm, where trajectories are optimized over a RoM and then tracked by a tracking controller on the FoM. Methods in this framework focus primarily on establishing tracking error bounds, through HJ Reachability ( Mitchell et al., 2005 ) , sum of squares programming ( Schweidel et al., 2022 ) , or contraction theory ( Singh et al., 2023 ) . Once a tracking error bound has been established, tools from tube MPC ( Langson et al., 2004 ; Compton et al., 2024 ) or search-based planning ( Chen et al., 2021a ) can be used to construct safe trajectories of the FoM. As these certification problems scale poorly with system complexity and dimensionality, we focus instead on leveraging the simplicity of the layered CBF paradigm with RoMs coupled with the power of a predictive horizon to achieve safety on the FoM. Figure 1: First, a CBF is synthesized on a RoM; tracking errors from the FoM can lead to unsafe behavior. We learn a structured robustification term \delta(\mathbf{x}) from massively parallel simulation, and deploy the robustified CBF on hardware to obtain safe behaviors. 1.1 Our Contribution: Rather than relying upon restrictive and difficult-to-verify tracking assumptions that induce conservative behavior, we learn a robustification of the CBF synthesized on the RoM to remove safety violations over a horizon-based rollout. This robustification term, guaranteed to exist under mild assumptions on tracking error, is conditioned on the FoM state. When added to the RoM safety filter, it induces a minimal constraint back-off to ensure safety of the FoM. We both formally establish guarantees of safety, and leverage massively parallel simulation to learn this term with high accuracy. We demonstrate our method outperforming previous methods using RoMs for layered safety filtering by attaining safety under conditions where previous methods fail (due to violation of their underlying assumptions), or expanding the safe set when previous methods were successful. Finally, we demonstrate our method on a complex robotic system, a 3D hopping robot ARCHER, achieving safe navigation of cluttered environments on hardware. 2 Background We begin by defining a framework for layered control systems consisting of a reduced order model (RoM) and full order model (FoM), interacting through a safety filter (as illustrated in Fig. 2 ). Reduced order Model (RoM) Dynamics: \displaystyle\dot{\mathbf{z}}_{t}=\mathbf{f}(\mathbf{z}_{t})+\mathbf{g}(\mathbf{z}_{t})\mathbf{v}_{t}, Safety: \displaystyle h(\mathbf{z}_{t})\geq 0,\hskip 8.19447pt\forall t\geq 0. Predictive CBF \displaystyle\mathbf{k}_{sf}^{\delta}(\mathbf{z},\mathbf{x})= \displaystyle\operatornamewithlimits{argmin}_{\mathbf{v}\in\mathcal{V}}\hskip 8.19447pt\frac{1}{2}\|\mathbf{v}-\mathbf{k}(\mathbf{z})\|^{2} \displaystyle\mathrm{s.t.}\hskip 8.19447pt \displaystyle\underbrace{\mathcal{L}_{f}h(\mathbf{z})+\mathcal{L}_{g}h(\mathbf{z})\mathbf{v}\geq-\alpha h(\mathbf{z})}_{\textrm{RoM CBF Condition}}+\hskip-2.84544pt\underbrace{\delta(\mathbf{x})}_{\textrm{Learned}} Full order Model (FoM) Dynamics: \displaystyle\dot{\mathbf{x}}_{t}=\mathbf{F}(\mathbf{x}_{t})+\mathbf{G}(\mathbf{x}_{t})\mathbf{K}(\mathbf{x}_{t},\mathbf{v}_{t}), Safety: \displaystyle h(\Pi(\mathbf{x}_{t}))\geq 0,\hskip 8.19447pt\forall t\geq 0. \begin{array}[]{l}\textbf{Top Interface}\\ \mathbf{v}_{t}=\mathbf{k}_{sf}^{\delta}(\mathbf{z}_{t},\mathbf{x}_{t})\end{array} \mathbf{z}_{t} \begin{array}[]{l}\textbf{Bottom Interface}\\ \mathbf{v}_{t}=\mathbf{k}_{sf}^{\delta}(\bm{\Pi}(\mathbf{x}_{t}),\mathbf{x}_{t})\end{array} \mathbf{x}_{t} State Projection: z=\Pi(x) Input Projection: v=\Psi(x) Figure 2: Layered architecture of a RoM and FoM interacting through a Predictive CBF. Full Order Model (FoM): Consider a full order system representing the system of interest—typically these are very complex, high dimensional, and often not known. We assume that the full-order system evolves according to the nonlinear control system: \dot{\mathbf{x}}_{t}=\mathbf{F}(\mathbf{x}_{t})+\mathbf{G}(\mathbf{x}_{t})\mathbf{u}_{t} where \mathbf{F}:\mathcal{X}\to\mathbb{R}^{N} and \mathbf{G}:\mathcal{X}\to\mathbb{R}^{N}\times\mathbb{R}^{M} are possibly unknown (but can be simulated), and the state \mathbf{x}\in\mathcal{X}\subseteq\mathbb{R}^{N} and input \mathbf{u}\in\mathcal{U}\subseteq\mathbb{R}^{M} typically have high dimension. Reduced Order Model (RoM): Assume there is access to a reduced order model: \displaystyle\dot{\mathbf{z}}_{t}=\mathbf{f}(\mathbf{z}_{t})+\mathbf{g}(\mathbf{z}_{t})\mathbf{v}_{t} (1) with state \mathbf{z}\in\mathcal{Z}\subseteq\mathbb{R}^{n} , input \mathbf{v}\in\mathcal{V}\subset\mathbb{R}^{m} . Coupling between RoM and FOM: The RoM is related to the FoM through a tracking controller—signals are sent from the RoM to the FoM and tracked by an existing (low-level) controller: \mathbf{u}=\mathbf{K}(\mathbf{x},\mathbf{v}) . The result is the partially closed-loop full-order dynamics: \displaystyle\dot{\mathbf{x}}_{t}=\mathbf{F}_{\mathrm{cl}}(\mathbf{x}_{t},\mathbf{v}_{t}):=\mathbf{F}(\mathbf{x}_{t})+\mathbf{G}(\mathbf{x}_{t})\mathbf{K}(\mathbf{x}_{t},\mathbf{v}_{t}) (2) The RoM is related to the FoM through a projection map: \bm{\Pi}:\mathcal{X}\to\mathcal{Z} . Therefore, given a feedback controller for the RoM, \mathbf{v}=\mathbf{k}(\mathbf{z}) , the result is the closed loop dynamics on the FoM: \displaystyle\dot{\mathbf{x}}_{t}=\mathbf{F}_{\mathrm{cl}}(\mathbf{x}_{t},\mathbf{k}(\bm{\Pi}(\mathbf{x}_{t})))=\mathbf{F}(\mathbf{x}_{t})+\mathbf{G}(\mathbf{x}_{t})\mathbf{K}(\mathbf{x}_{t},\mathbf{k}(\bm{\Pi}(\mathbf{x}_{t}))) (3) We are

Read the complete text