Safe adaptive NMPC using ellipsoidal tubes

Johannes Buerger, Mark Cannon · 2025

Read Safe adaptive NMPC using ellipsoidal tubes by Johannes Buerger, Mark Cannon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14670.txt.

Introduction

Johannes Buerger and Mark Cannon design a controller that steers uncertain systems safely while learning about them on the fly. Their setting is model predictive control, where a computer repeatedly plans moves ahead using a model of the system. Here the model is only partly known, built from a mix of known building blocks with unknown weights, plus bounded disturbances.

The method redraws a straight-line approximation of the system around each planned path. Uncertainty from the approximation, model error, and disturbances is wrapped in ellipsoid sets, shaped like stretched spheres, that travel with the plan. A backtracking search keeps every plan workable, and a set-based estimator narrows the unknown weights during runs. Tests show the uncertainty sets grow gently with problem size, and the scheme carries stability guarantees.

Catalog record

CREATORJohannes Buerger, Mark Cannon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14670

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Safe adaptive NMPC using ellipsoidal tubes Johannes Buerger, Mark Cannon Abstract A computationally efficient nonlinear Model Predictive Control (NMPC) algorithm is proposed for safe learning-based control with a system model represented by an incompletely known affine combination of basis functions and subject to additive set-bounded disturbances. The proposed algorithm employs successive linearization around predicted trajectories and accounts for the uncertain components of future states due to linearization, modelling errors and disturbances using ellipsoidal sets centered on the predicted nominal state trajectory. An ellipsoidal tube-based approach ensures satisfaction of constraints on control variables and model states. Feasibility is ensured using local bounds on linearization errors and a procedure based on a backtracking line search. We combine the approach with a set membership parameter estimation strategy in numerical simulations. We show that the ellipsoidal embedding of the predicted uncertainty scales favourably with the problem size. The resulting algorithm is recursively feasible and provides closed-loop stability and performance guarantees. I Introduction Model Predictive Control (MPC) is an optimal control approach with solid theoretical foundations and extensive applications in engineering practice [ 1 ] . In many cases, accurate prediction models can be obtained using physical modelling or black-box estimation methods. However, due to the inherent uncertainty in any system model, provably safe robust and adaptive MPC strategies are a key focus of this research field. There has been significant recent interest in integrating learning-based methods with robust MPC approaches [ 2 ] . Like robust adaptive MPC algorithms, these techniques retain the primary benefits of robust MPC while leveraging information about the controlled system collected during the execution of a control task. Thus they are able to improve the accuracy of the system model and enhance closed-loop control performance. While several methods for robust adaptive linear MPC have been proposed [ 3 , 4 ] , the more general case of robust adaptive NMPC has received comparatively little attention [ 5 , 6 , 7 ] . The approaches of [ 5 ] and [ 6 ] have strong system-theoretical properties, but are computationally intensive because they require the solution of a nonconvex program online. The method presented in [ 7 ] is both theoretically sound and computationally efficient for low-order systems (due to its foundations in convex optimization). However, a key drawback of [ 7 ] is its limited scalability, since the number of optimization variables depends on the number of vertices of polytopic sets describing the predicted state tube cross sections. This paper considers an alternative adaptive NMPC approach based on sequential convex approximations, but considering ellipsoidal tubes to bound the effects of the uncertainty in prediction. In this work we extend the theory of [ 8 ] to the context of systems with additive and parametric uncertainty, and propose a robust adaptive nonlinear model predictive control algorithm based on set membership parameter estimation (SME) [ 7 ] . The resulting algorithm relies on the solution of a second order cone program, which provides a computationally efficient and scalable approach to solve the otherwise challenging robust NMPC problem, as we demonstrate via extensive numerical simulations. To ensure recursive feasibility and closed-loop stability, the perturbations around state and control linearization points are limited to regions where the model approximation is meaningful and the effect of the approximation error is bounded by constructing tubes containing the predicted trajectories. By incorporating a line search procedure into the online algorithm, the approach provides recursive feasibility, constraint satisfaction and performance guarantees, even if just one linearisation iteration is computed at each online time step. Notation: \mathbb{N}_{\geq 0} is the set of non-negative integers, \mathbb{N}_{[p,q]}=\{n\in\mathbb{N}:{p\leq n\leq q}\} , and \mathbb{N}_{q}=\mathbb{N}_{[1,q]} . The i th row of a matrix A is [A]_{i} . For a matrix A , the inequality A\geq 0 applies elementwise, and A\succeq 0 (or A\succ 0 ) indicates that A is positive semidefinite (positive definite). The Euclidean and infinity norms are \|x\| and \|x\|_{\infty} , and \|x\|_{Q}=(x^{\top}Qx)^{1/2} . II Problem statement We consider a nonlinear system with unknown (but learnable) parametric dependency subject to an additive disturbance (caused by model error and physical disturbance inputs) x_{t+1}=f(x_{t},u_{t},\theta)+w_{t}, (1) where (x_{t},u_{t})\in\mathcal{X}\times\mathcal{U} , w_{t}\in\mathcal{W} , \theta\in\Theta_{0} and t is the discrete time index. The state, control and disturbance input, and model parameters belong to bounded polytopic sets: \mathcal{X}=\{x\in\mathbb{R}^{n_{x}}:Ex\leq 1\} , \mathcal{U}=\{u\in\mathbb{R}^{n_{u}}:Gu\leq 1\} , \mathcal{W}=\mathrm{co}\{w^{(r)},\,r\in\mathbb{N}_{\nu_{w}}\} , \Theta_{0}=\{\theta\in\mathbb{R}^{n_{\theta}}:H_{\Theta}\theta\leq h_{0}\}=\mathrm{co}\{\theta^{(q)},\,q\in\mathbb{N}_{\nu_{\theta}}\} . We assume that the system can be represented as an affine combination of known basis functions f_{i}(x,u) , i\in\smash{\mathbb{N}_{n_{\theta}}} , f(x_{t},u_{t},\theta)=f_{0}(x_{t},u_{t})+\sum_{i=1}^{\smash{n_{\theta}}}{\theta_{i}f_{i}(x_{t},u_{t})}. (2) where f_{i} is differentiable and Lipschitz continuous on \mathcal{X}\times\mathcal{U} and f_{i}(0,0)=0 for all i . Our approach can be used with any parameter learning algorithm that provides a polytopic parameter set \Theta_{t} satisfying \theta\in\Theta_{t}\subseteq\Theta_{t-1} for all t>0 . The objective of the control problem is to minimize a quadratic regulation cost (with R\succ 0 , Q\succeq 0 ) defined by \sum_{t=0}^{\infty}(\left\lVert x_{t}\right\rVert^{2}_{Q}+\left\lVert u_{t}\right\rVert^{2}_{R}). (3) To mitigate the effects of model uncertainty on predicted future state and control sequences, we consider the decision variables to be the variations \{v_{t},v_{t+1},\ldots\} relative to a feedback law, u_{t}=Kx_{t}+v_{t}, where the feedback gain K is robustly stabilizing locally around x=0 , in the sense defined in Section VI . To simplify notation, for all (x,v) such that (x,Kx+v)\in\mathcal{X}\times\mathcal{U} let f_{K}(x,v,\theta)=f(x,Kx+v,\theta) and f_{K,i}(x,v)=f_{i}(x,Kx+v) for each i\in\{0,\ldots,p\} . III Linearization error bounds in prediction We consider the Taylor expansion of the model in ( 1 ) around a nominal trajectory \mathbf{x}^{0}=\{\smash{x^{0}_{0}},\ldots,\smash{x^{0}_{N}}\} defined for a given sequence \mathbf{v}^{0}=\{\smash{v^{0}_{0}},\ldots,\smash{v^{0}_{N-1}}\} and parameter \theta^{0}\in\Theta by x^{0}_{k+1}=f_{K}(x_{k}^{0},v^{0}_{k},\theta^{0}),\ k=0,\ldots,N-1. (4) Defining state and control perturbations s_{k} and v_{k} , where x_{k}=x_{k}^{0}+s_{k} and u_{k}=Kx_{k}+v^{0}_{k}+v_{k} , we have x^{0}_{k+1}+s_{k+1}=f_{K}(x^{0}_{k},v^{0}_{k},\theta^{0})+\delta^{0}_{k}+\Phi_{k}s_{k}+B_{k}v_{k}+\delta^{1}_{k}+w_{k} (5) where \Phi_{k}=\nabla_{x}f_{K}(x^{0}_{k},v^{0}_{k},\theta^{0}) and B_{k}=\nabla_{v}f_{K}(x^{0}_{k},v^{0}_{k},\theta^{0}) denote the Jacobian matrices of f_{K} with respect to x and v . The perturbations on the state and control input are constrained to satisfy bounds s_{k}\in\mathcal{S} , v_{k}\in\mathcal{V} for all k\in\mathbb{N}_{[0,N]} , where \mathcal{S} , \mathcal{V} are given polytopic sets containing the origin. The perturbation s_{k} contains both a nominal component (due to the control perturbation v_{k} ) and an uncertain component (due to linearization errors, parameter estimation errors and external disturbances prior to the k th time step of the prediction horizon). In this context we distinguish the zero-order error term \delta^{0} and the first-order error term \delta^{1} resulting respectively from parameter estimation and linearization errors as follows. Definition 1 . The error terms \delta^{0}_{k} and \delta^{1}_{k} in ( 5 ) are defined by \displaystyle\delta^{0}_{k} \displaystyle=f_{K}(x_{k}^{0},v^{0}_{k},\theta)-f_{K}(x_{k}^{0},v^{0}_{k},\theta^{0}) \displaystyle\delta^{1}_{k} \displaystyle=f_{K}(x_{k}^{0}+s_{k},v^{0}_{k}+v_{k},\theta)-f_{K}(x_{k}^{0},v^{0}_{k},\theta)-\Phi_{k}s_{k}\!-\!B_{k}v_{k} Bounds on \delta^{0}_{k} are derived from the affine dependence on \theta : \delta^{0}_{k}=f_{K}(x^{0}_{k},v^{0}_{k},{\theta})-f_{K}(x^{0}_{k},v^{0}_{k},\theta^{0})=f_{K}(x^{0}_{k},v^{0}_{k},\theta-\theta^{0}), which implies a polytopic additive disturbance bound: \delta^{0}_{k}\in\mathcal{W}^{0}_{k}=\mathcal{W}^{0}(x^{0}_{k},v^{0}_{k},\theta^{0},\Theta)=\mathrm{co}\{\delta^{0\,(q)}_{k},\,q\in\mathbb{N}_{\nu_{\theta}}\}. (6) A tight bound can be obtained by elementwise maximization over \theta\in\Theta . This set can be recomputed online (based on the current trajectory and parameter estimation set) or can be computed as an offline, global bound. Bounds on \delta^{1}_{k} can similarly be derived using Definition 1 . The mean value theorem implies, for some (s,v)\in\mathcal{S}\times\mathcal{V} , \displaystyle\delta^{1}_{k} \displaystyle=\bigl(\nabla_{x}f_{K}(x^{0}_{k}+s,v^{0}_{k}+v,{\theta})-\Phi_{k}\bigr)s_{k} \displaystyle\quad+\bigl(\nabla_{v}f_{K}(x^{0}_{k}+s,v^{0}_{k}+v,{\theta})-B_{k}\bigr)v_{k}. (7) A corresponding polytopic uncertainty set can be defined \displaystyle\delta^{1}_{k}\in\mathcal{W}^{1}_{k} \displaystyle=\mathcal{W}^{1}(x^{0}_{k},v^{0}_{k},\theta^{0},\mathcal{S},\mathcal{V},\Theta) \displaystyle\quad=\mathrm{co}\{C^{(j)}_{k}s_{k}+D^{(j)}_{k}v_{k},\,j\in\mathbb{N}_{\nu_{1}}\} (8) where \{C^{(j)}_{k},D^{(j)}_{k},\,j\in\mathbb{N}_{\nu_{1}}\} are determined, for example, by computing componentwise bounds on the Jacobian matrices in ( 7 ) over s\in\mathcal{S} , v\in\mathcal{V} , \theta\in\Theta . This set can be recomputed online using the current nominal trajectory and estimated parameter set or computed offline as

Read the complete text