Learning-Based Model Predictive Control for Piecewise Affine Systems with Feasibility Guarantees

Samuel Mallick, Azita Dabiri, Bart De Schutter · 2024

Read Learning-Based Model Predictive Control for Piecewise Affine Systems with Feasibility Guarantees by Samuel Mallick, Azita Dabiri, Bart De Schutter (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00490.txt.

Introduction

Model predictive control steers a system by solving an optimization problem at every step, but for systems that switch between modes the problem can grow too heavy to solve live. Samuel Mallick, Azita Dabiri, and Bart De Schutter split the work in 2024: a policy learned offline picks the sequence of modes, leaving a smaller problem online. Fully offline control, by contrast, can demand huge memory.

A checkable condition during learning guarantees the learned policy always leaves a valid control move available online. Training data are generated in rounds so the policy improves where it matters, cutting offline effort. A numerical test showed the hybrid beat both full online solving and fully precomputed control. The authors aim at switched systems in vehicles and process plants.

Catalog record

CREATORSamuel Mallick, Azita Dabiri, Bart De Schutter
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-00490

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning-Based Model Predictive Control for Piecewise Affine Systems with Feasibility Guarantees Samuel Mallick, Azita Dabiri, Bart De Schutter Abstract Online model predictive control (MPC) for piecewise affine (PWA) systems requires the online solution to an optimization problem that implicitly optimizes over the switching sequence of PWA regions, for which the computational burden can be prohibitive. Alternatively, the computation can be moved offline using explicit MPC; however, the online memory requirements and the offline computation can then become excessive. In this work we propose a solution in between online and explicit MPC, addressing the above issues by partially dividing the computation between online and offline. To solve the underlying MPC problem, a policy, learned offline, specifies the sequence of PWA regions that the dynamics must follow, thus reducing the complexity of the remaining optimization problem that solves over only the continuous states and control inputs. We provide a condition, verifiable during learning, that guarantees feasibility of the learned policy’s output, such that an optimal continuous control input can always be found online. Furthermore, a method for iteratively generating training data offline allows the feasible policy to be learned efficiently, reducing the offline computational burden. A numerical experiment demonstrates the effectiveness of the method compared to both online and explicit MPC. I INTRODUCTION Traditional online model predictive control (MPC) for piecewise affine (PWA) systems requires the online solution to an optimization problem that optimizes over, not only the continuous states and control actions, but also implicitly over the sequence of PWA regions. Through the introduction of auxiliary variables this problem can be reformulated as a mixed-integer linear/quadratic program (MILP/MIQP) [ 1 ] . Unfortunately, MILP/MIQPs are NP-hard problems, and in the context of MPC the computational burden can grow exponentially with the size of the system and the length of the prediction horizon [ 2 ] , often limiting a real-time implementation. Explicit MPC methodology has been proposed to address this issue, shifting the computational burden offline [ 3 ] . Here, a multiparametric MILP/MIQP (mp-MILP/MIQP) is solved offline, characterizing the optimal control input as a function of the system state. This solution takes the form of a partition of the state space, with a PWA control law associated to each region of the partition, such that the online computation reduces to a lookup table and a function evaluation. However, the computational complexity of the mp-MILP/MIQP is such that this approach is in general limited to small-scale systems. Furthermore, the solution’s partition can be exceedingly complex, requiring significant online memory space to store the regions. As an alternative to offline MPC, machine learning methods have been employed to address the computational burden of mixed-integer-based MPC. In [ 4 ] a learned policy provides warm-start guesses for an MIQP solver, in order to decrease the required solution time; however, in the worst case the computational burden remains exponential in the problem size. In [ 5 , 6 , 7 , 8 ] a policy is learned that selects and fixes the configuration of integer variables prior to solving the MPC optimization problem, which is then convex, and far less demanding to solve. However, these approaches do not guarantee that the remaining optimization problem is feasible after the integer variables are chosen. In light of the above issues, this work presents a learning-based MPC controller for PWA systems in which the feasibility of the learned policy’s output is guaranteed. We propose an approach that follows the principle of [ 5 , 6 , 7 , 8 ] in decoupling the selection of discrete components, i.e., the sequence of PWA regions, and the continuous components, i.e., the state and control input trajectories, into a learned policy and a linear MPC optimization problem, respectively. Leveraging the properties of PWA dynamics, we formulate a class of classifiers whose output can be verified for feasibility during learning. Furthermore, we introduce an iterative procedure for generating training data such that the feasible policy is learned efficiently. The contributions of this work are as follows. As only a linear MPC problem is solved online, relative to the original online MPC problem the proposed approach has a much lower online computational burden. Furthermore, the online memory requirement for the learned policy is significantly less than that of offline MPC, as learning the sequence of PWA regions is less complex than learning the optimal control signal. Finally, in contrast to existing approaches, the learned policy provably selects a feasible output. The remainder of this paper is organized as follows. In Section II the problem setting is defined. In Section III useful structural properties of the MPC optimization problem are provided. Section IV introduces our proposed controller, which is then demonstrated in a numerical example in Section V . Finally, Section VI concludes the paper. I-A Definitions We define a polytope as the intersection of a finite number of (open or closed) halfspaces, which is then convex. A collection of sets P_{1},\dots,P_{l} forms a partition of the set P if \bigcup_{i=1}^{l}P_{i}=P , P_{i}\neq\emptyset for all i , and P_{i}\cap P_{j}=\emptyset for all i\neq j . If each set P_{i} is a polytope they form a convex partition of P . For a set \mathcal{X} we denote its convex hull as \text{Conv}(\mathcal{X}) , and its closure as \bar{\mathcal{X}} . The set of vertices of a polytope P is denoted as \text{Vert}(P) . Finally, indexing via subscripts represents closed-loop time steps, e.g., x_{k} , while brackets represent time steps within an MPC prediction horizon, e.g., x(k) . II PROBLEM SETTING Consider the discrete-time PWA system with state x\in\mathcal{X}\subseteq\mathbb{R}^{n} , input u\in\mathcal{U}\subseteq\mathbb{R}^{m} , and affine dynamics over a convex partition \{P_{i}\}_{i=1}^{l} of \mathcal{X} with l polytopes indexed by i\in\mathcal{L}=\{1,\dots,l\} , referred to as regions, x(k+1)=A_{i}x(k)+Bu(k)+c_{i},\>x(k)\in P_{i}. (1) The states and inputs are constrained to the sets \mathcal{X} and \mathcal{U} , respectively. Assumption 1 . The dynamics are assumed to be continuous, i.e., A_{i}x+Bu+c_{i}=A_{j}x+Bu+c_{j} for all x\in\bar{P}_{i}\cap\bar{P}_{j} , such that the dynamics can be considered over the closures \{\bar{P}_{i}\}_{i\in\mathcal{L}} without the need for a set-valued function. The sets \mathcal{X} and \mathcal{U} are assumed to be compact polytopes with the origin in their interior. There exists a terminal set \mathcal{X}_{\text{f}}\subseteq\mathcal{X} that is a polytope, assumed to contain the origin in its interior, and to be positive invariant under some linear control laws, i.e., there exists K_{i}\in\mathcal{R}^{m\times n} , for all i such that P_{i}\cap\mathcal{X}_{\text{f}}\neq\emptyset , such that (A_{i}+BK_{i})x\in\mathcal{X}_{\text{f}} for all x\in P_{i}\cap\mathcal{X}_{\text{f}} . We consider an MPC controller for the system ( 1 ). Define \bm{\delta}=\big(\delta(0),\dots,\delta(N)\big)\in\mathbb{Z}_{[0,l]}^{N+1} as a switching sequence that specifies the PWA regions over a prediction horizon of N . The control input at state x is then computed via the following optimization problem: \displaystyle J(x)= \displaystyle\min_{\mathbf{x},\mathbf{u},\bm{\delta}}\>J(\mathbf{x},\mathbf{u}) (2a) s.t. \displaystyle x(0)=x, (2b) \displaystyle x(k+1)=A_{\delta(k)}x(k)+Bu(k)+c_{\delta(k)} (2c) \displaystyle\quad\text{for}\>k=0,\dots,N-1, \displaystyle x(k)\in\bar{P}_{\delta(k)}\>\>\text{for}\>\>k=0,\dots,N, (2d) \displaystyle\big(x(k),u(k)\big)\in\mathcal{X}\times\mathcal{U}\>\>\text{for}\>\>k=0,\dots,N-1, (2e) \displaystyle x(N)\in\mathcal{X}_{\text{f}}, (2f) where \mathbf{x}=\big(x^{\top}(0),\dots,x^{\top}(N)\big)^{\top} and \mathbf{u}=\big(u^{\top}(0),\dots,u^{\top}(N-1)\big)^{\top} . In ( 2d ) the closure \bar{P}_{\delta(k)} can be used as the dynamics are continuous. If no solution exists for problem ( 2 ), by convention J(x)=\infty . Define the set of feasible states \mathcal{X}_{0}=\big\{x|J(x)<\infty\big\} . Once ( 2 ) is solved online numerically, the first of the optimal control inputs u^{\ast}(0) is applied to the system, with the problem resolved again at each time step in

Read the complete text