Iterative Learning Predictive Control for Constrained Uncertain Systems

Riccardo Zuliani, Efe C. Balta, Alisa Rupenyan, John Lygeros · 2025

Read Iterative Learning Predictive Control for Constrained Uncertain Systems by Riccardo Zuliani, Efe C. Balta, Alisa Rupenyan, John Lygeros (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19446.txt.

Introduction

Systems that repeat the same task can learn from past trials while staying safe, Riccardo Zuliani and co-authors show in a 2025 paper. Iterative learning control improves a repetitive system by learning from earlier runs. It can be joined with model predictive control to handle disturbances that do not repeat, yet prior work assumed perfect model knowledge or failed to learn uncertainty, which led to conservative behavior.

The proposed scheme mixes a binary mixed-integer learning part with a convex predictive part. It is designed for uncertain nonlinear systems with bounded stochastic noise and uncertain additive parts. The scheme ensures robust constraint satisfaction, a non-increasing nominal cost, and convergence to optimal performance. A simulation showcases the benefits.

Catalog record

CREATORRiccardo Zuliani, Efe C. Balta, Alisa Rupenyan, John Lygeros
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-19446

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Iterative Learning Predictive Control for Constrained Uncertain Systems Riccardo Zuliani, Efe C. Balta, Alisa Rupenyan, John Lygeros Abstract Iterative learning control (ILC) improves the performance of a repetitive system by learning from previous trials. ILC can be combined with Model Predictive Control (MPC) to mitigate non-repetitive disturbances, thus improving overall system performance. However, existing approaches either assume perfect model knowledge or fail to actively learn system uncertainties, leading to conservativeness. To address these limitations we propose a binary mixed-integer ILC scheme, combined with a convex MPC scheme, that ensures robust constraint satisfaction, non-increasing nominal cost, and convergence to optimal performance. Our scheme is designed for uncertain nonlinear systems subject to both bounded additive stochastic noise and additive uncertain components. We showcase the benefits of our scheme in simulation. I Introduction Iterative learning control (ILC) is an established control technique for repetitive systems that utilizes information from previous iterations to improve control performance [ 1 ] . Since the entire time sequence from previous iterations is available at the time of the input update, ILC can achieve perfect tracking even with little a-priori knowledge of the system [ 2 ] . Recently, research has focused on optimization based ILC , which explicitly considers input and state constraints by formulating the update as an optimization problem [ 3 , 4 ] . Generally, however, optimization-based schemes lack guarantees of constraint satisfaction in the presence of noise and/or model uncertainty. One notable exception is [ 5 ] , where the authors popose a forward-backward splitting algorithm and use constraint tightening to guarantee robust constraint satisfaction in the presence of uncertainty. Similar settings have been extended to online ILC methods [ 6 ] and to iteration varying systems [ 7 ] . Despite being robust to uncertainties, these approaches do not counteract nonrepetitive disturbances nor learn the unknown components, which introduces conservatism. Active learning can improve the performance of optimization-based schemes in settings with model uncertainty and hard input and state constraints by reducing the constraint tightening as the uncertainty diminishes. Active learning is common in Model Predictive Control (MPC) [ 8 , 9 ] . In this work, we seek to combine ILC and MPC to obtain a scheme that learns an unknown component of the system dynamics and reduces conservativeness as much as possible. Active learning has been considered in the field of adaptive ILC. For example, [ 10 ] combines ILC with recursive least squares estimation to learn an unknown parameter describing a nonlinear system. [ 11 ] can operate in a fully model-free setting by using data to learn the partial derivatives of the functions mapping inputs to outputs. Both these methods, however, don’t consider input or state constraints. Our paper is not the first example of combination of ILC and MPC, this is indeed a well-established area of research (see [ 12 ] for a comprehensive review). For example, the scheme in [ 13 ] performs a norm-optimal ILC update at each time-step in a shrinking horizon fashion, where measurements from the ongoing iteration improve robustness towards non-repetitive disturbances, and information from past iterations is used to compensate repetitive disturbances. The convergence properties of this scheme presented in [ 14 ] , however, require no model uncertainty and no iteration-varying disturbances. The method in [ 13 ] has recently been applied to the problem of controlling the temperature of an additive manufacturing machine in [ 15 ] . In [ 16 ] , ILC is combined with MPC to control an artificial pancreatic cell, without theoretical guarantees. The authors of [ 17 ] propose a learning, reference-free MPC that uses hystorical data to iteratively construct a set of states from which the control task can be completed using a known safe control policy. At the same time, the scheme approximately builds a value function that maps each visited state to the closed-loop cost for completing the task. The approach converges to an optimal trajectory while retaining recursive feasibility and constantly improving the closed-loop performance. More recently, [ 18 ] proposed an ILC scheme that iteratively tightens the constraints of an MPC scheme to incentivise safety, but without providing guarantees. All aformentioned methods, however, assume perfect model knowledge or lack active learning, resulting in unnecessary conservativeness. On the other hand, MPC has been coupled with adaptive control techniques to obtain schemes that simultaneously performs closed-loop identification and regulation of constrained linear systems subject to parametric and additive uncertainty [ 19 , 20 ] . These schemes are often implemented with set-membership identification techniques [ 21 ] , providing both a nominal model of the plant as well as a quantification of the residual uncertainty, ususally in the form of an uncertainty set. Generally, constraints are guaranteed to be satisfied for all possible uncertainty realizations inside the uncertainty set, and the uncertainty set is reduced as new observations of states and inputs become available [ 22 , 23 ] . The uncertainty set should contains all admissible models that are consistent with the measurements, and can then be exploited for robust control design. Contribution In this paper we adapt the idea of set-membership identification to the iterative setting by establishing an ILC scheme that actively learns an uncertain, state-dependent component while ensuring robust constraint satisfaction of state and input constraints. The uncertainty set is used to tighten the constraints, and as the set shrinks in size, both the tightening and the conservativeness are reduced. We consider uncertain nonlinear systems subject to both state-dependent additive disturbances and bounded stochastic additive noise. The ILC scheme is combined with an MPC scheme operating in receding horizon in each iteration. The MPC optimizes online a nominal state prediction as well as a sequence of tubes which are guaranteed to contain the true state of the system. The size of the tubes grows as the state prediction deviates from past observed trajectories. Asymptotically, the state trajectory is shown to converge to a neighborhood of the desired reference. At the beginning of every iteration, the ILC update is formulated as a mixed binary integer program where the number of binary variables is equal to the number of time-steps considered in the optimization. The MPC problem is convex and can be solved efficiently online at each time-step with shrinking prediction horizon. The scheme is recursively feasible and with a non-increasing nominal iteration cost. In addition, we show that the scheme converges to the same solution as a scheme with perfect model knowledge. Theoretical results are also validated in simulation. Outline The remainder of this paper is structured as follows: in Section II we introduce the problem, in Section III we propose a tractable reformulation. Section IV describes the control scheme, whose properties are later analyzed in Section V . In Section VII we present the simulation results. Notation We denote with \mathbb{Z},\mathbb{N},\mathbb{N}_{>0} the set of integers, non-negative integers, and positive integers, respectively. We denote with \mathbb{Z}_{[i,j]} the set of integers between i and j , with i,j\in\mathbb{Z} , i\leq j , i.e., \mathbb{Z}_{[i,j]}=\{n\in\mathbb{Z}:i\leq n\leq j\} . We denote with \mathbb{R},\mathbb{R}^{n},\mathbb{R}^{n\times m} the set of real numbers, the set of real-valued n -dimensional vectors, and the set of n\times m real-valued matrices, respectively, with n,m\in\mathbb{N}_{>0} . \|\cdot\| denotes the

Read the complete text