Choose Wisely: Data-driven Predictive Control for Nonlinear Systems Using Online Data Selection

Joshua Näf, Keith Moffat, Jaap Eising, Florian Dörfler · 2025

Read Choose Wisely: Data-driven Predictive Control for Nonlinear Systems Using Online Data Selection by Joshua Näf, Keith Moffat, Jaap Eising, Florian Dörfler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18845.txt.

Introduction

Joshua Näf, Keith Moffat, Jaap Eising, and Florian Dörfler control nonlinear systems by cherry-picking only the most relevant past data at every step, in a 2025 paper. Data-driven predictive control skips building a model and plans straight from recorded trajectories. Using all the data blurs the local picture, since a nonlinear system behaves differently in different regions.

Their method, Select-DPC, picks the data nearest the current situation to linearize the dynamics implicitly in trajectory space. A convex optimization then chooses inputs under user-set output limits, applied in rolling fashion. Two selection rules are offered, one by distance norms and one by manifold embedding, both verified. On rocket landing, robotic arm, and cart-pole simulators, the selective method beat both the standard approach and a time-windowed variant. The lesson travels: in data-driven control, the right few examples outrank the whole archive.

Catalog record

CREATORJoshua Näf, Keith Moffat, Jaap Eising, Florian Dörfler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18845

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Choose Wisely: Data-driven Predictive Control for Nonlinear Systems Using Online Data Selection Joshua Näf, Keith Moffat, Jaap Eising, Florian Dörfler Abstract This paper proposes Select-Data-driven Predictive Control (Select-DPC), a new method for controlling nonlinear systems using output-feedback for which data are available but an explicit model is not. At each timestep, Select-DPC employs only the most relevant data to implicitly linearize the dynamics in “trajectory space.” Then, taking user-defined output constraints into account, it makes control decisions using a convex optimization. This data-driven optimal control is applied in a receding-horizon manner. As the online data-selection is the core of Select-DPC, we propose and compare norm-based and manifold-embedding-based data selection methods. We evaluate Select-DPC on three benchmark nonlinear system simulators—rocket-landing, a robotic arm, and cart-pole inverted pendulum swing-up—comparing them with standard Data-enabled Predictive Control (DeePC) and Time-Windowed DeePC methods, and find that Select-DPC outperforms both methods. The source code can be found at: https://github.com/naefjo/choose-wisely-paper keywords Data-driven Predictive Control, Data-enabled Predictive Control, Nonlinear Systems, Nonlinear Predictive Control, Manifold Embedding, Sequential Quadratic Programming 1 Introduction Figure 1 : Closed-loop trajectories of Select-DPC (ours), standard DeePC, and Windowed DeePC in the Reacher (left) and the Rocket Lander (right) environments, as well as the corresponding open-loop predictions (dashed). Only Select-DPC converges to the setpoint. The data-driven control and Reinforcement Learning (RL) communities are focused on controlling systems for which data is available, but a system model is not. Specifically, the control community has developed interest in “direct” Data-driven Predictive Control (DPC) methods Dörfler et al. (2023) as they reduce system modeling/identification time and effort and bring the benefits of predictive control to the “model-free” setting. This paper proposes Select-DPC, a direct DPC method for nonlinear systems. Select-DPC extends DPC to the nonlinear setting by iteratively optimizing a convex Quadratic Program (QP) over an implicit linearization in “trajectory space” constructed from data. We define trajectory space as the high-dimensional space in which each dimension corresponds to an input or output over the course of a discrete-time, finite-length trajectory. Linearizing in trajectory space is achieved by selecting only trajectories that are “close” to the operating point in trajectory space. Literature Review Output-constrained systems are challenging for RL methods, which learn the constraints by exhaustive trial and error Sutton and Barto (1998) . Such systems have traditionally been the domain of Model Predictive Control (MPC) Morari and Lee (1999) , which solves a receding-horizon optimal control problem based on a state-space representation with an online optimization. In the nonlinear domain, the optimal control problem can be solved using Sequential Quadratic Programming (SQP). SQP-MPC iteratively linearizes the dynamics around a solution estimate, solves a QP around the linearization, and updates the solution estimate Diehl et al. (2002) . Figure 2 : Venn diagram illustrating how the discussed methods fall within the Explicit Constraint Handling , Direct , and Online Tractability merit categories. Select-DPC has all three merits. The class of Data-driven Predictive Controllers construct feasible trajectories of a linear, time-invariant (LTI) system purely from data. These methods bypass the sequential indirect system identification and MPC design pipeline and are hence called direct methods . Data-enabled Predictive Control (DeePC) Coulson et al. (2019) , for instance, linearly combines input-output trajectories in the data set. Such predictions fit into the behavioral control framework Willems (1991) . For a survey on DeePC we refer the reader to Markovsky et al. (2023) . DPC methods have demonstrated impressive results on various control tasks. While DPC methods can handle minor violations of the LTI assumption by treating them as additive measurement noise, the LTI restriction is severe and leads to arbitrary performance loss on generic nonlinear systems. Several approaches to DeePC in the nonlinear case can be found in the literature. Berberich and Allgöwer (2024) provide tailored formulations of the Fundamental Lemma Willems et al. (2005) to specific classes of nonlinear systems. These formulations enable efficient synthesis of DPC for systems belonging to these specific system classes. However, this already imposes a strong prior on the global nonlinear structure of the dynamical process, which might not be available for an arbitrary system. Alternatively, Berberich et al. (2022) propose using a set of the most recent past observations in a sliding window fashion along the current closed-loop trajectory to form the basis of a linear predictor, herein referred to as Time-Windowed DeePC. As this method only uses recent closed-loop data, it is practical only for systems with benign nonlinearities and with high signal-to-noise ratios. Approaches in the literature also suggest to reformulate the predictor in a kernelized fashion, enabling the use of nonlinear kernels Lian and Jones (2021) ; Huang et al. (2024) , using nonlinear basis functions or reformulating the problem in a lifted state-space using Koopman operators Lazar (2023) . While these methods offer nonlinear function approximation, the resulting optimization becomes high-dimensional, nonlinear, and generally nonconvex, requiring increased online computational complexity and resulting in suboptimal outcomes. In contrast with the optimization-based MPC literature, sampling-based MPC methods generate an ensemble of roll-outs by randomly sampling control inputs Nagabandi et al. (2018) and then applying an iterative refinement to obtain near optimal control sequences Botev et al. (2013) ; Williams et al. (2017) . These methods are favored in domains such as RL, as sampling-based MPC only requires zero-order model information, i.e. no gradient of the model, making them computationally cheap to evaluate. However, sampling-based MPC usually has no structured way of incorporating output constraints, since they rely on model roll-outs, and require the user to offload this complexity into other parts of the method, such as the model itself or the cost. In the context of RL, optimization-based planning techniques with explicit, learning-based models suffer from accumulating prediction errors Moerland et al. (2022) , exploding gradients due to backpropagation through time or model exploitation in regions of low data density Kurutach et al. (2018) . Figure 2 shows a conceptual overview of the mentioned strategies and their respective traits. The Select-DPC data-selection methods rely on finding high-dimensional nearest-neighbors, a concept that has been well established and applied in adjacent fields such as SLAM for feature matching and pose optimization Bailey and Durrant-Whyte (2006) , 3D shape registration Besl and McKay (1992) and in the context of dimensionality reduction and manifold learning Jia et al. (2022) . Contributions The contributions of this paper are threefold: 1. We introduce Select-DPC , a data-driven quadratic program predictive controller for nonlinear systems which implicitly linearizes the system dynamics in trajectory space by selecting and using only the most relevant data at each decision moment. 2. We propose two data-selection methods to achieve linearization in trajectory space, a norm-based method and a manifold-embedding-based method. 3. We demonstrate the benefits of Select-DPC on three benchmark nonlinear systems including a planar rocket-landing, a two degree of freedom robotic arm, and a cart-pole inverted pendulum, comparing it to standard DeePC and a Time-Windowed DeePC approach and find that Select-DPC outperforms both in terms of closed-loop cost and prediction accuracy. 2 Background Preliminaries We concern ourselves with nonlinear systems, for which we assume an autoregressive form y_{f}(k)=f(y_{\text{p}}(k),u_{\text{p}}(k),u_{\text{f}}(k)) exists. We use y\in\mathbb{R}^{p} and u\in\mathbb{R}^{m} to denote measurements and inputs of the nonlinear system respectively. The subscripts a_{\text{p}} and a_{\text{f}} denote past and future values

Read the complete text