Performance-driven Constrained Optimal Auto-Tuner for MPC

Albert Gassol Puigjaner, Manish Prajapat, Andrea Carron, Andreas Krause, Melanie N. Zeilinger · 2025

Read Performance-driven Constrained Optimal Auto-Tuner for MPC by Albert Gassol Puigjaner, Manish Prajapat, Andrea Carron, Andreas Krause, Melanie N. Zeilinger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07127.txt.

Introduction

Albert Gassol Puigjaner and co-authors present an auto-tuner for predictive control in this 2025 paper. Predictive control plans moves ahead of time to keep a system on track, but its cost settings are hard to tune. The key challenge is to keep performance above a set threshold while the tuning search goes on.

Their method learns after each tuning round and updates its beliefs about good settings. It explores toward promising settings in a goal-directed way, which makes it sample-efficient. Theory shows it respects the performance limit with high probability at all times and reaches the best setting in finite time. Tests in simulation and on hardware, including autonomous racing, beat standard search methods.

Catalog record

CREATORAlbert Gassol Puigjaner, Manish Prajapat, Andrea Carron, Andreas Krause, Melanie N. Zeilinger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07127

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Performance-driven Constrained Optimal Auto-Tuner for MPC Albert Gassol Puigjaner, Manish Prajapat, Andrea Carron, Andreas Krause, Melanie N. Zeilinger Abstract A key challenge in tuning Model Predictive Control ( MPC ) cost function parameters is to ensure that the system performance stays consistently above a certain threshold. To address this challenge, we propose a novel method, COAt-MPC , Constrained Optimal Auto-Tuner for MPC . With every tuning iteration, COAt-MPC gathers performance data and learns by updating its posterior belief. It explores the tuning parameters’ domain towards optimistic parameters in a goal-directed fashion, which is key to its sample efficiency. We theoretically analyze COAt-MPC , showing that it satisfies performance constraints with arbitrarily high probability at all times and provably converges to the optimum performance within finite time. Through comprehensive simulations and comparative analyses with a hardware platform, we demonstrate the effectiveness of COAt-MPC in comparison to classical Bayesian Optimization (BO) and other state-of-the-art methods. When applied to autonomous racing, our approach outperforms baselines in terms of constraint violations and cumulative regret over time. COAt-MPC Code : https://github.com/albertgassol1/coat_mpc CRS Code : https://gitlab.ethz.ch/ics/crs Video : https://youtu.be/Ep_BX3BDaeU?si=ShPcvWB_I8xCGg9T I Introduction Model Predictive Control ( MPC ) is a prominent optimization-based control framework that can handle constraints and optimize system performance by predicting the system’s future behavior. MPC is widely used in many robotic applications such as autonomous driving [ 1 ] , four-legged robots [ 2 ] , and bipedal robots [ 3 ] . While MPC is a successful optimal control technique, one of the significant challenges in its implementation is tuning the cost function parameters. Designing a cost function that balances competing objectives is a non-trivial task that requires significant trial and error. Moreover, the cost function parameters often depend on the specific environment and system dynamics, making it difficult to design a single set of parameters that can perform well in all scenarios. Usually, the task of fine-tuning cost function parameters involves heuristic methods and demands expert knowledge, leading to a significant number of costly and time-consuming experimental iterations. In most applications, we tune to maximize some performance function, e.g., while tuning for racing, we optimize the lap time. However, these performance functions are often a-priori unknown and need to be learned through data. Naively, to find the optimal parameters, one may try out a large set of parameters in a grid search approach. Apart from inefficiency caused by executing a large number of parameters, many of those parameters may lead the system to halt, i.e., low performance, resulting in a wasteful evaluation. For example, in tuning an MPC for autonomous racing, it is undesirable to use parameters that make the car move extremely slow, or even stop before finishing a lap. This motivates a tuning process ensuring system performance above a threshold. Figure 1 : COAt-MPC overview. COAt-MPC proposes a set of cost function weights \boldsymbol{\theta}_{n} , which are evaluated on the system. It gets a performance function sample, which is used to update the posterior belief and acquire a new set of cost function weights. The process is repeated until convergence. To tackle these challenges, we propose a novel algorithm: COAt-MPC , Constrained Optimal Auto-Tuner for MPC . COAt-MPC explores the space of MPC cost function parameters and builds a belief about the a-priori unknown performance function through data, utilizing tools from Gaussian processes [ 4 ] . COAt-MPC incorporates safe exploration ideas from [ 5 , 6 , 7 ] and recursively recommends sufficiently informative parameters that ensure exploration while satisfying the performance constraint. We establish convergence guarantees to the optimal tuning parameters in a finite number of samples while ensuring performance constraint satisfaction with an arbitrarily high probability. For finite time convergence, we present a sample complexity bound by leveraging the bound from [ 7 ] for continuous domains and demonstrate its applicability with discrete set operators required for discrete domains. In particular, our sample complexity result removes an explicit dependence on the discretization step size and thus significantly improves prior safe exploration results in discrete domains [ 6 , 8 , 9 ] . Finally, we demonstrate the effectiveness of COAt-MPC in the application of autonomous racing. We tune a Model Predictive Contouring Control [ 10 ] formulation with the objective of optimizing the lap time while avoiding undesirable effects such as halting. Our evaluation includes a comprehensive analysis in both simulation and in experiments on a 1:28 scale RC racecar [ 11 ] . We present a comparative analysis against competitive baselines. The results demonstrate that our approach outperforms other methods in terms of the number of constraint violations and yields an improved cumulative regret. II Related works Controller tuning in robotics has been an active area of research. Recently, data-driven methods aimed at learning the relationship between system parameters and a desired metric have emerged as promising solutions for automatic tuning. Methods such as the Metropolis-Hastings algorithm [ 12 ] and Policy Search methods [ 13 ] , have demonstrated state-of-the-art results in model-based agile flight control. Bayesian Optimization (BO) [ 14 , 15 ] has been particularly successful due to its ability to optimize the objective function using a limited number of samples [ 16 ] . It utilizes a probabilistic model to represent the unknown objective function, which is updated as new data is acquired. Even though any probabilistic model can be used, a popular choice to model unknown functions is a Gaussian Process (GP) [ 4 ] , e.g., in BO [ 8 , 17 , 18 , 19 , 6 , 20 ] , MPC [ 7 ] or experiment design [ 21 ] . In the context of MPC parameter tuning, BO can be used to find the optimal cost function parameters for a given platform and environment [ 22 ] by selecting an adequate objective function, i.e., laptime in the case of MPC tuning for racing applications. Additionally, subsequent works have introduced contextual information from the environment or system [ 17 ] , considered the confidence of the probabilistic model to enhance the cautiousness and convergence rate of BO [ 18 ] , and combined BO with trust region optimization [ 19 ] . However, it is worth noting that these BO methods do not take into account constraints on the objective function, which can lead to parameters that produce very poor performance due to their unbounded exploration. Several approaches have emerged to incorporate constraints into BO. One such approach involves utilizing a variant of the Expected Improvement (EI) function, referred to as the Constrained Expected Improvement (EI C ) [ 23 , 24 , 25 ] . This approach involves modeling the constraint function with a prior distribution and incorporating a probability of violation into the acquisition function. However, none of these methods provide a theoretical guarantee of constraint satisfaction. In the literature of constrained Bayesian Optimization, Safe-Opt [ 8 , 5 , 26 ] is introduced as a method that aims to provide high-probability guarantees of constraint satisfaction. The algorithm leverages the regularity assumption on the objective function and the Lipschitz continuity to identify a set of parameters where the constraints on the underlying objective function are unlikely to be violated. Even though Safe-Opt has been proven

Read the complete text