Learning-Augmented Control: Adaptively Confidence Learning for Competitive MPC
Tongxin Li · 2025
Read Learning-Augmented Control: Adaptively Confidence Learning for Competitive MPC by Tongxin Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14595.txt.
Introduction
Control systems must act on forecasts, yet forecasts from machine learning can be badly wrong. Tongxin Li tackles that trust problem in this 2025 paper. The setting is a constrained system whose state changes over time in a curved, nonlinear way. Blind trust in a bad forecast can break safety limits, while no trust wastes a good tool.
The proposed method, called Learning-Augmented Control, mixes learned forecasts with a safe standard plan. A confidence value sets the mix, and that value is tuned online, after a delay, as outcomes arrive. The author proves bounds on how far the method can fall behind the best possible plan. In the simplest case that bound is tight, so it marks a true limit. Tests show the method stays stable even when forecasts are hostile.
Catalog record
| CREATOR | Tongxin Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-14595
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning-Augmented Control: Adaptively Confidence Learning for Competitive MPC Tongxin Li Abstract We introduce L earning- A ugmented C ontrol ( LAC ), an approach that integrates untrusted machine learning predictions into the control of constrained, nonlinear dynamical systems. LAC is designed to achieve the “best-of-both-worlds” guarantees, i.e, near-optimal performance when predictions are accurate, and robust, safe performance when they are not. The core of our approach is a delayed confidence learning procedure that optimizes a confidence parameter online, adaptively balancing between ML and nominal predictions. We establish formal competitive ratio bounds for general nonlinear systems under standard MPC regularity assumptions. For the linear quadratic case, we derive a competitive ratio bound that is provably tight, thereby characterizing the fundamental limits of this learning-augmented approach. The effectiveness of LAC is demonstrated in numerical studies, where it maintains stability and outperforms standard methods under adversarial prediction errors. I Introduction Predictive information is fundamental to controlling dynamical systems, enabling methods like Model Predictive Control (MPC) to optimize actions based on anticipated future behavior [ 1 ] . While MPC has widespread applications across numerous engineering domains, its performance critically depends on the quality of these predictions. In the current era of artificial intelligence, these predictions increasingly originate from sophisticated yet inherently uncertain sources, particularly off-the-shelf Machine Learning (ML) models. For instance, ML-generated predictions are utilized in data-driven MPC (see [ 2 , 3 ] and [ 4 ] ) and model-based reinforcement learning [ 5 ] , while other forms of auxiliary predictive advice like human feedback are employed in applications including mobile robotics [ 6 ] and fair motion planing [ 7 ] . A major limitation, however, is that these ML-based and other predictive sources often lack formal guarantees on their accuracy. This uncertainty introduces significant risks, especially in dynamic, time-varying systems, potentially leading to degraded performance or even instability. The performance and robustness of MPC under uncertain inputs have been extensively studied in the literature, often focusing on sensitivity analysis within given uncertainty bounds; see, e.g., [ 8 , 9 , 10 , 11 , 12 , 13 , 14 ] , and [ 15 ] . In many real-world applications, advanced complex, data-driven predictors often produce outputs whose accuracy is difficult to verify a priori, and prediction errors may only appear occasionally. While theoretically sound, existing approaches become overly conservative because simple uncertainty models are inadequate for capturing rare but significant prediction errors. Consequently, this creates a critical dilemma for control design: (1) leverage potentially superior but uncertain predictions, risking poor outcomes if they are wrong, or (2) rely on safe but suboptimal nominal predictions. The latter approach is frequently adopted in practice to ensure system safety and predictability, albeit at the cost of performance. Motivated by this practical challenge, we seek to develop an MPC framework that escapes this dichotomy by providing the best of both worlds: (1). Exploit good predictions consistently to achieve near-optimal performance; (2). Ensure performance remains close to that of using only nominal predictions robustly when prediction quality degrades significantly (often in the worst-case). Fig. 1: Illustrative comparison of closed-loop control cost versus prediction error for Learning-Augmented Control ( LAC , this work), MPC , LQR , and Self-Tuning [ 16 ] . LAC (blue solid) and Self-Tuning (black solid) exemplify the desired “best-of-both-worlds” behavior: they achieve near-optimal low cost comparable to MPC when predictions are good (low error) and robustly maintain cost close to the LQR baseline when prediction quality is poor (high error). Shaded regions represent standard deviation over multiple simulation runs. In Section V-A , detailed experimental settings are provided. An example is shown in Figure 1 , where a Linear Quadratic Regulator ( LQR , red dash-dot) uses only baseline nominal predictions by regarding future system disturbances as zero, yielding robust but potentially suboptimal cost. Classic MPC (green dashed) directly uses potentially inaccurate predictions, achieving consistent performance at low error but suffering significant performance degradation (high cost and variance) as error increases. Classic MPC and LQR cannot achieve (1) and (2) simultaneously. Focusing on this need, various new approaches have sought to strike a balance between uncertain ML predictions and safer nominal ones. A preliminary algorithm termed Self-Tuning (black solid in Figure 1 ) was presented in [ 16 ] , but its applicability is limited to time-invariant linear dynamics with quadratic costs, and its competitive ratio guarantee depends on quantifying the variation of predictions and system perturbations due to its Follow-the-Leader (FTL) basis. For more general time-varying systems, online policy selection via online optimization has been explored in [ 17 ] by tuning policy parameters. An adaptive regret of O(\sqrt{T}) is guaranteed by [ 17 ] , but the surrogate costs need to be convex and differentiable with respect to policy parameters. Recent results such as [ 18 ] have used the disturbance response control to ensure the convexity of the stable controller space; [ 19 ] has applied online optimization algorithms to linear quadratic control problems with latent disturbances, yet the analysis requires additional assumptions to stabilize the key confidence parameter. Consequently, there remains a need for a principled method with theoretical guarantees that achieves the dual “best-of-both-worlds” objectives above for general dynamical systems subject to uncertain ML predictions. Our work also contributes to the evolving field of adaptive control, especially in its recent intersection with learning theory to address non-asymptotic metrics. While the adaptive control community has traditionally concentrated on Lyapunov stability and asymptotic convergence [ 20 , 21 , 22 ] , the newer trend represented in [ 23 ] , [ 24 ] , [ 25 ] , and [ 26 ] employs learning-theoretic measures such as competitive ratio and regret for finite horizon analysis. In particular, [ 23 , 26 , 27 , 28 ] have applied regret minimization to provide finite-time performance bounds and [ 25 , 24 , 29 , 30 ] have established sample complexity guarantees for online control. In contrast to those recent results that rely on statistical assumptions and weaker regret metrics, our work employs competitive analysis to design controllers robust to adversarial disturbances and evaluated against a true offline optimal. Contributions. To tackle the challenge of utilizing untrusted ML predictions in MPC, this work studies the Learning-Augmented Control (LAC) problem for general time-varying nonlinear systems with constraints, where a controller receives potentially inaccurate, parameterized predictions of future system parameters (\phi^{\star}_{\tau}:\tau\geq t) within a receding horizon framework. The core problem is that the prediction error is unknown until the corresponding true parameters are revealed. Our framework aims to transform conventional MPC by introducing a robust layer of online confidence learning. In the first part of this article, we propose a \lambda_{t} -confident control law, where \lambda_{t} is a time-varying confidence parameter learned online. This mechanism explicitly balances leveraging potentially high-reward but untrusted ML predictions against relying on safe but conservative nominal predictions. We formulate the online learning of the confidence sequence \{\lambda_{t}\}_{t=0}^{T-1} as a delayed online convex optimization problem. We derive a per-step surrogate error bound, minimizing which aims to minimize the overall control cost. Crucially, evaluating the bound and its gradient at time t requires knowledge of prediction errors up to time t+k where k is a prediction