Online Learning for Supervisory Switching Control
Haoyuan Sun, Ali Jadbabaie · 2026
Read Online Learning for Supervisory Switching Control by Haoyuan Sun, Ali Jadbabaie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14762.txt.
Introduction
Sun and Jadbabaie learn switching control for partly seen linear systems. The true system is unknown, and some candidate controllers can destabilize it. Classic designs promise stability in the long run but give no time bounds. Their bandit-style method scores each controller with care for state history. Bad controllers stand out fast under the scoring. Two variants find the right controller in O(N log^2 N) steps. Finite-time bounds that ignore system dimension back both variants.
Catalog record
| CREATOR | Haoyuan Sun, Ali Jadbabaie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75317 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.14762
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Online Learning for Supervisory Switching Control Haoyuan Sun, Ali Jadbabaie Abstract We study supervisory switching control for partially-observed linear dynamical systems. The objective is to identify and deploy the best controller for the unknown system by periodically selecting among a collection of N N candidate controllers, some of which may destabilize the underlying system. While classical estimator-based supervisory control guarantees asymptotic stability, it lacks quantitative finite-time performance bounds. Conversely, current non-asymptotic methods in both online learning and system identification require restrictive assumptions that are incompatible in a control setting, such as system stability, which preclude testing potentially unstable controllers. To bridge this gap, we propose a novel, non-asymptotic analysis of supervisory control that adapts multi-armed bandit algorithms to a control-theoretic setting. The proposed data-driven algorithm evaluates candidate controllers via scoring criteria that leverage system observability to isolate the effects of state history, enabling both detection of destabilizing controllers and accurate system identification. We present two algorithmic variants with dimension-free, finite-time guarantees, where each identifies the most suitable controller in 𝒪 ( N log N ) \mathcal{O}(N\log N) steps, while simultaneously achieving finite L 2 L_{2} -gain with respect to system disturbances. 0 0 footnotetext: This work was supported by ONR grant #N00014-23-1-2299 and AFOSR MURI grant #FA9550-25-1-0375. 0 0 footnotetext: Corresponding author: Haoyuan Sun ( haoyuans [at] mit [dot] edu ). 1 Introduction This paper presents a supervisory switching framework that guarantees finite-time adaptation for unknown linear systems, leveraging online algorithm to establish non-asymptotic analysis for this classical problem. In many applications involving complex systems, such as power systems [ 16 ] , autonomous vehicles [ 2 ] , and epidemic control [ 5 ] , it is impractical for a single controller design to achieve acceptable performance across all operating conditions of the unknown plant. To address this challenge, switching control employs a collection of candidate controllers alongside a switching policy that selects the controller best suited to the current system behavior [ 14 ] . This approach has important applications in many established control paradigms, including gain scheduling [ 25 , 23 ] and linear parameter-varying control [ 33 , 17 ] . Within this framework, supervisory switching control relies on a higher-level policy that monitors system measurements to determine which controller should be inserted into the feedback loop. One well-studied class of supervisory policies is the estimator-based supervision [ 18 , 19 , 7 ] . This approach considers a setting where the true unknown system belongs to a predefined collection of models, each associated with a candidate controller providing satisfactory performance for that specific model. Then, a multi-estimator is constructed by simulating the predicted output of each model and computing its deviation from the true observed process y_{t} . A switching signal p_{t} is then determined by periodically selecting the model most consistent with the observations. Provided the switches are separated by a dwell time sufficiently long to avoid chattering, the certainty equivalence principle ensures the closed-loop system resulted from this policy is asymptotically stable. However, this traditional estimator-based approach does not quantitatively specify the time required to find a suitable controller and deriving precise finite-time bounds remains an open challenge. To develop a non-asymptotic analysis of supervisory switching control, we revisit this classical problem through the lens of modern learning techniques. A natural starting point is the non-asymptotic analysis of system identification, which estimates the parameters of an unknown dynamical system from a single trajectory of input-output data. Conceptually, estimator-based supervisors select the model that minimizes the error between predicted and observed outputs, akin to the least-squares objectives underpinning system identification. Recent advances in non-asymptotic system identification have extended classical asymptotic results [ 15 ] to quantify the sample complexity of learning accurate system estimates from data [ 28 , 34 , 13 ] . This has led to numerous methods for the non-asymptotic identification of partially observed linear systems, typically by estimating the system’s response matrix to an exploratory signal and reconstructing the system parameters via the Ho-Kalman algorithm [ 21 , 26 , 24 , 4 ] . However, these methods cannot be directly applied to our supervisory switching control paradigm because they presuppose system stability. This assumption is frequently violated in switching systems, where not all candidate controllers stabilize the underlying plant. Therefore, standard system identification approach cannot ensure safe exploration, as the potentially unstable controllers may cause the system to diverge before sufficient data is collected. Several works have attempted to address this limitation of performing system identification under instability. For example, one can explicitly identify system dynamics by injecting large probing signals, and subsequently control the learned system with online convex optimization [ 6 ] . A different approach pairs a multi-armed bandit algorithm with a stability certificate to safely switch between candidate controllers for unknown nonlinear systems [ 12 , 10 ] . Crucially, however, these methods apply only to fully-observed systems, requiring direct knowledge of the system states to guarantee both performance and stability. In contrast, our prior work [ 29 ] addresses the partially-observed setting by employing a two-step procedure: first detecting and eliminating destabilizing controllers, and then applying least-squares system identification to the remaining stable candidates. While this approach ensures safety under partial observability, it relies on a conservative instability detection criterion and exhaustively searches through controllers in a fixed order. This results in a highly inefficient sample complexity where the number of exploration steps scales exponentially with the number of candidates. Contributions. In this work, we propose a data-driven analysis of supervisory switching control that establishes non-asymptotic guarantees for adapting to partially-observed linear systems with a collection of N candidate controllers. Drawing on techniques from the machine learning and multi-armed bandit literature, our approach (Algorithm 1 ) evaluates each candidate controller over fixed switching intervals. Specifically, our evaluation criteria leverage system observability to approximate state trajectories from output data, effectively isolating the influences of earlier destabilizing controls. This eliminates the need for the stability or fully-observed state assumptions mandated by previous works. To achieve this, we introduce two evaluation criteria to simultaneously detect destabilizing controller (Criterion 1 ) and identify the unknown system (Criterion 2 ). The fixed interval between switches is deliberately chosen to ensure sufficient measurements for both criteria, thereby providing a quantitative lower bound on the dwell time that was only qualitatively defined in classical estimator-based supervision. Finally, based on these evaluation metrics, our algorithm selects the candidate controller that balances exploration and exploitation. Unlike standard multi-armed bandit frameworks, which assume independent and stationary rewards, our algorithm explicitly accounts for the evolution of the system states, striking a balance between learning performance and system stability. We present two algorithmic variants that find the most suitable controller in \mathcal{O}(N\log N) steps and at the same time guarantee finite L_{2} gain with respect to disturbances (Theorem 3 ). These guarantees represent a significant improvement over our prior work [ 29 ] , which required \exp(N) steps for identification. 2 Problem Settings We consider a collection of discrete-time, partially-observed linear systems \left\{(C_{i},A_{i},B_{i})\right\}_{i=1}^{N} . The unknown true system parameters (C_{\star},A_{\star},B_{\star}) belongs to this collection, and we denote their index as i_{\star} . Each of these systems evolves according to the following discrete-time dynamics: