The Fragility of Learning LQG Controllers
Bruce D. Lee*, Anastasios Tsiamis*, Nikolai Matni, Manfred Morari, John Lygeros · 2026
Read The Fragility of Learning LQG Controllers by Bruce D. Lee*, Anastasios Tsiamis*, Nikolai Matni, Manfred Morari, John Lygeros (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24442.txt.
Introduction
Lee and four colleagues study how hard it is to learn controllers for partially observed linear systems with Gaussian noise, known as LQG control, from recorded trajectories. They prove a lower bound on excess cost for any method that maps offline data to a stabilizing linear controller. The bound uses the cost curvature and the Fisher information of the exploration policy. Applied to classic fragile examples, it shows when fragility becomes high sample complexity.
Catalog record
| CREATOR | Bruce D. Lee*, Anastasios Tsiamis*, Nikolai Matni, Manfred Morari, John Lygeros |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 163607 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24442
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Fragility of Learning LQG Controllers Bruce D. Lee*, Anastasios Tsiamis*, Nikolai Matni, Manfred Morari, John Lygeros Abstract Learning methods are increasingly used to synthesize controllers from data, yet existing sample-complexity characterizations for continuous control are sharp only in the fully observed setting. This paper studies the partially observed case by deriving information-theoretic lower bounds for learning Linear Quadratic Gaussian (LQG) controllers from offline trajectories generated by a (linear) exploration policy. We prove an ε \varepsilon -local minimax excess-cost lower bound that applies to any algorithm mapping the offline dataset to a stabilizing linear controller. The bound is expressed in terms of the Hessian of the LQG cost with respect to model parameters and the inverse Fisher Information induced by the exploration policy. We further provide system-theoretic characterizations of these objects, enabling transparent construction of hard instances. Instantiating the bound on classical fragile robust-control examples, including variants of the Doyle LQG fragility counterexample and non-minimum-phase systems, demonstrates when fragile robust control problems translate into high sample complexity for learning-enabled control. These results suggest the asymptotic optimality of certainty-equivalent synthesis and motivate the importance of both task-directed experiment design and system co-design for sample-efficient learning in partially observed control. I Introduction The problem of learning to control partially observed systems remains poorly understood, even for the relatively simple case of linear systems with quadratic costs and Gaussian noise (LQG). Although the robust control community has long recognized that partial observability introduces substantial additional subtleties [ 1 ] , this insight is largely absent from the recent literature on learning-based control and reinforcement learning. In this paper, we fill this gap by examining the fundamental limits and inherent fragility of learning the optimal LQG controller. We characterize the complexity of this problem through its data requirements, that is, its statistical complexity. I-A Contributions We make the following contributions: • We provide an information-theoretic lower bound on the sample complexity of learning LQG controllers from offline data. The bound applies to any algorithm mapping data to a controller, and thus shows that common practical strategies for mitigating partial observability in control and reinforcement learning (e.g., history stacking [ 2 ] ) cannot circumvent the fundamental hardness of the problem. • We show the bound in terms of the underlying dynamical system, allowing the construction of ‘‘hard’’ instances. 1 1 1 Code to evaluate the hardness of any instance is available at https://colab.research.google.com/drive/12BtSCDb8-gYhx-7CwIIw6FaC8Z3OnGmM?usp=sharing • We study classical examples of fragile problems from robust control, including an example inspired by Doyle’s counterexample [ 1 ] and a non-minimum phase system. We show that such fragile instances result in learning problems which exhibit high sample complexity. These contributions serve as an important step to enable the design of optimal algorithms, e.g. by task-directed experiment design. They also shed light on the importance of system design as a critical step in the engineering pipeline to enable sample efficient learning, a step that is often neglected in reinforcement learning due to the desire to apply black-box algorithms. By exposing hard instances of linear systems, the results additionally enable strategic design of benchmarks for reinforcement learning that have a clear hierarchy of difficulty. I-B Related Work Complexity of Learning-Enabled Control Recent literature has made significant progress in understanding the statistical complexity of learning to control in the setting of fully observed linear systems. The authors of [ 3 ] provide a bound on the regret of learning to control a linear system online, while [ 4 ] bound the excess cost of an offline identification and control scheme. Bounds that appear tight in dimension were introduced by [ 5 ] for the offline setting, and by [ 6 ] for the online setting. Subsequent work has shown that such bounds neglected terms that could scale exponentially in dimensions [ 7 , 8 , 9 , 10 ] , indicating that the focus should be upon achieving bounds that are tight in system-theoretic quantities rather than system dimensions. Progress in this direction is presented by [ 11 , 12 , 13 , 14 ] . However, these works are restricted to the fully observed setting or special cases of partially observed systems. Upper bounds on learning the LQG are presented in the offline setting by [ 5 ] and in the online setting by [ 15 ] but without a tight dependence on the underlying system instance. We instead achieve tight lower bounds in the partially observed setting of learning the LQG from offline data. Fundamental Limitations of Robust Control A long line of work in robust control has shown that partially observed systems can exhibit fundamental fragility to model uncertainty. The seminal paper [ 1 ] was the first to show that LQG could be arbitrarily fragile to model uncertainty, despite the guaraneed inherent robustness of the linear quadratic regulator (LQR). Subsequently, robust alternatives to LQG were developed, which could mitigate the issue [ 16 ] . Nonetheless, certain systems which are ill-conditioned [ 17 ] or which exhibited challenging observability structure due to unstable zeros [ 18 ] lack robustness under any controller. In [ 19 ] , the authors provide a case study illustrating such limitations on the toy problem of stabilizing a cartpole system with visual observations. This problem is studied from an empirical perspective in [ 20 ] by applying a reinforcement learning algorithm to a partially observed cartpole system, and highlighting that the systems which robust control theory predicts are fragile require a large number of samples to learn an effective controller. We provide theoretical justification for such observations by deriving lower bounds on the cost incurred by any learning algorithm applied to control a partially observed linear system. We instantiate our lower bound on several classical examples of fragile robust control problems, and demonstrate when they correspond to challenging learning-based control problems. Interplay of System Identification with Control When the system model must be estimated from data, the fragility phenomena described above place a significant burden on the identification process. In particular, small errors can lead to large degradation in control performance, necessitating very accurate identification [ 21 ] . This has led to extensive study of the interplay of system identification with control, see e.g. [ 22 ] and references therein. One of the primary takeaways from such literature is that the experiment design must be performed in a way that accounts for the downstream control task [ 23 , 22 , 24 , 25 , 26 , 27 ] . A case study for one sensitive example, controlling a high purity distillation column, is studied by [ 28 ] . In contrast to work on identification for control, our analysis takes an algorithm-agnostic perspective. In particular, we derive lower bounds on the excess cost incurred by any algorithm that maps an offline dataset to a controller. These bounds provide an information-theoretic justification for the central insight of identification-for-control: that data collection must excite the parameter directions to which the downstream control task is most sensitive. Notation: For size conforming matrices A,B,C,D , we identify \mathopen{}\left[\begin{array}[]{c|c}A&B\\ \hline\cr C&D\end{array}\right]\mathclose{} with the transfer function C(zI-A)^{-1}B+D . For a transfer function \mathcal{M} of dimension (\mathsf{dz}+\mathsf{dy})\times(\mathsf{d\eta}+\mathsf{du}) , denote the feedback interconnection of \mathcal{M} with a transfer