Stabilizing Linear Systems under Partial Observability: Sample Complexity and Fundamental Limits

Ziyi Zhang, Yorie Nakahira, Guannan Qu · 2025

Read Stabilizing Linear Systems under Partial Observability: Sample Complexity and Fundamental Limits by Ziyi Zhang, Yorie Nakahira, Guannan Qu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16756.txt.

Introduction

Ziyi Zhang, Yorie Nakahira, and Guannan Qu ask how much data stabilizing a half-seen system takes in a 2025 paper. Controllers must steady systems whose full state cannot be measured. For fully seen systems, the learning cost depends only on the unstable part's size, not the whole system's.

Partial sight breaks that trick, since the unstable subspace cannot be uniquely identified. Their LTS-P method compresses a lifted data matrix to estimate the unstable subsystem up to a change of coordinates. A robust controller then steadies it. The sample cost matches the fully seen benchmark, closing a recognized gap in learning to control.

Catalog record

CREATORZiyi Zhang, Yorie Nakahira, Guannan Qu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE109 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-16756

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stabilizing Linear Systems under Partial Observability: Sample Complexity and Fundamental Limits Ziyi Zhang, Yorie Nakahira, Guannan Qu Abstract We study the problem of stabilizing an unknown partially observable linear time-invariant (LTI) system. For fully observable systems, leveraging an unstable/stable subspace decomposition approach, state-of-art sample complexity is independent from system dimension n n and only scales with respect to the dimension of the unstable subspace. However, it remains open whether such sample complexity can be achieved for partially observable systems because such systems do not admit a uniquely identifiable unstable subspace. In this paper, we propose LTS-P, a novel technique that leverages compressed singular value decomposition (SVD) on the “lifted” Hankel matrix to estimate the unstable subsystem up to an unknown transformation. Then, we design a stabilizing controller that integrates a robust stabilizing controller for the unstable mode and a small-gain-type assumption on the stable subspace. We show that LTS-P stabilizes unknown partially observable LTI systems with state-of-the-art sample complexity that is dimension-free and only scales with the number of unstable modes, which significantly reduces data requirements for high-dimensional systems with many stable modes. 1 Introduction Learning-based control of unknown dynamical systems is of critical importance for many autonomous control systems [ Beard et al., 1997 ; Li et al., 2022 ; Bradtke et al., 1994 ; Krauth et al., 2019 ; Dean S. Mania, 2020 ] . However, existing methods make strong assumptions such as open-loop stability, availability of initial stabilizing controller, and fully observable systems [ Fattahi, 2021 ; Sarkar et al., 2019 ] . However, such assumptions may not hold in many autonomous control systems. Motivated by this gap, this paper focuses on the problem of stabilizing an unknown, partially-observable, unstable system without an initial stabilizing controller. Specifically, we consider the following linear-time-invariant (LTI) system: \begin{split}x_{t+1}&=Ax_{t}+Bu_{t}\\ y_{t}&=Cx_{t}+Du_{t}+v_{t},\end{split} (1) where x_{t}\in\mathbb{R}^{n} and u_{t}\in\mathbb{R}^{d_{u}},y_{t}\in\mathbb{R}^{d_{y}} are the state, control input, and observed output at time step t\in\{0,\dots,T-1\} , respectively. The system also has additive observation noise v_{t}\sim\mathcal{N}(0,\sigma_{v}^{2}I) . While there are works studying system identification for partially observable LTI systems [ Fattahi, 2021 ; Sun et al., 2020 ; Sarkar et al., 2019 ; Oymak and Ozay, 2018b ; Zheng and Li, 2020 ] , none of these works address the subsequent stabilization problem; in fact, many assume open-loop stability [ Fattahi, 2021 ; Sarkar et al., 2019 ; Oymak and Ozay, 2018b ] . Other adaptive control approaches can solve the learn-to-stabilize problem in ( 1 ) and achieve asymptotic stability guarantees [ Pasik-Duncan, 1996 ; Petros A. Ioannou, 2001 ] , but the results therein are asymptotic in nature and do not study the transient performance. Recently, in the special case when C=I , i.e. fully-ovservable LTI system, Chen and Hazan [2020] reveals that the transient performance during the learn-to-stabilize process suffers from exponential blow-up, i.e. the system state can blow up exponentially in the state dimension. This is mainly due to that in order to stabilize the system, system identification for the full system is needed, which takes at least n samples on a single trajectory, during which the system could blow up exponentially for n steps. To relieve this problem, Hu et al. [2022] proposed a framework of separating the unstable component of the system and stabilizing the entire system by stabilizing the unstable subsystem. This reduces the sample complexity to only grow with the number of the unstable eigenvalues (as opposed to the full state dimension n ). This result was later extended to noisy setting in Zhang et al. [2024] , and such a dependence on the number of unstable eigenvalues is the best sample complexity so far for the learn-to-stabilize problem in the fully observable case. Compared with this line of work, our work focuses on partially observable systems, which is fundamentally more difficult than the fully observable case. First, partially observable systems typically need a dynamic controller, which renders stable feedback controllers in the existing approach not applicable [ Hu et al., 2022 ] . Second, the construction in “unstable subspace” in Hu et al. [2022] is not uniquely defined in the partially observable case. This is because the state and the A,B,C matrices are not uniquely identifiable from the learner’s perspective, as any similarity transformation of the matrices can yield the same input-output behavior. Given the above discussions, we ask the following question: Is it possible to stabilize a partially observable LTI system by only identifying an unstable component (to be properly defined) with a sample complexity independent of the overall state dimension ? Contribution. In this paper, we answer the above question in the affirmative. Firstly, we propose a novel definition of “unstable component” to be a low-rank version of the transfer function of the original system that only retains the unstable eigenvalues. Based on this unstable component, we propose LTS-P, which leverages compressed singular value decomposition (SVD) on a “lifted” Hankel matrix to estimate the unstable component. Then, we design a robust stabilizing controller for the unstable component, and show that it stabilizes the full system under a small-gain-type assumption on the H_{\infty} norm of the stable component. Importantly, our theoretical analysis shows that the sample complexity of the proposed approach only scales with the dimension of unstable component, i.e. the number of unstable eigenvalues, as opposed to the dimension of the full state space. We also conduct simulations to validate the effectiveness of LTS-P, showcasing its ability to efficiently stabilize partially observable LTI systems. Moreover, the novel technical ideas behind our approach are also of independent interest. We show that by using compressed singular value decomposition (SVD) on a properly defined lifted Hankel matrix, we can estimate the unstable component of the system. This is related to the classical model reduction [ Dullerud and Paganini, 2000 , Chapter 4.6] , but our dynamics contain unstable modes with a blowing up Hankel matrix as opposed to the stable Hankel matrix in Dullerud and Paganini [2000] and the system identification results in Fattahi [2021] ; Sarkar et al. [2019] ; Oymak and Ozay [2018b] . Interestingly, the H_{\infty} norm condition on the stable component, derived from the small gain theorem, is a necessary and sufficient condition for stabilization, revealing the required subspace to be estimated in order to stabilize the unknown systems. Such a result not only suggests the optimality of LTS-P but also informs the fundamental limit on stabilizability. Related Work. Our work is mostly related to adaptive control, learn-to-control with known stabilizing controllers, learn-to-stabilize on multiple trajectories, and learn-to-stabilize on a single trajectory. In addition, we will also briefly cover system identification. Adaptive control. Adaptive control enjoys a long history of study [ Pasik-Duncan, 1996 ; Petros A. Ioannou, 2001 ; Chen and Astolfi, 2021 ] . Most classical adaptive control methods focus on asymptotic stability and do not provide finite sample analysis. The more recent work has started to study non-asymptotic sample complexity of adaptive control when a stabilizing controller is unknown [ Chen and Hazan, 2020 ; Faradonbeh, 2017 ; Lee et al., 2023 ; Tsiamis and Pappas, 2021 ; Tu and Recht, 2018 ] . Specifically, the most typical strategy to stabilize an unknown dynamic system is to use past trajectory to estimate the system dynamics

Read the complete text