System Identification from Partial Observations under Adversarial Attacks
Jihun Kim, Javad Lavaei · 2025
Read System Identification from Partial Observations under Adversarial Attacks by Jihun Kim, Javad Lavaei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00244.txt.
Introduction
Jihun Kim and Javad Lavaei wrote this 2025 paper on learning the rules of a system from partial readings while an attacker corrupts some of them. The goal is a trimmed copy of the true system, accurate up to a set order, built only from output data. Attacks strike at a set rate over time, with values that can be anything at all.
For a clean class of systems, the team's estimator nails the system's response matrix exactly, under any attack pattern. For general systems, the error in that matrix shrinks at an exponential rate as the order grows. The trimmed model follows suit, matching the true system up to a change of coordinates. The authors claim the first input-output proof of its kind for this harsh setting.
Catalog record
| CREATOR | Jihun Kim, Javad Lavaei |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-00244
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
System Identification from Partial Observations under Adversarial Attacks Jihun Kim, Javad Lavaei Abstract This paper is concerned with the partially observed linear system identification, where the goal is to obtain reasonably accurate estimation of the balanced truncation of the true system up to the order k k from output measurements. We consider the challenging case of system identification under adversarial attacks, where the probability of having an attack at each time is Θ ( 1 / k ) \Theta(1/k) while the value of the attack is arbitrary. We first show that the l 1 l_{1} -norm estimator exactly identifies the true Markov parameter matrix for nilpotent systems under any type of attack. We then build on this result to extend it to general systems and show that the estimation error exponentially decays as k k grows. The estimated balanced truncation model accordingly shows an exponentially decaying error for the identification of the true system up to the similarity transformation. This work is the first to provide the input-output analysis of the system with partial observations under arbitrary attacks. I Introduction Dynamical systems are often highly complex to accurately model from physics, which potentially leads to a considerable number of unknown parameters of the underlying system. The system identification is to identify these true parameters, given the input and output data [ 1 ] . In the fully observed system, all states are measured, meaning that the outputs are identical to the states. The challenge of system identification is often posed by the disturbances injected into the system. Existing methods for dealing with this problem include least-squares [ 2 , 3 , 4 ] , l_{2} -norm estimator [ 5 , 6 ] , and l_{1} -norm estimator [ 7 ] , where each estimator tackles a different type of disturbance. While the classical least-squares method overcomes sub-Gaussian zero-mean independent disturbances, the work [ 7 ] considers the general case where the system is affected by sub-Gaussian, nonzero-mean, and possibly adversarial attacks. However, one may not be able to measure all states of the system in many applications, including robotics [ 8 ] , healthcare [ 9 ] , and complex safety-critical systems [ 10 ] . This partial measurement of the states hinders accurate system identification since it introduces an additional challenge of inferring unmeasured states from the observations. For this reason, instead of directly estimating the system parameters, it would be beneficial to first estimate the Markov parameter matrix using the observations, since a sufficiently large set of Markov parameters enables accurate reconstruction of the original system [ 11 , 12 ] . The existing literature mainly used the least-squares method for the estimation of Markov parameters, assuming Gaussian or sub-Gaussian zero-mean independent disturbances [ 13 , 14 ] . A variant of least-squares method is given in [ 15 ] , where the disturbances are predictable based on past observations. While the least-squares method provides a satisfactory estimator for such restrictive disturbances, little is known about the partially observed system identification when the disturbances are fully selected adversarially, leveraging past information to enhance their adversarial nature. A pioneering work on retrieving the true system from the Markov parameter matrix is the Ho-Kalman algorithm [ 16 ] , which obtains the balanced realization of the true system via singular value decomposition (SVD). Similarly, one can obtain an estimated balanced model from the estimated Markov parameter matrix, which remains robust if the Markov parameter matrix is estimated accurately [ 13 ] . In this paper, we focus on the partially observed linear system identification and obtain the balanced truncated model of the true system up to the order k , where we allow fully adversarial attacks to occur at each time with probability \Theta(1/k) . Our attack model applies to the case when an extremely large attack may occasionally affect the partially observed system, such as natural disaster on power systems [ 17 , 18 ] , unanticipated malicious cyber attacks [ 19 ] , and others. We first estimate the Markov parameter matrix with an l_{1} -norm estimator by building on [ 7 ] . We construct two scenarios on the true system and show that: 1. the true Markov parameter matrix is the unique solution to the l_{1} -norm estimator for a nilpotent system, 2. the estimation error of the Markov parameter matrix exponentially decays with k for a general system. Following the estimation of the Markov parameter matrix, we conduct a similar analysis to that in [ 14 ] to retrieve the estimated balanced truncation up to the order k , where we show that the error also decays exponentially with k within the similarity transformation. The paper is organized as follows. In Sections II and III , we introduce the preliminaries and formulate the problem, respectively. In Section IV , we prove that the l_{1} -norm estimator achieves exact recovery for a nilpotent system and establish a bounded estimation error for a general system under the presence of adversarial attacks. Section V leverages the results from Section IV to retrieve an accurate approximation of the true system. In Section VI , we present numerical experiments to support our main results. Finally, concluding remarks are provided in Section VII . Notation. Let \mathbb{R}^{n} denote the set of n -dimensional vectors and \mathbb{R}^{n\times n} denote the set of n\times n matrices. For a matrix A , \|A\|_{2} denotes the spectral norm and \|A\|_{F} denotes the Frobenius norm of the matrix. The notation A_{[n_{1}:n_{2}],[m_{1}:m_{2}]} denotes the submatrix of A that contains the rows from the n_{1}^{\text{th}} to the n_{2}^{\text{th}} row and the columns from the m_{1}^{\text{th}} to the m_{2}^{\text{th}} column of A . Let A^{-1} denote the inverse, A^{\dagger} denote the pseudoinverse, and A^{T} denote the transpose of the matrix A . Let I_{n} denote the identity matrix in \mathbb{R}^{n\times n} . For a vector x , \|x\|_{1} denotes the l_{1} -norm and \|x\|_{2} denotes the l_{2} -norm of the vector. For a scalar z , \text{sgn}(z)=1 if z>0 , \text{sgn}(z)=-1 if z<0 , and \text{sgn}(z)=0 if z=0 . Let \mathbb{E} denote the expectation operator. \mathbb{P}(\mathcal{E}) denotes the probability of the event \mathcal{E} . We use \Theta(\cdot) for the big- \Theta notation, and \tilde{\Theta}(\cdot) for the big- \Theta notation hiding logarithmic factors. Let N(\mu,\Omega) denote the Gaussian distribution with mean \mu and covariance \Omega . Finally, let \mathbb{S}^{d-1} denote the set \{y\in\mathbb{R}^{d}:\|y\|_{2}=1\} . II Preliminaries In this work, we consider each attack on the system to be a sub-Gaussian variable in which the tail event rarely occurs (note that bounded attacks automatically satisfy our assumption). We use the definition given in [ 20 ] . Definition 1 (sub-Gaussian scalar variables): A random variable w\in\mathbb{R} is called sub-Gaussian if there exists c>0 such that \mathbb{E}\Bigr[\exp\Bigr(\frac{w^{2}}{c^{2}}\Bigr)\Bigr]\leq 2. (1) Its sub-Gaussian norm is denoted by \|w\|_{\psi_{2}} and defined as \|w\|_{\psi_{2}}=\inf\left\{c>0:\mathbb{E}\Bigr[\exp\Bigr(\frac{w^{2}}{c^{2}}\Bigr)\Bigr]\leq 2\right\}. (2) Note that the \psi_{2} -norm satisfies properties of norms: positive definiteness, homogeneity, and triangle inequality. We have the following properties for a sub-Gaussian variable w : \displaystyle\mathbb{E}[|w|]\leq c_{1}\|w\|_{\psi_{2}}, (3) \displaystyle\mathbb{P}(|w|\geq s)\leq 2\exp(-c_{2}s^{2}/\|w\|_{\psi_{2}}^{2}),\quad\forall s\geq 0, (4) \displaystyle\mathbb{E}[\exp(\lambda w)]\leq\exp(c_{3}\lambda^{2}\|w\|_{\psi_{2}}^{2}),~\forall\lambda\in\mathbb{R}~\text{if }\mathbb{E}[w]=0, (5) where c_{1},c_{2},c_{3} are positive absolute constants. For example, if w\sim N(0,\gamma^{2}) , equivalent to \mathbb{E}[\exp(\lambda w)]=\exp(\lambda^{2}\gamma^{2}/2) , then we have