Distances between finite-horizon linear behaviors
A. Padoan, J. Coulson · 2025
Read Distances between finite-horizon linear behaviors by A. Padoan, J. Coulson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22849.txt.
Introduction
Alberto Padoan and Jeremy Coulson define distances between linear system behaviors over finite time spans. Behavioral theory describes systems by their allowed signal sets. Comparing such sets across different sizes needs care.
Their distances ignore coordinate choices, rotations, and reorderings. Models of unlike dimensions can still be compared fairly. The measures blend model complexity with fit in one principled scale. That blend solves a long-standing puzzle in the theory. Modeling becomes a search for the closest unfalsified model. Their best model class is named and characterized fully. A time series anomaly task shows the metrics at work. Finer resolution beat older distances on that task.
Catalog record
| CREATOR | A. Padoan, J. Coulson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22849
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Distances between finite-horizon linear behaviors A. Padoan, J. Coulson Abstract The paper introduces a class of distances for linear behaviors over finite time horizons. These distances allow for comparisons between finite-horizon linear behaviors represented by matrices of possibly different dimensions. They remain invariant under coordinate changes, rotations, and permutations, ensuring independence from input-output partitions. Moreover, they naturally encode complexity-misfit trade-offs for Linear Time-Invariant (LTI) behaviors, providing a principled solution to a longstanding puzzle in behavioral systems theory. The resulting framework characterizes modeling as a minimum distance problem, identifying the Most Powerful Unfalsified Model (MPUM) as optimal among all systems unfalsified by a given dataset. Finally, we illustrate the value of these metrics in a time-series anomaly detection task, where their finer resolution yields superior performance over existing distances. I Introduction Linear systems theory has recently witnessed renewed interest in subspace representations [ 1 , 2 , 3 , 4 , 5 ] . Grounded in behavioral systems theory [ 6 , 7 , 8 ] , which models systems as sets of trajectories, subspace representations provide a flexible alternative to classical parametric models, characterizing all system trajectories over a finite time horizon. While subspace representations rely on linearity, they avoid committing to a specific model structure, such as state-space representations or transfer functions. Instead, they can operate directly on raw data and characterize linear behaviors over finite horizons, without explicit parametrizations or a priori complexity constraints. These properties have made these representations an established foundation for subspace identification algorithms [ 9 ] and recent advances in data-driven control [ 1 ] , often leading to superior performance compared to traditional parametric approaches [ 2 ] . A natural question arising in this context is: “How should one compare subspace representations of finite-horizon linear behaviors?” In system identification and data-driven control, subspace representations are often compared using distances induced by matrix norms. While simple to compute, such distances give rise to several fundamental inconsistencies: (i) matrix representations of different dimensions cannot be meaningfully compared—even if they describe the same behavior; (ii) distances may depend on arbitrary coordinate choices; and (iii) behaviors that are geometrically distant may appear deceptively close. All these issues arise because finite-horizon linear behaviors are, by nature, linear subspaces [ 6 , 7 , 8 ] , and should be compared using metrics that respect their geometry. Prior work has explored this issue—most notably through the L -gap metric and Grassmann metric studied in [ 3 ] and [ 4 ] . However, both metrics are useful only when comparing subspaces of equal dimension, as they either assign a trivial maximal value or become undefined when dimensions differ. We introduce a new class of distances inherited from the doubly infinite Grassmannian [ 10 ] , which resolve the inconsistencies noted above, provide a principled answer to a long-standing puzzle in behavioral systems theory, and offer improved resolution in time series analysis applications. Related work Distances have long played a foundational role in systems and control theory. The gap metric [ 11 ] and its refinements [ 12 , 13 ] have shaped robust control by providing a topology for comparing feedback systems. In the context of behavioral systems theory for Linear Time-Invariant (LTI) systems, notions of distance have been explored in [ 14 , 15 ] , while subspace angles have been studied in [ 16 , 17 ] . A misfit–complexity trade-off for identification was proposed in [ 18 ] . All prior work focuses on infinite-horizon behaviors. In contrast, we consider the finite-horizon setting, which is increasingly relevant in system identification and data-driven control [ 2 ] . Closest to our work are [ 3 , 4 ] , but the distances proposed in these works either assign a trivial maximal value or become undefined when the subspace dimensions differ. Contributions : We introduce a new class of distances for finite-horizon linear behaviors (Theorem 1 ), based on principal angles over the doubly infinite Grassmannian [ 10 ] . Such distances are able to compare subspaces of differing dimensions, remain invariant under coordinate changes, rotations, and permutations (Lemma 2 and Theorem 2 ), and are thus independent of input-output partitions. They naturally encode a trade-off between complexity and misfit (Theorem 3 ), yielding utility functions (Lemma 3 ) resolving a long-standing modeling question posed in [ 8 ] . We show that the Most Powerful Unfalsified Model (MPUM) [ 7 ] emerges as the optimal model among all unfalsified behaviors (Theorem 4 , Corollary 1 ). Finally, we illustrate the value of these metrics in the context of anomaly detection, where their finer resolution offers improved sensitivity to anomaly severity over existing distances. Organization : Section II covers preliminary material. Section III revisits a modeling puzzle. Section IV defines the set of finite-horizon linear behaviors. Section V reviews the doubly infinite Grassmannian [ 10 ] . Section VI characterizes the proposed metrics and their relevance to modeling. Section VII illustrates their use in time series anomaly detection. Section VIII provides a summary and future research directions. II Preliminaries II-A Notation The set of positive integers is denoted by \mathbb{N} . The set of real numbers is denoted by \mathbb{R} . For {T\in\mathbb{N}} , the set of integers \{1,2,\dots,T\} is denoted by \mathbf{T} . A map f from X to Y is denoted by {f:X\to Y} ; (Y)^{X} denotes the set of all such maps. The restriction of {f:X\to Y} to a set {X^{\prime}} , with {X^{\prime}\cap X\neq\emptyset} , is defined as {f|_{X^{\prime}}(x)=f(x)} for {x\in X^{\prime}} ; if {\mathcal{F}\subseteq(Y)^{X}} , then {\mathcal{F}|_{X^{\prime}}=\{f|_{X^{\prime}}\,:\,f\in\mathcal{F}\}} . The shift operator {\sigma} on sequences is defined as {(\sigma w)_{t}=w_{t+1}} ; if {\mathcal{S}} is a set of sequences, then {\sigma\mathcal{S}=\{\sigma w\,:\,w\in\mathcal{S}\}} . The transpose, image, and kernel of a matrix {M\in\mathbb{R}^{m\times n}} are denoted by M^{\top} , \operatorname{im}\,M , and \operatorname{ker}M , respectively. The m\times p zero matrix is denoted by 0_{m\times p} and the m\times p matrix with ones on the main diagonal and zeros elsewhere is denoted by I_{m\times p} . For m=p , we use 0_{p} and I_{p} , omitting subscripts if clear from the context. Following [ 10 ] , the Grassmannian manifold of k -dimensional subspaces in \mathbb{R}^{N} is denoted by \operatorname{Gr}(k,N) , the orthogonal group of k\times k orthogonal matrices is denoted by \operatorname{O}(k) , and the i -th principal angle between {\mathcal{V}\in\operatorname{Gr}(k,N)} and {\mathcal{U}\in\operatorname{Gr}(l,N)} is denoted by {\theta_{i}(\mathcal{V},\mathcal{U})} for {i\in\mathbf{r}} , with {r=\min(k,l)} . For brevity, we omit dependence on \mathcal{V} and \mathcal{U} if clear from the context. II-B Behavioral system theory Behavioral systems theory views systems as sets of trajectories [ 6 , 7 , 8 ] . Given a time set {\mathbb{T}} and a signal space \mathbb{W} , a trajectory is any function {w:\mathbb{T}\to\mathbb{W}} and a system is defined by its behavior \mathcal{B} , i.e. , a subset of the set of all possible trajectories {\mathcal{W}=(\mathbb{W})^{\mathbb{T}}} . In this spirit, a model of a system is its behavior, and a model class {\mathcal{M}\subseteq 2^{\mathcal{W}}} is a family of subsets of the set of possible trajectories {\mathcal{W}} . By convention, we identify systems with their behaviors and use “model,” “system,” and “behavior” interchangeably. Throughout this work, we exclusively focus on discrete-time systems, with {\mathbb{T}=\mathbb{N}} and