Least Squares Model Reduction: A Two-Stage System-Theoretic Interpretation

Alberto Padoan · 2025

Read Least Squares Model Reduction: A Two-Stage System-Theoretic Interpretation by Alberto Padoan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20604.txt.

Introduction

Alberto Padoan reframes a model reduction method as a two-stage process, in this 2025 paper. Model reduction shrinks complex dynamic systems while keeping their core behavior. The method in view is least squares moment matching, recently given a system theory frame.

Stage one builds a stand-in model that meets chosen matching conditions. Stage two projects that stand-in onto a smaller space. Tools from output regulation and Krylov methods support the reading. Padoan then revisits a classic method by Lucas and Smith under this lens, drawing out its hidden structure. The paper aims to unify how such reductions are understood.

Catalog record

CREATORAlberto Padoan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20604

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Least Squares Model Reduction: A Two-Stage System-Theoretic Interpretation Alberto Padoan Abstract Model reduction simplifies complex dynamical systems while preserving essential properties. This paper revisits a recently proposed system-theoretic framework for least squares moment matching. It interprets least squares model reduction in terms of two steps process: constructing a surrogate model to satisfy interpolation constraints, then projecting it onto a reduced-order space. Using tools from output regulation theory and Krylov projections, this approach provides a new view on classical methods. For illustration, we reexamine the least-squares model reduction method by Lucas and Smith, offering new insights into its structure. 1 Introduction Model reduction simplifies dynamical systems while preserving their key features ( Antoulas, 2005 ) . For linear time-invariant systems, moment matching has emerged as a popular approach ( Antoulas, 2005 ; Georgiou, 1983 ; Kimura, 1986 ; Antoulas et al., 1990 ; Byrnes et al., 1995 ; Georgiou, 1999 ; Byrnes et al., 2001 ; Grimme, 1997 ; Gallivan et al., 2004 ; Gallivan et al., 2006 ; Astolfi, 2010 ) . It approximates a system’s transfer function by a lower-degree function via rational interpolation, ensuring their moments — defined as coefficients of the Laurent series expansion — coincide at specified points. Efficient and robust implementations often use Krylov projectors ( Antoulas, 2005 , Chapter 11) . Over the past three decades, moments of linear time-invariant systems have been characterized using Sylvester equations ( Gallivan et al., 2004 ; Gallivan et al., 2006 ) and, under specific assumptions, steady-state responses ( Astolfi, 2010 ) . However, classical moment matching methods enforce exact interpolation, which can be overly restrictive in practice. Least squares moment matching relaxes this requirement, optimizing mismatches in a least squares sense. For linear systems, it has a rich literature ( Shoji et al., 1985 ; Aguirre, 1992 ; Aguirre, 1994b ; Smith and Lucas, 1995 ; Aguirre, 1995 ; Gugercin and Antoulas, 2006 ; Gu and An, 2010 ; Gustavsen and Semlyen, 1999 ; Mayo and Antoulas, 2007 ; Berljafa and Güttel, 2017 ; Nakatsukasa et al., 2018 ; Antoulas et al., 2020 ) , with connections to Padé approximation ( Aguirre, 1992 ; Aguirre, 1994b ; Aguirre, 1994a ) and Prony’s method ( Gugercin and Antoulas, 2006 ; Parks and Burrus, 1987 ) . Least squares model reduction for linear and nonlinear systems is studied in ( Padoan, 2021 ; Padoan, 2023 ) , building on the framework of ( Astolfi, 2010 ) . Moments are characterized using output regulation theory ( Byrnes and Isidori, 1989 ; Isidori and Byrnes, 1990 ; Byrnes and Isidori, 2000 ; Isidori, 1995 ) , resulting in a time-domain formulation of least squares moment matching as a constrained optimization problem. This formulation connects frequency-domain interpolation to system-theoretic concepts such as interconnections, invariance equations, and steady-state responses. Contributions . This paper makes two main contributions. First, we provide a new system-theoretic interpretation of least squares moment matching as a two-step model reduction process, bridging classical projection methods with recent output regulation insights. Second, we illustrate how this framework unifies and clarifies existing methods, particularly those based on moment matching at zero. For illustration, we analyze the approach of Smith and Lucas ( Smith and Lucas, 1995 ) , showing that this method yield models within the family derived in ( Padoan, 2021 ) . Paper organization . The rest of this work is structured as follows. Section 2 introduces the problem setup, including key definitions, assumptions, and the formulation of the moment matching problem. Section 3 discusses moment matching for linear systems, focusing on methods using Sylvester equations and Krylov projections. Section 3 recalls the least-squares moment matching framework developed in ( Padoan, 2023 ) . Section 5 explores the system-theoretic interpretation of least squares moment matching, presenting it as a two-step model reduction process, highlighting connections between our least squares moment matching framework and existing methods. Section 6 concludes the paper with a summary and future directions. Notation . \mathbb{Z}_{+} , \mathbb{R} and \mathbb{C} denote the set of non-negative integers, the set of real numbers, and the set of complex numbers, respectively. \mathbb{C}_{-} and \mathbb{C}_{0} denote the sets of complex numbers with negative and zero real part, respectively. I denotes the identity matrix. {\sigma({A})} denotes the spectrum of the matrix {A\in\mathbb{R}^{n\times n}} . M^{\mathsf{T}} denotes the transpose of the matrix {M\in\mathbb{R}^{p\times m}} . \left\lVert\,\cdot\,\right\rVert_{2} and \left\lVert\,\cdot\,\right\rVert_{2*} denote the Euclidean 2 -norm on \mathbb{R}^{n} and the corresponding dual norm ( Boyd and Vandenberghe, 2004 , p.637) , respectively. f^{(k)}(\cdot) denotes the derivative of order {k\in\mathbb{Z}_{+}} of the function f(\cdot) , provided it exists, with f^{(0)}(\cdot)=f(\cdot) by convention. \lfloor x\rfloor denotes the largest integer less than or equal to {x\in\mathbb{R}} . 2 Problem setup Consider a continuous-time, single-input, single-output, linear, time-invariant system described by the equations \quad\dot{x}=Ax+Bu,\quad y=Cx, (1) where {x(t)\in\mathbb{R}^{n}} , {u(t)\in\mathbb{R}} , {y(t)\in\mathbb{R}} , {A\in\mathbb{R}^{n\times n}} , {B\in\mathbb{R}^{n\times 1}} and {C\in\mathbb{R}^{1\times n}} , with transfer function defined as W(s)=C(sI-A)^{-1}B. (2) For the notion of moment to make sense, we make the following standing assumption throughout the paper. 1 . The system ( 1 ) is minimal, i.e. the pair (A,B) is controllable and the pair (A,C) is observable. The moment of order 1 1 1 Moments may also be defined at poles of the transfer function ( 2 ). Following ( Padoan and Astolfi, 2017a ; Padoan and Astolfi, 2017b ; Padoan and Astolfi, 2017c ; Padoan and Astolfi, 2019 ) , if {s^{\star}\in\mathbb{C}} is a pole of order {m>0} , the moment of order {-k} , with {1\leq k\leq m} , is the coefficient of (s-s^{\star})^{-k} in the Laurent series of ( 2 ) around {s^{\star}} . {k\in\mathbb{Z}_{+}} of system ( 1 ) at {s^{\star}\in\mathbb{C}} , with {s^{\star}\not\in{\sigma({A})}} , is defined as {\eta_{k}(s^{\star})=\tfrac{(-1)^{k}}{k!}W^{(k)}(s^{\star})}. Given distinct interpolation points {\{s_{i}\}_{i=1}^{N}} , with {s_{i}\in\mathbb{C}} and {s_{i}\not\in{\sigma({A})}} , and corresponding orders of interpolation {\{k_{i}\}_{i=1}^{N}} , with {k_{i}\in\mathbb{Z}_{+}} , model reduction by moment matching consists in finding a system \quad\dot{\xi}=F\xi+Gv,\quad\psi=H\xi, (3) where {\xi(t)\in\mathbb{R}^{r}} , {v(t)\in\mathbb{R}} , {\psi(t)\in\mathbb{R}} , {F\in\mathbb{R}^{r\times r}} , {G\in\mathbb{R}^{r\times 1}} , {H\in\mathbb{R}^{1\times r}} , the transfer function of which \hat{W}(s)=H(sI-F)^{-1}G (4) satisfies the interpolation conditions \quad\eta_{j}(s_{i})=\hat{\eta}_{j}(s_{i}),\quad j\in\{0,\ldots,k_{i}\},\ i\in\{1,\ldots,N\}, (5) where \eta_{j}(s_{i}) and \hat{\eta}_{j}(s_{i}) denote the moments of order j of ( 1 ) and ( 3 ) at s_{i} , respectively. The system ( 3 ) is said to be a model of system ( 1 ) and to match the moments of system ( 1 ) (or achieve moment matching) at \{s_{i}\}^{N}_{i=1} if the interpolation conditions ( 5 ) hold. Furthermore, ( 3 ) is said to be a reduced order model of system ( 1 ) if {r<n} . It is well-known that a model of order r can match up to 2r moments ( Antoulas, 2005 , Chapter 11) . The number of interpolation conditions is thus larger than the number of moments that can be matched if {\nu=\sum_{i=1}^{N}(k_{i}+1)}>2r . In this case, the interpolation conditions ( 5 ) give rise to an overdetermined system of equations which can be only solved in a least squares sense, leading directly to the model reduction problem by least squares moment matching . Given distinct interpolation points {\{s_{i}\}_{i=1}^{N}} , with {s_{i}\in\mathbb{C}} and {s_{i}\not\in{\sigma({A})}} , and corresponding orders of interpolation {\{k_{i}\}_{i=1}^{N}} ,

Read the complete text