On Continuous-time Sparse Identification of Nonlinear Polynomial Systems
Mazen Alamir · 2025
Read On Continuous-time Sparse Identification of Nonlinear Polynomial Systems by Mazen Alamir (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17635.txt.
Introduction
Mazen Alamir, writing alone, improves a method for learning unknown dynamics from a little noisy data. His 2025 arXiv paper works in continuous time and targets nonlinear systems whose behavior follows a polynomial law with few active terms. The systems in view take one input and one output, with relative degree up to four.
Two recent advances feed the method. The first rebuilds high derivatives of a signal from a noisy time series, which continuous-time identification needs. The second finds sparse multivariate polynomials that fit the rebuilt signals. Joined, they let the procedure name a parsimonious model from a small data set. Alamir illustrates the full pipeline on an electronic throttle control system from the automotive world. The paper speaks to engineers who must model a plant from short, imperfect test runs.
Catalog record
| CREATOR | Mazen Alamir |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17635
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Continuous-time Sparse Identification of Nonlinear Polynomial Systems Mazen Alamir Abstract This paper leverages recent advances in high derivatives reconstruction from noisy-time series and sparse multivariate polynomial identification in order to improve the process of parsimoniously identifying, from a small amount of data, unknown Single-Input/Single-Output nonlinear dynamics of relative degree up to 4 4 . The methodology is illustrated on the Electronic Throttle Controlled automotive system. keywords Nonlinear, continuous-time, sparse identification, chain of integrators. 1 Introduction In this paper we are interested in continuous-time identification of unknown Single-Input/Single-Output (SISO) polynomial systems of relative degree n\in\{1,\dots,4\} . Namely: y^{(n)}=\mathcal{P}(y,\dot{y},\dots,y^{(n-1)},u) (1) where \mathcal{P} is a multivariate polynomial of an unknown degree d . Moreover since the safe excitation of unknown systems remains challenging, we are interested in a methodology that enables an accurate identification using small datasets involving a family of short damped excitation signals that are known to be possible to safely apply to the system, initially at rest. While the restriction applies to the notation and the specific illustrative example, the methodology developed hereafter easily extends to more general MIMO polynomial systems of the form: \displaystyle\text{For}\ i\in\{1,\dots,n_{y}\}, \displaystyle y_{i}^{(n_{i})}=\mathcal{P}_{i}\Bigl(\bigl\{\{y_{j}^{(\kappa)}\}_{\kappa=0}^{n_{j}^{(i)}-1}\bigr\}_{j=1}^{n_{y}},\{u_{\ell}\}_{\ell=1}^{n_{u}}\Bigr)=:\mathcal{P}_{i}\bigl(z_{i}\bigr) (2) using the same tools that are shown hereafter to be efficient to address the identification of ( 1 ), namely: - Tool1 : The recently proposed algorithm 1 1 1 This refers to the python module ml-derivatives that is available through standard python-pip-install . see https://mazenalamir.github.io/ml_derivatives/ for more details. for the computation of high derivatives (up to order 4 ) of noisy time-series ( Alamir 2025c ) , - Tool2 : The scalable plars algorithm which addresses the problem of identifying multivariate polynomial relationships ( Alamir 2025a ) . Indeed, assuming that for a given n_{i} , the l.h.s y^{(n_{i})}_{i} of ( 2 ) is available ( Tool1 ), the problem boils down to identify the multivariate polynomial relationships ( 2 ) that links the label y_{i}^{(n_{i})} to the features 2 2 2 The couple (label, features) borrows the well-known Machine Learning vocabulary where one seeks a map F such that label =F( features ). vector z_{i} ( Tool2 ). The price associated to the generalization to the MIMO systems lies in the dimension of z_{i} , namely 3 3 3 Notice that n_{i}^{(i)}=n_{i}-1 for all i by definition. : \texttt{dim}(z_{i})=n_{u}+\sum_{j\in\{1,\dots,n_{y}\}}n_{j}^{(i)} as this leads to a multivariate polynomial with a large number of coefficients. For instance, a 9-dimensional nonlinear system with two inputs and three outputs of relative degree 4 4 4 The relative degree of an output is the number of derivation that are required to see the one of the components of the input explicitly in the expression of the derivative. 3 each, might be associated to the following instantiation: \Bigl\{n_{u}=2,n_{y}=3,n_{j}^{(i)}=3\Bigr\}\ \longrightarrow\texttt{dim}(z_{i})=11 This leads to a 78 coefficients for a polynomial of degree d=2 , 1365 coefficients for d=4 and 12376 coefficients for d=6 . Surprisingly enough, as it is shown in ( Alamir 2025a ) , such problems can be efficiently solved using standard tools as the lassolars module of the scikit-learn python library ( Pedregosa et al. 2011 ) in few minutes if not seconds. Much larger problems involving up to half a million variables can be solved using plars ( Alamir 2025a ) in few minutes suggesting that this is not a real issue. This being said, for the sake of simplicity of notation, we focus on SISO models given by ( 1 ) in the present paper. The reason for which we are interested in continuous-time models is threefold: 1. It enables to totally decouple the identification of the dynamics from the choice of the sampling period for the control design. 2. More importantly, the degree of the r.h.s of the continuous-time dynamics is lower than that of the discrete-time one-step ahead version as the latter is the result of multiple composition of the former as it is the case in standard Runge-Kutta method for instance. The direct consequence of this fact is that it is an easier task to identify the ODEs than the discrete-time law, provided that the reconstruction of high derivatives is possible despite of the noisy measurement ( Tool1 ). 3. Identifying the nonlinear system in the derivatives space corresponds to a nonlinear coordinates transformation that might, in some cases, approximately admits a linear representation enabling simpler design of the control law. This is because the implicit coordinates change involves the r.h.s of the ODE’s. This features is precisely exhibited in the illustrative example used in the present paper. It is precisely because decent reconstruction of high derivatives has always been viewed as almost-impossible that CT-identification was systematically considered as a tricky task ( Rao and Unbehauen 2006 ; Paduart et al. 2010 ) . In the next section, a discussion regarding possible alternatives to address the above-defined problem is briefly provided 1.1 State of the art A relevant way to cluster the set of possible approaches is to examine the mathematical structure that is used to represent the nonlinearity: - The Hammerstein structure ( Greblicki 2002 ; Jui and Ahmad 2021 ) has been widely used in the past where a nonlinear transformation of the control is fed to a linear dynamics. This results in a nonlinear structure that is affine in the state and can be nonlinear only in the control input. - The Wiener structure ( Sadeghi and Farrokhi 2018 ) where nonlinearity applies to the output of a linear dynamics, the nonlinearity is affine in the control and all the state’s components except the output itself which is again a very specific structure. - Naturally, combined Wiener-Hammerstein structures have been studied in ( Paduart et al. 2012 ) with polynomial nonlinear part. This leads to the nonlinearity affecting only input and output and not the internal state or, equivalently, the other derivatives of the output as in ( 1 ). - Comprehensively, the recent burst of Deep NN enhanced some works that addressed the identification of the two above structures using DNN to express the localized nonlinearity but this does not fundamentally change the properties of the nonlinearity being exclusively concentrated on the input and the output respectively. - Fully-polynomial state space models have been studied in ( Paduart et al. 2010 ) and some related papers. The algorithm in ( Paduart et al. 2010 ) involves two main steps. In the first a best linear model is first identified. This model is then corrected by adding virtual inputs that involve a set of multivariate monomials in the state and the control input. The identification of the nonlinear added polynomial expressions is based on the minimization of the norm of the the output prediction error which involves the simulation of the nonlinear system for all candidate set of parameters involved in the iterations. Since neither the linear model nor the successive nonlinear iterates are guaranteed to show stable dynamics, this might lead to a fragile optimization process. This difficulty is shared by all the algorithms that minimize simulation-based cost functions. Another difficulties stems from the non parsimonious approach being used which might induce the well known over-fitting problem unless a large dataset is used which contradicts the problem statement as defined above. In ( Biagetti et