On polynomial explicit partial estimator design for nonlinear systems with parametric uncertainties

Mazen Alamir · 2025

Read On polynomial explicit partial estimator design for nonlinear systems with parametric uncertainties by Mazen Alamir (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01638.txt.

Introduction

Mazen Alamir designs partial estimators, algorithms that reconstruct only part of a system's hidden state, for nonlinear systems whose parameters are not known exactly. Instead of a neural network, he proposes learning the estimator as a sparse multivariate polynomial: a compact formula relating measured data to the quantities that need estimating.

A general design framework is presented first, then tested on two illustrative examples against several machine learning and deep learning alternatives. The sparse polynomial scheme came out ahead, at least when the amount of learning data is small, the regime where big flexible models tend to overfit. The result argues for structured, interpretable formulas as serious rivals to black-box learners in estimation problems with limited data.

Catalog record

CREATORMazen Alamir
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01638

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On polynomial explicit partial estimator design for nonlinear systems with parametric uncertainties Mazen Alamir Abstract This paper investigates the idea of designing data-driven partial estimators for nonlinear systems showing parametric uncertainties using sparse multivariate polynomial relationships. A general framework is first presented and then validated on two illustrative examples with comparison to different possible Machine/Deep-Learning based alternatives. The results suggests the superiority of the proposed sparse identification scheme, at least when the learning data is small. keywords Nonlinear, State Estimation, Machine Learning, Uncertain Systems. 1 Introduction The state estimation of nonlinear systems ( Besançon 2007 ) is a fundamental topic in the control system literature that is still largely open in the case of real-life general nonlinear systems ( Alexander et al. 2020 ) in spite of the fact that nonlinear Moving-Horizon Estimators ( MHE ) ( Allan and Rawlings 2019 ) enabled a breakthrough in terms of genericity and constraints handling for deterministic nominal nonlinear systems. The difficulty increases in the case of nonlinear systems with parametric uncertainties. In this case, a first intuitive option is to extended the state vector by adjoining the unknown parameters with zero dynamics to the vector of decision variables to be optimized ( Kühl et al. 2011 ; Vijayaraghavan and Valibeygi 2016 ) . This might significantly increase the dimension of the decision variable or, even worse, lead to unobservable extended system inducing irrelevant estimation. A second option towards handling the parametric uncertainties is to define an expectation -based cost function in the optimization problem underlying the MHE following a dual formulation to stochastic Model Predictive Control design ( Mesbah 2016 ) . The expectation here is defined relative to the statistics of the parameters dispersion. This keeps the decision variable unchanged at the price of significantly heavier computation of the cost function inducing possible real-time implementation issues. The concept of Partial Estimation has been introduced in ( Alamir 2022 ) where it has been argued that the reconstruction of the whole state is not always needed, be it extended or not. Rather, one might need to reconstruct a so-called observation target based on the previous measurement time-series. The observation target might be any expression involving the state, control and parameter vectors. An example is the case where one needs to reconstruct the expression of the state feedback (involving as many unknowns as the number of inputs) rather than applying that feedback law to the estimated vector of the whole state (involving as many unknown as the number of states and parameters). Notice however that in the context of partial estimation, since the whole state is not involved in the computation, the system model cannot be used in online optimization as in standard estimation algorithms, rather, the model is used in an off-line data generation step that is then used in an off-line, Machine Learning-like ( ML ) identification step 1 1 1 In a nutshell, machine learning is about finding a map F such that F(\texttt{feature})=\texttt{label} . . In this ML process, the features vector is built on the previous time-series of the measured quantities while the label is precisely the observation target. The use of ML/Neural-Networks approach to nonlinear observer design is not new [ ( Alhajeri et al. 2021 ) and the references therein] and a detailed discussion of of the subtile differences between available solutions is out of the scope of the present short contribution. Rather, it is worth underlying the specificity of the approach proposed in the present contribution, namely: 1) The learning data used in the identification process involves a cloud of realizations of the uncertain parameters according to a supposedly known statistics. This induces an implicit implementation of the stochastic observer concept, applied to the very specific observation target. 2) The identification of the relationship between the previous measurement time-series and the observation target is based on the parsimonious identification of multi-variate polynomial relationships using a recently developed scalable least-angle -like algorithm ( Alamir 2025 ) . It can be conjectured that it is the parsimonious property of this approach that provides the safe generalization power when small amount of data is used in the learning step as it is shown in the present contribution. This paper is organized as follows. Section 2 provides some definitions and notation used throughout the paper and states the problem to be solved. Section 3 exposes the adopted methodology that is then applied to the illustrative examples in Section 4 which also provides comparison with some alternative solutions. The paper ends with Section 5 that summarizes the paper’s findings and gives some hints for further investigation. 2 Definitions & notation We consider nonlinear systems governed by: \displaystyle\dot{x} \displaystyle=f(x,u,p) (1a) \displaystyle y \displaystyle=h(x,u,p) (1b) where x\in\mathbb{R}^{n_{x}} , u\in\mathbb{R}^{n_{u}} , p\in\mathbb{R}^{n_{p}} and y\in\mathbb{R}^{n_{y}} stand for the state, control input, parameter and measurement vectors. The dynamic and the measurement maps, namely f and h are supposed to be known while p is supposed to be uncertain with known dispersion statistics \mathcal{S} providing the possibility to draw relevant random set of realizations. In the sequel, it is important to keep in mind that contrary to the majority of textbooks where y and u are separated entities, it is considered hereafter that, since u is supposed to be measured, it is a part of the measurement vector y given by ( 1b ). It is assumed that one is interested in estimating the value of some so-called observation target z that is given by: z=T(x,u,p) (2) where T is a known map and where z is supposed to be a scalar quantity without loss of generality 2 2 2 In case multiple observation targets are of interest, all the process can be repeated for each one of them in a totally decoupled manner. . Given a sampling instant k , the vector of past measurement used in the estimation is denoted by: \mathbf{y}^{(-)}_{k}:=\begin{bmatrix}y_{k}\cr y_{k-m}\cr\vdots\cr y_{k-Nm}\end{bmatrix}\in\Bigl[\mathbb{R}^{n_{y}}\Bigr]^{N+1} (3) where m\in\mathbb{N} is an under-sampling parameter, N the number of past measurements involved leading to N_{O}:=Nm being the so called observation horizon. The possibility of reconstructing the observation target z from the past measurement implicitly requires the existence of a map \mathcal{O} such that: z_{k}\approx\mathcal{O}(\mathbf{y}^{(-)}_{k}) (4) which provides a good estimation of z_{k} given the measurement time-series \mathbf{y}_{k}^{(-)} acquired over the past observation horizon. The \approx symbol used in ( 4 ) refers to the fact that the existence of the map \mathcal{O} may not be rigorously true preventing the use of rigorous equality. This is in particular generally impossible in the presence of model uncertainties and measurement errors. It is the outcome and the size of the residual delivered by the methodology proposed hereafter that determines the extent to which the relationship ( 4 ) holds. Notice however that the condition regarding the existence of \mathcal{O} is not constructive in the sense that it is not necessary to run the design-related computation. Based on the above notation, the problem addressed in the present paper can be stated as follows: Given the maps f , h and T defining the dynamics, the measurement and an observation target and assuming the knowledge of relevant sets \mathbb{X} , \mathbb{P} and \mathbb{U} for the state, parameters and control, Design an estimator of

Read the complete text