Real-Time Performance Analysis of Multi-Fidelity Residual Physics-Informed Neural Process-Based State Estimation for Robotic Systems

Devin Hunter, Chinwendu Enyioha · 2025

Read Real-Time Performance Analysis of Multi-Fidelity Residual Physics-Informed Neural Process-Based State Estimation for Robotic Systems by Devin Hunter, Chinwendu Enyioha (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08231.txt.

Introduction

Devin Hunter and Chinwendu Enyioha test a multi closeness leftover physics informed neural process for tracking the state of a robotic system in real time. Safety critical tracking needs not only forecasts but trustworthy error margins. Choosing the right motion model is a core difficulty, since simple models miss effects that complex ground truth dynamics contain.

The estimator learns the leftover gap between low closeness forecasts and high closeness conduct. Split conformal prediction supplies robust uncertainty guarantees inside training and inference for a hybrid online learning setup. Against unscented and deep Kalman filter variants, the method shows promising accuracy for live robotic tracking tasks.

Catalog record

CREATORDevin Hunter, Chinwendu Enyioha
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08231

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Real-Time Performance Analysis of Multi-Fidelity Residual Physics-Informed Neural Process-Based State Estimation for Robotic Systems Devin Hunter, Chinwendu Enyioha Abstract Various neural network architectures are used in many of the state-of-the-art approaches for real-time nonlinear state estimation. With the ever-increasing incorporation of these data-driven models into the estimation domain, model predictions with reliable margins of error are a requirement – especially for safety-critical applications. This paper discusses the application of a novel real-time, data-driven estimation approach based on the multi-fidelity residual physics-informed neural process (MFR-PINP) toward the real-time state estimation of a robotic system. Specifically, we address the model-mismatch issue of selecting an accurate kinematic model by tasking the MFR-PINP to also learn the residuals between simple, low-fidelity predictions and complex, high-fidelity ground-truth dynamics. To account for model uncertainty present in a physical implementation, robust uncertainty guarantees from the split conformal (SC) prediction framework are modeled in the training and inference paradigms. We provide implementation details of our MFR-PINP-based estimator for a hybrid online learning setting to validate our model’s usage in real-time applications. Experimental results of our approach’s performance in comparison to the state-of-the-art variants of the Kalman filter (i.e. unscented Kalman filter and deep Kalman filter) in estimation scenarios showed promising results for the MFR-PINP model as a viable option in real-time estimation tasks. I Introduction and Background Accurate and reliable state estimation remains a cornerstone of autonomous robotic systems, directly impacting their ability to localize, navigate, and interact with complex environments. In recent years, a growing body of research has explored both model-based and data-driven paradigms to achieve robust estimation under challenging sensing conditions [ 8 , 13 , 16 ] . At one end of the spectrum, dead reckoning approaches relying on motion-based sensors such as inertial measurement units (IMUs) and wheel encoders provide a lightweight and fully onboard solution for estimating a ground robot’s odometry. Such methods are appealing due to their low computational and sensor requirements, making them attractive in cost- and weight-constrained scenarios. However, it is well established that dead reckoning accumulates drift over time, with errors in wheel encoder calibration, slippage, or IMU bias. These errors result in large-scale localization inaccuracies when external correction signals such as GPS, LiDAR, or vision are unavailable [ 23 , 2 ] . To overcome these limitations, model-based sensor fusion techniques such as the Extended Kalman Filter (EKF), Unscented Kalman Filter (UKF), and factor graph optimization methods have been widely deployed [ 21 , 7 ] . These approaches combine data from multiple sensors including LiDAR, cameras, IMUs, and encoders, while explicitly encoding kinematic and dynamic models of the platform. Although successful in practice, they require accurate motion models and well-calibrated sensors. In addition, performance can degrade significantly under sensor failures or mismatches between assumed and true system dynamics. In parallel, the growth of machine learning has motivated data-driven state estimation methods, such as deep Kalman filters, recurrent neural networks, and more recently, attention-based sequence models. These methods bypass explicit modeling by learning latent state representations directly from sequential data. While capable of capturing complex nonlinearities, they often require large volumes of labeled training data, utilized models can output physically infeasible predictions, and they typically lack principled mechanisms for quantifying predictive uncertainty. This makes them difficult to deploy in safety-critical robotic applications, where predictions need to be physically consistent with the system being modeled, and confidence bounds on estimates are as important as the estimates themselves. Data-driven estimators such as deep Kalman filters [ 19 , 26 ] , recurrent networks [ 5 ] , and sequence models learn latent dynamics directly from data and can capture complex nonlinearities that elude hand-tuned filters [ 12 ] . However, many such approaches require large labeled datasets and often provide limited, poorly calibrated uncertainty estimates, reducing their appeal for safety-critical robotic systems. Neural Processes (NPs) [ 6 , 10 ] were introduced as a family of models that combine the flexibility of neural nets with the fast adaptation and uncertainty quantification of stochastic processes; NPs condition on context sets and output predictive distributions, making them attractive for few-shot and online adaptation tasks. Attentive Neural Processes (ANPs) extended NPs by adding attention mechanisms to overcome underfitting and to produce query-specific context representations, substantially improving predictive fidelity [ 18 ] . Recently, a promising line of work has focused on multi-fidelity state estimation methods. Multi-fidelity approaches leverage complementary information from both low-fidelity models, such as simplified kinematics, inexpensive simulators, or approximate analytical models, and high-fidelity data sources, such as real sensor logs, physics-based simulators, or ground truth from motion capture [ 24 , 11 , 27 ] . By exploiting multiple fidelity levels, such approaches can achieve both data efficiency and generalization, using the lower-fidelity models to guide learning of highest fidelity high-fidelity corrections to ensure accuracy. Within this space, Gaussian processes, Bayesian hierarchical models, and neural operators have all been investigated as multi-fidelity surrogates [ 25 , 20 , 4 ] . Yet, most existing methods remain constrained by scalability challenges, limited real-time applicability, and weak handling of structured uncertainty [ 9 , 27 , 3 ] . These challenges motivate the need for a state estimator that operates effectively in dead-reckoning settings with minimal sensor suites, leverages multi-fidelity modeling to compensate for imperfect kinematic priors, and provides robust and adaptive uncertainty quantification suitable for real-time robotic deployment. In this work, we propose the Multi-Fidelity Residual Physics-Informed Neural Process (MFR-PINP), a neural process-based state estimation framework designed to address these challenges. The MFR-PINP extends the work in [ 14 ] by introducing a residual learning mechanism that explicitly models the discrepancy between simple, low-fidelity predictions and complex, high-fidelity ground-truth dynamics. This residual formulation enables the estimator to correct systematic biases introduced by approximate kinematic models while still benefiting from the inductive structure they provide. Furthermore, by embedding conformal prediction into the training and inference loop, the MFR-PINP delivers calibrated uncertainty sets that adapt to changes in real-world sensor behavior. The contributions of this work are twofold. • First, we introduce the MFR-PINP, a real-time, multi-fidelity residual learning framework that fuses physics-based low-fidelity priors with high-fidelity observational data for state estimation. • Second, we validate the proposed approach in a hybrid online learning setting, demonstrating its effectiveness in GPS-denied environments using only low-fidelity motion data at inference, while benchmarking against state-of-the-art baselines. By combining multi-fidelity modeling, physics-informed residual learning, and principled uncertainty calibration, the MFR-PINP establishes a novel approach for deploying real-time state estimation solutions onto autonomous robotic systems operating in challenging environments. The remainder of this paper is structured as follows. In Section II , we formally present the problem. In sections III and IV , we present the approach and outcomes, respectively. We make concluding remarks in Section V . II Problem Statement We consider the problem of learning the high-fidelity dynamics of a nonlinear robotic system represented as a vector field of coupled, discrete-time nonlinear dynamics of the form: \displaystyle x_{k+1}^{\text{high}} \displaystyle=f^{\text{high}}(x_{k}^{\text{high}},u_{k},\xi_{k},\Delta x_{k},\Delta k), (1) where x_{k}^{\text{high}}\in\mathbb{R}^{n} are the high-fidelity, fused system states and u_{k}\in\mathbb{R}^{m} are the control inputs. The vector \xi_{k}\in\mathbb{R}^{o} denotes time-varying sensor noise present within onboard utilized sensors, while \Delta x_{k}\in\mathbb{R}^{n} represents unmodeled disturbances acting on the system dynamics. The non-uniform time step \Delta k\in\mathbb{R}

Read the complete text