Model Recovery at the Edge under Resource Constraints for Physical AI
Bin Xu, Ayan Banerjee, Sandeep K.S. Gupta · 2025
Read Model Recovery at the Edge under Resource Constraints for Physical AI by Bin Xu, Ayan Banerjee, Sandeep K.S. Gupta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02283.txt.
Introduction
Self-driving and other safety-critical machines increasingly explain themselves by recovering the equations that govern them, a technique called model recovery. Bin Xu, Ayan Banerjee, and Sandeep Gupta tackle in 2025 the problem of running that recovery on small edge devices, where memory and energy are tight.
The obstacle is the method's engine, neural ordinary differential equations, whose iterative solving maps poorly onto FPGA hardware. The authors adapt model recovery to survive those resource constraints while staying real-time. Explainable decisions matter most exactly where edge devices operate, in physical systems whose failures are dangerous and whose reasoning must be auditable.
Catalog record
| CREATOR | Bin Xu, Ayan Banerjee, Sandeep K.S. Gupta |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-02283
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Model Recovery at the Edge under Resource Constraints for Physical AI Bin Xu, Ayan Banerjee, Sandeep K.S. Gupta Abstract Model Recovery (MR) enables safe, explainable decision-making in mission-critical autonomous systems (MCAS) by learning governing dynamical equations, but its deployment on edge devices is hindered by the iterative nature of neural ordinary differential equations (NODE), which are inefficient on FPGAs. Memory and energy consumption are the main concern of applying MR on edge devices for real-time running MR. We propose MERINDA, a novel FPGA-accelerated MR framework that replaces iterative solvers with a parallelizable neural architecture equivalent to NODEs. MERINDA achieves nearly 11× lower DRAM usage and 2.2× faster runtime compared to mobile GPUs. Experiments reveal an inverse relationship between memory and energy at fixed accuracy, highlighting MERINDA’s suitability for resource-constrained, real-time MCAS. “The implementation and datasets are publicly available at github.com/ImpactLabASU/ECAI2025 .” † † paperid: 123 † † orcid: 0000-0000-0000-0000 † † orcid: 0000-0001-6529-1644 † † orcid: 0000-0002-6108-5584 1 Introduction One of the fundamental advancements in the Artificial Intelligence (AI) revolution is physical AI where computational agents interact with physical systems for the purpose of control and continual learning [ 1 ] . Physics-guided predictive inference is central to the future of physical AI, where systems like autonomous vehicles and insulin delivery devices rely on real-time understanding of the underlying physical dynamics. A key technological innovation in physics-guided inference is the ability to extract first-principle–guided dynamical equations from real-world data of physical systems, a process known as model recovery (MR). As opposed to data-driven model learning, the recovered model is a digital twin (DT) that can be used for online monitoring of safety, integrity and unknown errors and feedback from forward simulation of the DT can be used by the system to adjust responses [ 2 , 3 ] . In this regard, an important requirement of MR techniques arises from the necessary response time of physical AI applications as shown in Table 1 . Given the data deluge problem in physical AI [ 4 ] , executing MR methods in cloud creates several bottlenecks related to data transfer (Table 1 shows that cloud data transfer time in most physical AI applications is close to response time), and energy which hampers response time and operational costs. A potential solution to the data deluge problem is edge AI, where inference is partially offloaded to edge devices to reduce data transfer, storage, and energy costs. However, this introduces higher computation costs, as edge devices (e.g., mobile GPUs) typically have far fewer computational resources compared to cloud GPUs. To the best of our knowledge, MR techniques have not been evaluated for their computational performances in the edge devices. In this paper, we focus on implementation of MR techniques in the edge under memory and energy constraints, characterize their response time performance, and evaluate the feasibility of using MR techniques in real time physical AI applications such as Table 1 . Recently, Koopman theory [ 5 ] has been used to develop sparse regression-based solutions for the MR problem with two broad classes of techniques: a) Sparse regression of nonlinear dynamics (SINDY) and its model predictive control version (SINDY-MPC) that deals with external inputs [ 6 ] , and b) a combination of sparse regression with initial state estimation using neural architectures such as physics-informed neural ordinary differential equation (PiNODE) [ 7 ] , physics-informed neural networks with sparse regression (PINN+SR) [ 8 ] , and Extraction of underlying Models with Implicit Dynamics (EMILY) [ 9 ] . Modern MR methods are typically accelerated using GPUs via standard multi-processing pipelines (e.g., PyTorch, TensorFlow). However, as seen in Table 1 , state-of-the-art (SOTA) multi-processing fail to meet response times of DT learning for various physical AI applications. This motivates a shift toward deploying MR on hardware acceleration devices such as Field Programmable Gate Arrays (FPGAs), which offer reconfigurable, time and energy-efficient execution. While there has been previous attempts at hardware acceleration of SINDY without forcing inputs [ el2024fpga , 19 , 18 ] , more generally applicable MR methods that are robust to external inputs, such as EMILY, and noise such as PINN+SR remain largely unexplored on FPGAs—highlighting a key research gap in edge-deployable physical AI. Table 1: Use of Digital Twins to provide feedback physical AI applications. The table lists application specific response time requirements and DT learning times in SOTA GPU system for EMILY [ 10 ] . Domain Hazard Feedback Response Time DT model GPU Time Transfer time Diabetes [ 10 ] Hypo-glycemia Change insulin rate 900s Bergman minimal metabolic model 1412s 27s Cardiac disease [ 11 , 12 ] Ischemia Alert first responders 100s ECG generative model 452s 81s Brain sensing [ 10 , 13 ] Attention deficit Audio-visual cues 33ms Resistance capacitance model 321s 125s In this paper, we address this gap by introducing architectural innovations that enable real-time, resource-aware MR on FPGAs, pushing the physical AI into the Edge AI domain. Several efforts have accelerated ODENet [ 14 ] and NODE architectures [ 15 ] , but these focus on fixed-depth models and lack the flexibility required by frameworks like PINN+SR, PiNODE, or EMILY. As shown in Fig. 1 , these approaches incorporate large, adaptive NODE layers whose forward passes involve solving high-dimensional ODEs—computationally intensive due to their iterative nature. While some works target standalone ODE solver acceleration [ 16 , 17 ] , they assume fixed coefficients and are unsuitable for dynamic, data-driven MR tasks like PiNODE, where model parameters vary across inputs. We leverage the theory of neural flows [ 25 ] to develop MERINDA (Model Recovery In Dynamic Architecture), an alternative neural structure that is mathematically equivalent to the NODE layers used in EMILY, PiNODE, and PINN+SR while being more amenable to FPGA acceleration (Fig. 1 ). Instead of using a conventional NODE layer, MERINDA employs a layer of invertible functions designed through a combination of Gated Recurrent Units (GRU) [ 26 ] and a dense layer of neurons with nonlinear activation functions, enabling efficient and high-speed computations. The key contributions include: Figure 1: FPGA acceleration strategy using neural flow based equivalent architecture to neural ODEs [ 27 ] . 1. Empirical Benchmarking: We compare MERINDA against state-of-the-art (SOTA) MR techniques, EMILY and PINN+SR, evaluating MR accuracy across four benchmark nonlinear systems, consisting of two real-world and two simulated datasets (see Sec. 4 ). 2. Performance Evaluation in Edge-AI Applications: We assess accuracy, processing speed, energy consumption, and DRAM footprint by comparing MERINDA with SINDY [ 20 ] and PINN+SR [ 21 ] in a real-world Automated Insulin Delivery (AID) application (see Sec. 4 ). 3. Comparison with GPU-Based Implementations: We analyze the advantages of MERINDA’s FPGA acceleration by benchmarking it against GPU-based implementations of all three approaches (EMILY, PINN+SR, and SINDY) (see Sec. 4 ). 4. Exploration of the Energy-Memory Tradeoff in MERINDA: We demonstrate that MERINDA exhibits an inherent trade-off between energy consumption and memory usage when maintaining accuracy constraints (see Sec. 3.2 ). 2 Theoretical background This section introduces the fundamentals of MR and establishes the approximate equivalence between neural flow architectures and NODEs. Basics of Model Recovery The primary objective of MR is similar to an auto-encoder (Fig. 1 ), where given a