Enabling Physical AI at the Edge: Hardware-Accelerated Recovery of System Dynamics
Bin Xu, Ayan Banerjee, Sandeep Gupta · 2025
Read Enabling Physical AI at the Edge: Hardware-Accelerated Recovery of System Dynamics by Bin Xu, Ayan Banerjee, Sandeep Gupta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23767.txt.
Introduction
Bin Xu, Ayan Banerjee, and Sandeep Gupta bring equation discovery to small edge devices. Self-driving systems in the field must understand and predict physical dynamics in real time, under tight limits on latency, computing power, and energy. Model recovery, identifying a system's governing equations from sensor data, gives safe, explainable monitoring, but leading methods lean on neural ordinary differential equations whose iterative solvers resist hardware acceleration.
Their framework, MERINDA, reformulates the problem for an FPGA chip: recurrent GRU-based dynamics replace the neural ODE, joined by dense inverse-ODE layers, sparsity-driven dropout, and lightweight solvers, all arranged for streaming parallelism. Across four benchmark nonlinear systems, MERINDA matched state-of-the-art recovery accuracy while using over a hundred times less energy than GPU versions, a far smaller memory footprint, and faster training. The work appeared at the Asilomar Conference.
Catalog record
| CREATOR | Bin Xu, Ayan Banerjee, Sandeep Gupta |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23767
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enabling Physical AI at the Edge: Hardware-Accelerated Recovery of System Dynamics Bin Xu, Ayan Banerjee, Sandeep Gupta Abstract Physical AI at the edge—enabling autonomous systems to understand and predict real-world dynamics in real-time—demands efficient hardware acceleration. Model recovery (MR), which extracts governing equations from sensor data, is critical for safe and explainable monitoring in mission-critical autonomous systems (MCAS) operating under severe time, compute, and power constraints. While Field Programmable Gate Arrays (FPGAs) offer promising reconfigurable hardware for edge deployment, state-of-the-art (SOTA) MR methods like EMILY and PINN+SR rely on Neural ODEs requiring iterative solvers that resist hardware acceleration. This paper presents MERINDA (Model Recovery in Dynamic Architecture), an FPGA-accelerated framework specifically designed to enable physical AI at the edge. MERINDA replaces computationally expensive Neural Ordinary Differential Equation (ODE) components with a hardware-friendly architecture combining: (a) Gated Recurrent Unit (GRU) layers for discretized dynamics, (b) dense inverse ODE layers, (c) sparsity-driven dropout, and (d) lightweight ODE solvers—with critical components fully parallelized on FPGA. Evaluated on four benchmark nonlinear dynamical systems, MERINDA achieves transformative improvements over Graphics Processing Unit (GPU) implementations: 114× reduction in energy consumption (434J vs. 49,375J), 28× smaller memory footprint (214MB vs. 6,118MB), and 1.68× faster training —while maintaining model recovery accuracy equivalent to SOTA methods. These results validate MERINDA’s capability to bring physical AI to resource-constrained edge devices for real-time autonomous system monitoring. I Introduction Physical AI [ 7 ] at the edge is revolutionizing autonomous systems by enabling real-time understanding of physical dynamics directly on resource-constrained devices. Unlike traditional cloud-based AI, edge deployment demands extreme efficiency in energy, memory, and latency—particularly critical for MCAS such as automated insulin delivery (AID), autonomous vehicles, and robotic systems where decisions must be made in milliseconds with minimal power consumption. Data-driven inference for physical systems falls into two paradigms: (a) model learning (ML), which fits black-box neural networks to sensor data, and (b) model recovery (MR), which extracts interpretable governing equations—as exemplified by PiNODE [ 21 ] , PINN+SR [ 6 ] , and EMILY [ 1 , 2 , 26 ] . While ML offers predictive power, MR provides explainability and physical insight essential for safety-critical applications. Fig. 1: Optimization Framework of MERINDA. At the high level, we reformulate MR by replacing the iterative ODE solver in Liquid Time-Constant networks(LTC) with a GRU-based neural flow. At the low level, we specialize the GRU-based MR for FPGA by fine-grained spatial parallelism. The Edge AI [ 11 , 27 , 25 ] Challenge: Deploying MR at the edge faces a fundamental bottleneck. Current SOTA methods rely on Neural ODEs (NODEs), requiring iterative solvers that consume orders of magnitude more energy and time than standard neural networks. Case Study: AID. Consider a wearable insulin pump for Type 1 Diabetes patients. The device must continuously learn personalized glucose–insulin dynamics to adapt to changing physiology, meals, and exercise, requiring model updates every five minutes. A GPU-based solution consuming 29,943.68 J per training cycle would require more than seven times the energy stored in a typical smartwatch battery (3.7 V, 300 mAh \approx 4 kJ), making even a single on-device update infeasible. In contrast, MERINDA requires only 261.79 J per update, enabling approximately fifteen full training cycles per battery charge. This shifts continuous on-device learning from impractical to deployable for medical wearables. TABLE I: MERINDA Performance Summary: Enabling Physical AI at the Edge (Hidden Size 16, Model Recovery Task) Metric GPU FPGA (MERINDA) Speedup Training Time (s) 163.51 55.23 2.96 \times faster Energy (J) 29,943.68 261.79 114 \times less DRAM (MB) 5,862.32 211.29 28 \times smaller Accuracy (MSE) 3.18 5.37 Comparable Hardware Acceleration Challeng: Traditional time-series ML accelerators succeed because of structured, discretized Recurrent Neural Network (RNN) operations implementable via matrix multiplications and specialized units like CORDIC [ 5 ] . However, SOTA MR methods (EMILY, PINN+SR, PiNODE) rely on Neural ODE layers requiring iterative solvers that resist parallelization (Fig. 2 ). Prior ODENet acceleration efforts [ 24 , 4 ] assume fixed architectures, while real MR demands adaptive NODE depth. Existing ODE solver accelerators [ 22 , 8 ] assume static coefficients, incompatible with learning-based methods where ODEs change during training. Fig. 2: FPGA acceleration strategy using neural flow based equivalent architecture to neural ODEs. FPGAs offer a promising solution through reconfigurable, energy-efficient hardware acceleration. While FPGA-based ML acceleration has been extensively studied [ 9 , 16 , 28 ] , MR acceleration remains largely unexplored due to the difficulty of parallelizing adaptive ODE solvers. This gap prevents physical AI from achieving its full potential at the edge, where recent trends in Edge AI and on-device intelligence [ 12 ] demonstrate growing demand. This paper presents MERINDA, a novel framework (Fig. 1 ) that makes physical AI practical at the edge through FPGA acceleration. Leveraging neural flow theory [ 3 ] which is shown in Fig. 2 , we replace computationally expensive NODE layers with hardware-friendly invertible functions using GRU and dense neural layers—achieving theoretical equivalence while enabling massive parallelization on reconfigurable hardware. Our work demonstrates that physical AI can operate efficiently on edge devices with dramatic improvements, which is shown in Tab. I . Key Contributions: 1. Hardware-Accelerated Physical AI Framework (Fig. 1 ): We present the first FPGA-accelerated model recovery architecture achieving GPU-equivalent accuracy with order-of-magnitude improvements in energy efficiency and memory footprint—validated on four benchmark nonlinear systems including real-world automated insulin delivery. 2. Comprehensive Performance Analysis: We compare MERINDA against three paradigms (ML, physics-guided ML, and full MR) on both FPGA and GPU platforms, revealing fundamental trade-offs between accuracy, latency, energy, and memory—providing practitioners with actionable deployment guidance. II Theoretical background This section presents basics of MR and establishes approximate equivalence of neural flow architecture with NODE. II-A Basics of Model Recovery The main goal of MR is akin to an auto-encoder (Figure 2 ), where given a multivariate time series signal X(t) , the aim is to find a latent space representation that can be used to reconstruct an estimation \tilde{X}(t) with low error. It has the traditional encoder \phi(t) and decoder ( \Psi(t) ) of an autoencoder architecture. MR represents the measurements X of dimension n and N samples, as a set of nonlinear ordinary differential equation model in Eqn: 1 . \scriptsize\dot{X}=h(X,U,\theta), (1) where h is a parameterized non-linear function, U is the m dimensional external input, and \theta is the p dimensional coefficient set of the nonlinear ODE model. Sparsity: An n -dimensional model with M^{th} order non-linearity can utilize \binom{M+n}{n} non-linear terms. A sparse model only includes a few non-linear terms p<<\binom{M+n}{n} . Sparsity structure of a model is the set of non-linear terms used by it. Identifiable model: A model in Eqn. 1 is identifiable [ 23 ] , if \exists time t_{I}>0 , such that \forall\theta,\tilde{\theta}\in\mathcal{R}^{p} : \scriptsize\forall t\in[0,t_{I}],f(X(t),U(t),\theta)=f(X(t),U(t),\tilde{\theta})\implies\theta=\tilde{\theta}. (2) Eqn. 2 effectively means that a model is identifiable if two different model coefficients do not result in identical measurement X . In simpler terms this means \forall\theta_{i}\in\theta,\frac{dX}{d\theta_{i}}\neq 0 . In this paper, we assume that the underlying model is identifiable. Problem 1 (Sparse Model Recovery) . Given N samples of measurements X and inputs U , obtained from a sparse model in Eqn. 1 such that \theta is identifiable, recover \tilde{\theta} such that for