Enabling Physical AI at the Edge: Hardware-Accelerated Recovery of System Dynamics Bin Xu, Ayan Banerjee, Sandeep Gupta Abstract Physical AI at the edge—enabling autonomous systems to understand and predict real-world dynamics in real-time—demands efficient hardware acceleration. Model recovery (MR), which extracts governing equations from sensor data, is critical for safe and explainable monitoring in mission-critical autonomous systems (MCAS) operating under severe time, compute, and power constraints. While Field Programmable Gate Arrays (FPGAs) offer promising reconfigurable hardware for edge deployment, state-of-the-art (SOTA) MR methods like EMILY and PINN+SR rely on Neural ODEs requiring iterative solvers that resist hardware acceleration. This paper presents MERINDA (Model Recovery in Dynamic Architecture), an FPGA-accelerated framework specifically designed to enable physical AI at the edge. MERINDA replaces computationally expensive Neural Ordinary Differential Equation (ODE) components with a hardware-friendly architecture combining: (a) Gated Recurrent Unit (GRU) layers for discretized dynamics, (b) dense inverse ODE layers, (c) sparsity-driven dropout, and (d) lightweight ODE solvers—with critical components fully parallelized on FPGA. Evaluated on four benchmark nonlinear dynamical systems, MERINDA achieves transformative improvements over Graphics Processing Unit (GPU) implementations: 114× reduction in energy consumption (434J vs. 49,375J), 28× smaller memory footprint (214MB vs. 6,118MB), and 1.68× faster training —while maintaining model recovery accuracy equivalent to SOTA methods. These results validate MERINDA’s capability to bring physical AI to resource-constrained edge devices for real-time autonomous system monitoring. I Introduction Physical AI [ 7 ] at the edge is revolutionizing autonomous systems by enabling real-time understanding of physical dynamics directly on resource-constrained devices. Unlike traditional cloud-based AI, edge deployment demands extreme efficiency in energy, memory, and latency—particularly critical for MCAS such as automated insulin delivery (AID), autonomous vehicles, and robotic systems where decisions must be made in milliseconds with minimal power consumption. Data-driven inference for physical systems falls into two paradigms: (a) model learning (ML), which fits black-box neural networks to sensor data, and (b) model recovery (MR), which extracts interpretable governing equations—as exemplified by PiNODE [ 21 ] , PINN+SR [ 6 ] , and EMILY [ 1 , 2 , 26 ] . While ML offers predictive power, MR provides explainability and physical insight essential for safety-critical applications. Fig. 1: Optimization Framework of MERINDA. At the high level, we reformulate MR by replacing the iterative ODE solver in Liquid Time-Constant networks(LTC) with a GRU-based neural flow. At the low level, we specialize the GRU-based MR for FPGA by fine-grained spatial parallelism. The Edge AI [ 11 , 27 , 25 ] Challenge: Deploying MR at the edge faces a fundamental bottleneck. Current SOTA methods rely on Neural ODEs (NODEs), requiring iterative solvers that consume orders of magnitude more energy and time than standard neural networks. Case Study: AID. Consider a wearable insulin pump for Type 1 Diabetes patients. The device must continuously learn personalized glucose–insulin dynamics to adapt to changing physiology, meals, and exercise, requiring model updates every five minutes. A GPU-based solution consuming 29,943.68 J per training cycle would require more than seven times the energy stored in a typical smartwatch battery (3.7 V, 300 mAh \approx 4 kJ), making even a single on-device update infeasible. In contrast, MERINDA requires only 261.79 J per update, enabling approximately fifteen full training cycles per battery charge. This shifts continuous on-device learning from impractical to deployable for medical wearables. TABLE I: MERINDA Performance Summary: Enabling Physical AI at the Edge (Hidden Size 16, Model Recovery Task) Metric GPU FPGA (MERINDA) Speedup Training Time (s) 163.51 55.23 2.96 \times faster Energy (J) 29,943.68 261.79 114 \times less DRAM (MB) 5,862.32 211.29 28 \times smaller Accuracy (MSE) 3.18 5.37 Comparable Hardware Acceleration Challeng: Traditional time-series ML accelerators succeed because of structured, discretized Recurrent Neural Network (RNN) operations implementable via matrix multiplications and specialized units like CORDIC [ 5 ] . However, SOTA MR methods (EMILY, PINN+SR, PiNODE) rely on Neural ODE layers requiring iterative solvers that resist parallelization (Fig. 2 ). Prior ODENet acceleration efforts [ 24 , 4 ] assume fixed architectures, while real MR demands adaptive NODE depth. Existing ODE solver accelerators [ 22 , 8 ] assume static coefficients, incompatible with learning-based methods where ODEs change during training. Fig. 2: FPGA acceleration strategy using neural flow based equivalent architecture to neural ODEs. FPGAs offer a promising solution through reconfigurable, energy-efficient hardware acceleration. While FPGA-based ML acceleration has been extensively studied [ 9 , 16 , 28 ] , MR acceleration remains largely unexplored due to the difficulty of parallelizing adaptive ODE solvers. This gap prevents physical AI from achieving its full potential at the edge, where recent trends in Edge AI and on-device intelligence [ 12 ] demonstrate growing demand. This paper presents MERINDA, a novel framework (Fig. 1 ) that makes physical AI practical at the edge through FPGA acceleration. Leveraging neural flow theory [ 3 ] which is shown in Fig. 2 , we replace computationally expensive NODE layers with hardware-friendly invertible functions using GRU and dense neural layers—achieving theoretical equivalence while enabling massive parallelization on reconfigurable hardware. Our work demonstrates that physical AI can operate efficiently on edge devices with dramatic improvements, which is shown in Tab. I . Key Contributions: 1. Hardware-Accelerated Physical AI Framework (Fig. 1 ): We present the first FPGA-accelerated model recovery architecture achieving GPU-equivalent accuracy with order-of-magnitude improvements in energy efficiency and memory footprint—validated on four benchmark nonlinear systems including real-world automated insulin delivery. 2. Comprehensive Performance Analysis: We compare MERINDA against three paradigms (ML, physics-guided ML, and full MR) on both FPGA and GPU platforms, revealing fundamental trade-offs between accuracy, latency, energy, and memory—providing practitioners with actionable deployment guidance. II Theoretical background This section presents basics of MR and establishes approximate equivalence of neural flow architecture with NODE. II-A Basics of Model Recovery The main goal of MR is akin to an auto-encoder (Figure 2 ), where given a multivariate time series signal X(t) , the aim is to find a latent space representation that can be used to reconstruct an estimation \tilde{X}(t) with low error. It has the traditional encoder \phi(t) and decoder ( \Psi(t) ) of an autoencoder architecture. MR represents the measurements X of dimension n and N samples, as a set of nonlinear ordinary differential equation model in Eqn: 1 . \scriptsize\dot{X}=h(X,U,\theta), (1) where h is a parameterized non-linear function, U is the m dimensional external input, and \theta is the p dimensional coefficient set of the nonlinear ODE model. Sparsity: An n -dimensional model with M^{th} order non-linearity can utilize \binom{M+n}{n} non-linear terms. A sparse model only includes a few non-linear terms p<<\binom{M+n}{n} . Sparsity structure of a model is the set of non-linear terms used by it. Identifiable model: A model in Eqn. 1 is identifiable [ 23 ] , if \exists time t_{I}>0 , such that \forall\theta,\tilde{\theta}\in\mathcal{R}^{p} : \scriptsize\forall t\in[0,t_{I}],f(X(t),U(t),\theta)=f(X(t),U(t),\tilde{\theta})\implies\theta=\tilde{\theta}. (2) Eqn. 2 effectively means that a model is identifiable if two different model coefficients do not result in identical measurement X . In simpler terms this means \forall\theta_{i}\in\theta,\frac{dX}{d\theta_{i}}\neq 0 . In this paper, we assume that the underlying model is identifiable. Problem 1 (Sparse Model Recovery) . Given N samples of measurements X and inputs U , obtained from a sparse model in Eqn. 1 such that \theta is identifiable, recover \tilde{\theta} such that for \tilde{X} generated from f(X,U,\tilde{\theta}) , we have ||X-\tilde{X}||\leq\epsilon , where \epsilon is the maximum tolerable error. Role of NODE: Both EMILY [ 1 ] and PINN+SR [ 6 ] utilize a layer of NODE cells in order to integrate the underlying non-linear ODE dynamics. NODE cell’s forward pass is by design the integration of the function h over time horizon T with N samples (Fig. 2 ). This effectively requires an ODE solver in each cell of the NODE layer: \scriptsize z(t)=\int\limits^{T}_{0}{h(z,u,\theta)dt}, (3) where z\in Z and u\in U are each cells output and input. The results are then used further in the EMILY or PINN+SR pipeline to extract the accurate underlying non-linear ODE model. II-B Neural flows and equivalent architectures to NODE According to the theory of neural flows [ 3 ] , the node layer can be replaced by an approximate solution to F(t)\approx Z(t) in discretized form using recurrent nerual network architectures such as GRU provided that following conditions are satisfied: F(0,u)=Z(0,u),\text{(initial condition), and }F(t,u)\text{ is invertible}. (4) Bilovs et al. [ 3 ] show that F(t,u) can be achieved by replacing the original NODE layer by a GRU layer. However, the GRU layer does not statisfy by the invertible condition. The authors in [ 3 ] suggest the usage of a dense layer since it acts as a universal approximator of nonlinear functions and hence can also act as the inversion of the function F(t,u) . MERINDA further enhances the equivalent architecture proposed in [ 3 ] by further pruning the dense layer as shown in Figure 3 . The main idea is to further reduce the dense layer structure by utilizing the inherent sparsity in the data. Given the definitions of identifiability and sparsity, we now discuss our full architecture that is equivalent to PiNODE III MERINDA Architecture In our approach (Fig. 3 ), we extend gated recurrent unit neural network (GRU-NN) to obtain advanced neural structure MERINDA that can solve the model recovery problem. The forward pass of GRU-NN structure expresses the coefficients of the model as a nonlinear function of the outputs Y and inputs U of the model. The measurements of Y , can be used to convert the set of implicit dynamics to an overdetermined system of equations that are nonlinear in terms of the model coefficients. As such an over-determined system of equation may have no solution unless either some equations are rejected or are expressed as linear superposition of other equations. To search for a set of consistent equations to estimate model coefficient, a dense layer is utilized. The search process of the dense layer is guided by a loss function ( ODE loss ) that computes the mean square error between the estimated Y_{est} using an Ordinary Differential Equation (ODE) solver \mathbf{SOLVE}(Y(0),\Theta,U) and the ground truth measurements Y . Fig. 3: MERINDA: Gated recurrent unit (GRU) NN-based MR architecture. The advanced neural architectures for model recovery in Fig. 3 is implemented by extending the base code available in [ 13 ] . We extract the training data consisting of temporal traces of Y , and U . Y is sampled at least at the Nyquist rate for the application, and U has the same sampling rate as Y . The resulting training data is then divided into batches of size S_{B} . This forms a 3 D tensor of size S_{B}\times|Y|+m\times k . Each batch is passed through the GRU-NN network with V nodes, resulting in V hidden states. A dense layer is then employed to transform these V hidden states into p=|\Theta| model coefficient estimates and q input shift values. The dense layer is a multi-layer perceptron with ReLU activation function for the model coefficient estimate nodes, whose outputs are the estimated model coefficients. The dense layer converts the V dimensional hidden layer outputs to M+|X|\choose|X| which is the number of non-linear terms that can be used for an M th order polynomial. A dropout rate of |\Theta| is used so that the final number of output layers with non-zero activation is |\Theta| . The model coefficient estimates and the initial value Y(0) is passed through an ODE solver to solve the nonlinear dynamical equations with the coefficients \Theta_{est} , initial conditions Y(0) and inputs U . The Runge Kutta integration method is used in the ODE solver, which gives Y_{est} . In the backpropagation phase the network loss is appended with ODE loss, which is the mean square error between the original trace Y and estimated trace Y_{est} . III-A Accelerator Design Exploration III-A 1 Computation Optimization To achieve high-throughput GRU computation on hardware, we use a deeply pipelined architecture that allows a new GRU cell to start every clock cycle. Applying #pragma HLS PIPELINE II=1 on the outer loop over time ensures an initiation interval (II) of 1 for the entire GRU cell. Inside the GRU cell, each stage—such as computing the reset gate, update gate, and the new hidden state—is decomposed into smaller element-wise operations instead of one large matrix–vector computation. This exposes fine-grained parallelism. We apply #pragma HLS UNROLL to the inner loops so that operations across the input and hidden dimensions run fully in parallel, effectively forming parallel multiply–accumulate (MAC) arrays. To further improve throughput, we use #pragma HLS DATAFLOW so that independent stages execute concurrently and communicate through streaming FIFOs. This overlaps work between different compute stages and across successive time steps. By combining dataflow pipelining, loop pipelining, and loop unrolling, the GRU design becomes latency-insensitive and reaches a throughput determined solely by the optimized initiation interval of 1. III-A 2 Memory Optimization To reduce off-chip memory access and improve data locality, we place frequently used variables in on-chip buffers using HLS pragmas. The hidden state buffer, which is reused across timesteps, is fully partitioned with #pragma HLS ARRAY_PARTITION complete to allow parallel access to all hidden units. Temporary values used within each GRU computation step are selectively mapped to either registers or BRAM which is on-chip memory on FPGA based on their access patterns and reuse needs. Frequently accessed data is stored in registers for low-latency access, while larger or less frequently accessed data is placed in BRAM to balance storage efficiency and routing complexity. The updated hidden state is directly forwarded to subsequent layers without sending it back to off-chip memory, further reducing bandwidth usage. Combined with loop pipelining and dataflow execution, these memory optimizations help maintain a one-cycle initiation interval (II=1), enabling high-throughput FPGA execution. III-B MILP-Based Platform and Task Optimization Strategy In this paper, we propose a Mixed-Integer Linear Programming (MILP) approach to identify the optimal platform (FPGA or GPU), task type (ML, ML-PG, or MR), and corresponding hyperparameter configurations. The motivation for applying MILP to MERINDA is to systematically explore a broader design space and determine configurations that best align with real-world deployment constraints—such as energy, latency, and accuracy—enabling resource-aware model recovery in mission-critical settings. For the equations below, Hi represents the hidden layer size, E denotes the number of epochs, sq is the sequence length (input size), P represents power, M denotes memory, \varepsilon is the error and R is the threshold of time. We set the objective to find out the trade-off between power and memory with constraints in error f_{e}(a,h,hi,e,N) and time t_{\text{ex}}(a,h,hi,e,N) . We employ Ridge regression strategy [ 18 ] on polynomial library functions to model the error f_{e}(a,h,hi,e,N) , execution time t_{\text{ex}}(a,h,hi,e,N) , power f_{p}(hi,e,N) , and memory f_{m}(hi,e,N) which are cubic functions. Input: \vec{X}=\begin{bmatrix}x_{1}&x_{2}&\cdots&x_{n}\end{bmatrix} Platforms: a\in A=\{0,1\} (0\rightarrow\text{FPGA},\,1\rightarrow\text{GPU}) Tasks: h\in H=\{0,1,2\} (0\rightarrow\text{ML},\,1\rightarrow\text{ML + PG},\,2\rightarrow\text{MR}) Hyper: hi\in\text{Hi}=\{16,32,64,128\},\,e\in E=\{16,32,64,128\}, N\in\text{sq}=\{50,100,200\} Objective: O=\gamma P+(1-\gamma)M,\,P=f_{p}(hi,e,N), M=f_{m}(hi,e,N) Goal: \left\lVert\hat{x}t-xt\right\rVert\leq\varepsilon Constraints: f_{e}(a,h,hi,e,N)<\varepsilon,\hskip 8.19447ptt_{\text{ex}}(a,h,hi,e,N)