Time Resolution Independent Operator Learning

Diab W. Abueidda, Mbebo Nonna, Panos Pantidis, Mostafa E. Mobasher · 2025

Read Time Resolution Independent Operator Learning by Diab W. Abueidda, Mbebo Nonna, Panos Pantidis, Mostafa E. Mobasher (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02524.txt.

Introduction

Diab Abueidda, Mbebo Nonna, Panos Pantidis, and Mostafa Mobasher wrote this paper in two thousand twenty-five. It learns solution operators for time-based partial differential equations from sparse, uneven data, free of any fixed time grid.

Their network, NCDE-DeepONet, puts a neural controlled differential equation in the branch net. The load history is coded as the path of that equation, driven by a smooth curve through the samples, so any sampling rate gives the same code. The trunk net takes raw space and time points, so answers can be asked on new meshes and steps with no retraining. Tests on heat, elastic, and coupled heat-elastic tasks show fast, sound forecasts.

Catalog record

CREATORDiab W. Abueidda, Mbebo Nonna, Panos Pantidis, Mostafa E. Mobasher
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-02524

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Time Resolution Independent Operator Learning Diab W. Abueidda, Mbebo Nonna, Panos Pantidis, Mostafa E. Mobasher Abstract Accurately learning solution operators for time-dependent partial differential equations (PDEs) from sparse and irregular data remains a challenging task. Recurrent DeepONet extensions inherit the discrete-time limitations of sequence-to-sequence (seq2seq) RNN architectures, while neural-ODE surrogates cannot incorporate new inputs after initialization. We introduce NCDE - DeepONet , a continuous - time operator network that embeds a Neural Controlled Differential Equation (NCDE) in the branch and augments the trunk with explicit space–time coordinates. The NCDE encodes an entire load history as the solution of a controlled ODE driven by a spline-interpolated input path, making the representation input-resolution-independent : it encodes different input signal discretizations of the observed samples. The trunk then probes this latent path at arbitrary spatial locations and times, rendering the overall map output - resolution independent : predictions can be queried on meshes and time steps unseen during training without retraining or interpolation. Benchmarks on transient Poisson, elastodynamic, and thermoelastic problems confirm the robustness and accuracy of the framework, achieving almost instant solution prediction. These findings suggest that controlled dynamics provide a principled and efficient foundation for high-fidelity operator learning in transient mechanics. Keywords Neural differential equations \cdot Ordinary differential equations \cdot Operator learning \cdot Thermoelasticity \cdot Elastodynamics 1 Introduction Deep learning techniques for operator learning have enabled data-driven modeling of complex physical systems by approximating mappings between function spaces. Modeling transient mechanics problems often requires learning the relationship between temporal inputs and outputs. Traditional neural network approaches, such as multilayer perceptrons (MLPs), are not naturally suited to this task because they operate on fixed-size input-output pairs and lack an inherent mechanism for sequential dependence [ 1 , 2 , 3 ] . Recurrent neural networks (RNNs) introduce a hidden state to capture sequence history. Recurrent neural networks (RNNs) such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) have recently been applied to capture nonlinear, history-dependent behavior in solid mechanics [ 1 , 2 , 3 , 4 , 5 ] . However, their discrete-time updates and training challenges (e.g., vanishing gradients and sensitivity to time-step size) can limit accuracy and stability [ 6 , 7 , 8 ] . Sequence - to - sequence (seq2seq) surrogates show rigidity. Specifically, learned networks are locked to the temporal grid seen during training and cannot refine predictions at unseen times or accommodate irregularly sampled data, which severely limits their usefulness in transient mechanics applications [ 2 , 9 , 10 ] . Additionally, standard RNN-based surrogates for history-dependent material models have been shown to produce oscillatory or inconsistent results under perturbations in the input, failing to converge when embedded in numerical solvers [ 2 , 11 , 9 , 5 ] . These limitations motivate the search for modeling frameworks that can more naturally handle continuous-time dynamics and complex temporal dependencies. Neural ordinary differential equations (NODEs) offer a promising paradigm for continuous-time modeling. A NODE treats the evolution of a neural network’s hidden state as an initial value problem defined by an ordinary differential equation, essentially providing a continuous-depth generalization of deep networks like residual networks [ 12 , 13 ] . In a NODE, the hidden state \boldsymbol{z}(t) is defined by a learned vector field—its detailed formulation is provided in Section 2.2 —where the state evolves from an initial condition \boldsymbol{z}(t_{0})=\boldsymbol{z}_{0} . This formulation ties the model’s forward pass to the solution of an ODE, which can yield advantages in parameter efficiency [ 14 ] and in capturing smooth dynamics [ 15 , 16 , 17 ] . However, a key drawback is that the trajectory of a NODE is entirely determined by its initial condition, with no mechanism to adjust the state based on new input information during the evolution [ 6 ] . In other words, once the integration starts, the NODE cannot directly ingest time-varying external forcing or additional observations. This contrasts with an RNN, wherein the hidden state is updated at discrete time steps based on the current input \boldsymbol{X}_{n} (a detailed formulation is provided in Section 2.2 ). The lack of a similar input injection in NODEs makes them insufficient for many transient mechanics problems—especially those driven by sequential loads or boundary conditions—unless one resorts to ad-hoc techniques. Neural controlled differential equations (NCDEs) have been introduced as a continuous-time generalization of RNNs to overcome the above limitation [ 6 , 18 ] . Just as NODEs are the continuous analog of residual networks, a Neural CDE serves as the continuous-time counterpart of an RNN [ 6 ] . In an NCDE, the hidden state \boldsymbol{z}(t) evolves according to a controlled ordinary differential equation driven by the input function. This construction provides a principled way to incorporate external time-dependent inputs into the model: the hidden state is continuously adjusted based on changes in the input, rather than solely on its initial value. As a result, NCDEs can naturally process incoming data that may be irregularly sampled or varying in time [ 6 , 19 ] , while maintaining the smooth interpolation capabilities of ODE-based models [ 6 ] . The NCDE approach essentially equips the network with a form of memory and the ability to handle complex temporal patterns, much like an RNN, but in a mathematically continuous framework [ 20 , 21 ] . This makes NCDEs well-suited for capturing the causal, path-dependent behavior inherent in transient physical systems [ 22 , 23 ] . Deep operator networks (DeepONets) provide a complementary perspective by focusing on learning operators – mappings between function spaces – rather than simple point-to-point mapping [ 24 , 25 , 26 ] . DeepONet employs a dual-network architecture – a branch network to encode the input function and a trunk network to encode the query location (e.g., temporal or spatial coordinates) for the output, thereby effectively parametrizing the input and output function spaces. The network achieves this by combining the processed features from both networks through a Hadamard product operation, resulting in a flexible framework capable of handling various partial differential equations and functional relationships [ 27 , 28 , 29 , 30 , 31 ] . Notable advantages of DeepONet include its ability to maintain accuracy across different discretization schemes and its capacity to generalize to unseen input functions. Additionally, this construction of the DeepONet enables it to learn solution operators from relatively small datasets. Hence, DeepONet is becoming particularly valuable for applications in scientific computing and engineering simulations, where rapid and accurate solution approximations are essential [ 32 , 30 , 33 ] . Various extensions of the basic DeepONet framework replace the standard MLP-based branch and trunk networks with specialized architectures to better capture problem-specific structure. For instance, convolution-based DeepONets have been proposed (e.g., using CNNs in the branch net) to exploit local spatial correlations and translation invariance in input functions, thereby improving sample efficiency and generalization on high-dimensional fields [ 34 , 35 ] . Additionally, to handle complex, spatially varying outputs, He et al. [ 36 ] devised a DeepONet variant using a residual U-Net (ResUNet) as the trunk network, replacing the fully connected trunk, which enables the model to effectively encode intricate input geometries when predicting elastoplastic

Read the complete text