Bridging Sequential Deep Operator Network and Video Diffusion: Residual Refinement of Spatio-Temporal PDE Solutions

Jaewan Park 1,2, Farid Ahmed 1,3, Kazuma Kobayashi 1,3, Seid Koric 1,2, Syed Bahauddin Alam 1,3, Iwona Jasiuk 2, Diab Abueidda 1,4 · 2025

Read Bridging Sequential Deep Operator Network and Video Diffusion: Residual Refinement of Spatio-Temporal PDE Solutions by Jaewan Park 1,2, Farid Ahmed 1,3, Kazuma Kobayashi 1,3, Seid Koric 1,2, Syed Bahauddin Alam 1,3, Iwona Jasiuk 2, Diab Abueidda 1,4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06133.txt.

Introduction

Jaewan Park and six co-authors hone physics runs with video diffusion in twenty twenty-five. Video diffusion models lead the pack in work that makes or fills in frames, thanks to how firm and true they stay. The team turns them to a new use: as stand ins for fields ruled by partial differential equations. A two stage build splits the load in two halves.

First, a step by step deep operator network turns out a rough fix that hews to the laws of physics. It starts from the edge terms or the load terms of the task. A video diffusion model, fed the rough fix, then learns just the rest: the gap to the true fix. That gap is much more small than the full fix, so the model can spend its strength on fine points. Sharp, fast change traits gain the most from that aim.

Catalog record

CREATORJaewan Park 1,2, Farid Ahmed 1,3, Kazuma Kobayashi 1,3, Seid Koric 1,2, Syed Bahauddin Alam 1,3, Iwona Jasiuk 2, Diab Abueidda 1,4
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06133

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Sequential Deep Operator Network and Video Diffusion: Residual Refinement of Spatio-Temporal PDE Solutions Jaewan Park 1,2, Farid Ahmed 1,3, Kazuma Kobayashi 1,3, Seid Koric 1,2, Syed Bahauddin Alam 1,3, Iwona Jasiuk 2, Diab Abueidda 1,4 Abstract Video-diffusion models have recently set the standard in video generation, inpainting, and domain translation thanks to their training stability and high perceptual fidelity. Building on these strengths, we adopt and train conditional video diffusion as a surrogate for spatio-temporal solution fields governed by partial differential equations (PDEs). Our two-stage surrogate first applies a Sequential Deep Operator Network (S-DeepONet) to produce a coarse, physics-consistent prior from the prescribed boundary or loading conditions. The prior is then passed, together with the original input function, to a conditional video diffusion model that learns only the residual: the point-wise difference between the ground truth and the S-DeepONet prediction. By shifting the learning burden from the full solution to its much smaller residual space, this innovative approach enables diffusion to focus on sharpening high-frequency solution structures without sacrificing global coherence. The framework is assessed on two disparate benchmarks: (i) vortex-dominated lid-driven cavity flow and (ii) tensile plastic deformation of dog-bone specimens. Across these data sets the hybrid surrogate consistently outperforms its single-stage counterpart, cutting the mean relative L 2 L_{2} error from 4.57% to 0.83% for the flow problem and from 4.42% to 2.94% for plasticity, a relative improvements of 81.8% and 33.5% respectively. The hybrid approach not only lowers quantitative errors but also improves visual quality, visibly recovering sharp transients and fine spatial details. These novel results show that (i) conditioning diffusion on a physics-aware prior enables faithful reconstruction of localized, high-gradient features, (ii) residual learning simplifies the target distribution, accelerating convergence and enhancing accuracy, and (iii) the same architecture transfers seamlessly from incompressible turbulent flow to nonlinear elasto-plasticity without any problem-specific architectural modifications, highlighting its broad applicability to nonlinear, time-dependent phenomena in engineering and science. *[inlinelist,1]label=(), 1 Introduction Neural operator networks have emerged over the past five years as a powerful class of function-to-function surrogates: given boundary data, material coefficients, load histories or previous solution fields, they learn the entire solution operator and return full spatio-temporal fields in a single forward pass [ 1 ] . Due to their nature to retrieve full solution fields, neural operator networks are widely used as a powerful surrogate paradigm for computationally heavy numerical simulations [ 2 , 3 ] . One type of neural operator network is the Fourier Neural Operator (FNO) [ 4 ] which learns global integral kernels in Fourier space. They have been reported to gain three orders - of - magnitude speed - ups on Burgers, Darcy, and incompressible Navier–Stokes benchmarks while retaining high accuracy, even for turbulent super - resolution. The other type of neural operator is the Deep Operator Network (DeepONet) [ 5 ] , which has gained popularity due to its generality. It uses a branch–trunk decomposition backed by the universal approximation theorem, which guarantees to learn nonlinear operators from modest data. The original work of DeepONet consists of fully connected neural networks in its’ branch and trunk network. Since its debut, a rich ecosystem of problem-aware variants has appeared, experimenting different types of neural network architectures in branch and trunk according to the type of problem it tries to solve. ResUNet-DeepONet is one example, which exploits residual U-Net (ResUNet) in trunk [ 6 ] . Authors have various 2D geometry with load applied at one end, predicted the von Mises stress solution field. Another variant of this deep operator network is the Sequential DeepONet (S-DeepONet) which utilizes recurrent neural network in the branch network [ 7 , 8 ] . Taking advantage of recurrent neural networks, it handles temporal input functions effectively to construct solution fields in elasto-plastic problems and transient heat - transfer tasks. These DeepONet variants were also tested with multiphysics setting. With both displacements and heat flux applied simultaneously in one specimen, DeepONet variants successfully reconstructed von Mises stress field and temperature field [ 9 ] . Such operator networks pave the way for mesh-free, once-for-all surrogates that evaluate in milliseconds while comprehending complex boundary conditions. Generative AI has advanced through a sequence of paradigm shifts, each widening the scope of what machines can synthesize. Early breakthroughs such as the Variational Auto-Encoder (VAE) and its conditional extension, the CVAE [ 10 , 11 ] , introduced latent-variable modeling capable of conditional image and sequence generation. Shortly thereafter, Generative Adversarial Networks (GANs) [ 12 ] reframed generation as a minimax game between two networks, yielding photo-realistic imagery and inspiring hundreds of domain-specific variants. The quest for discrete, information-rich latents produced the VQ-VAE [ 13 ] , whose quantized codebook enabled faithful reconstruction of images, speech, and even short video clips. The field pivoted again with Denoising Diffusion Models [ 14 , 15 , 16 , 17 , 18 ] , which interpret generation as time-reversed diffusion and achieve state-of-the-art sample quality while providing an explicit likelihood. Progress accelerated when the forward-inverse dynamics were re-formulated as a stochastic differential equation (SDE) [ 19 ] , unifying score matching and denoising objectives and paving the way for subsequent refinements. Most notably, Karras et al. systematically optimizes noise schedules and further streamlines sampling through a Heun-style second order solver eschewing the Euler predictor used in earlier works by introducing their own framework, Elucidated Diffusion models (EDM) [ 20 ] . Diffusion foundations have since scaled from still images to coherent spatio-temporal synthesis: Video Diffusion Models integrate joint image–video training and conditional sampling to produce the first large-scale text-to-video generations with smooth dynamics [ 21 , 22 , 23 ] , while Imagen Video cascades base and super-resolution diffusers to push video resolution and photorealism even further [ 24 ] . In parallel, the Schrödinger Bridge perspective recasts diffusion as an entropy-regularized optimal-transport problem, unifying score matching, flow matching, and bridge dynamics under a stochastic control lens that naturally extends to physical time-series data [ 25 ] . Today, latent-variable VAEs, adversarial GANs, discrete VQ-VAEs, probabilistic diffusion, and optimal-transport bridges constitute a rich generative toolkit, positioning AI to model not only images and language but also the complex spatio-temporal fields encountered in scientific and engineering simulations. While neural operators such as FNO and DeepONet excel at capturing the global structure of parametric PDE solutions, their spectral bias tends to smear sharp gradients and under-predict fine-scale energy [ 26 ] . Recent studies therefore augments a deterministic operator (or low - resolution solver) with a stochastic generative corrector that recovers the missing high - frequency content. Early examples include the physics - guided diffusion model [ 27 ] which learns to super - resolve coarse PDE outputs and then nudges the samples toward a low residual with respect to the governing equations, and NVIDIA’s two - stage CorrDiff framework [ 28 ] , where a regression UNet supplies a mean field that a conditional diffusion model refines into kilometer - scale weather realizations. LatentPINN [ 29 ] uses a latent diffusion prior to draw PDE coefficients that feed a physics - informed neural network, enabling one PINN to generalize across parameter families without retraining, whereas the Generative Adversarial Neural Operator (GANO) [ 30 ]

Read the complete text