Time-Dependent PDE-Constrained Optimization via Weak-Form Latent Dynamics

April Tran, Terry Haut, David M. Bortz, Youngsoo Choi · 2026

Read Time-Dependent PDE-Constrained Optimization via Weak-Form Latent Dynamics by April Tran, Terry Haut, David M. Bortz, Youngsoo Choi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20639.txt.

Introduction

April Tran and three colleagues speed up design problems where the rules are given by time-dependent partial differential equations, the maths of fields that change over space and time. High-fidelity runs need repeated forward and sensitivity solves, which grow too costly in many-query design and control. Their weak-form latent-space method compresses solution paths into a low-dimensional latent form and learns its dynamics without explicit numerical differentiation. That improves robustness to noisy data, and they derive direct and adjoint gradients for the reduced problem.

Catalog record

CREATORApril Tran, Terry Haut, David M. Bortz, Youngsoo Choi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE108981
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20639

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Time-Dependent PDE-Constrained Optimization via Weak-Form Latent Dynamics April Tran, Terry Haut, David M. Bortz, Youngsoo Choi Abstract Optimization problems constrained by high-dimensional, time-dependent partial differential equations require repeated forward and sensitivity solves, making high-fidelity optimization computationally prohibitive in many-query design and control settings. We present a weak-form latent-space reduced-order modeling framework for accelerating gradient-based PDE-constrained optimization. The proposed approach builds on Weak-form Latent Space Dynamics Identification (WLaSDI), which compresses high-dimensional solution trajectories into a low-dimensional latent representation and identifies parametric latent dynamics using weak-form system identification. By avoiding explicit numerical differentiation of training trajectories, the weak-form improves robustness to noisy data and yields more reliable surrogate dynamics for optimization. We formulate the resulting reduced PDE-constrained optimization problem and derive both direct-sensitivity and adjoint-based gradient expressions for the learned latent dynamics, enabling scalable gradient evaluation with respect to design parameters. The framework is demonstrated on three time-dependent benchmark problems: thermal radiative transfer for optimal hohlraum design, the two-stream instability Vlasov–Poisson system, and the inviscid Burgers equation. Across these examples, WLaSDI produces accurate optimal designs, remains robust under noisy training data, and delivers substantial computational savings, including speedups of up to five orders of magnitude relative to full-order optimization. These results demonstrate that weak-form latent dynamics provide an efficient and noise-robust surrogate foundation for gradient-based optimization of complex time-dependent PDE systems. 1 Introduction A practical digital twin for complex systems must support repeated solutions of design and control problems governed by high-fidelity physical models. In many applications, particularly in PDE-constrained optimization, this entails solving parametric, time-dependent partial differential equations (PDEs) within iterative optimization loops. The computational cost of repeatedly invoking high-fidelity PDE solvers, however, renders such many-query workflows prohibitively expensive. This fundamental challenge has motivated the development of surrogate-based optimization strategies aimed at reducing computational cost. One common approach constructs surrogate models by interpolating selected quantities of interest (QoIs) 52 , 20 . While effective in some settings, these methods typically require retraining the response surface whenever the QoI changes. An alternative strategy is to accelerate the solution process itself through the use of reduced-order models (ROMs), which approximate the underlying PDE dynamics at substantially lower computational cost. In practice, projection-based reduced-order models (pROMs) 4 have proven particularly effective for accelerating the solution of high-dimensional parametric PDEs. In a typical pROM workflow, the high-dimensional full-order state is projected onto a low-dimensional subspace. This subspace is commonly constructed using techniques such as proper orthogonal decomposition (POD) 5 , reduced basis methods 56 , balanced truncation 59 , or nonlinear embeddings learned via autoencoders 28 . To enable predictions at new parameter values, the resulting reduced model is typically interpolated in parameter space 71 , 31 . These methods have demonstrated success across a wide range of applications, including fluid dynamics 19 , 15 , 36 , aerospace engineering 1 , 10 , 37 , and design optimization 16 , 2 , which motivates the focus of this study. Within the class of pROMs, the Latent Space Dynamics Identification (LaSDI) framework 21 has emerged as a strong contender due to its interpretability and non-intrusive nature. Stemming from 13 , which employs Sparse Identification of Nonlinear Dynamics (SINDy) 9 to model latent space dynamics via an ordinary differential equation (ODE), LaSDI extends these ideas to a data-driven pROM framework for accelerating the simulation of parametric PDEs. In essence, LaSDI projects the solution of a parametric PDE onto a low-dimensional parametric ODE governing the latent dynamics. By evolving this latent ODE in time and reconstructing the full-order state, LaSDI enables efficient and accurate simulation across the parameter domain at a substantially reduced computational cost. A key advantage of LaSDI lies in its interpretable and physics-informed representation of the latent dynamics. Rather than relying on a black-box neural network, the latent dynamics are modeled explicitly through a surrogate ODE, which promotes interpretability and facilitates the incorporation of physical constraints and structure. Parametric dependence is incorporated directly through the coefficients of the latent parametric ODE, rather than implicitly through learned latent trajectories, as seen in 71 , 31 . Since its introduction, LaSDI has evolved into a unified framework and has been applied across a wide range of problems. Key developments include interpolation strategies 21 , 25 , 6 , advances in autoencoder architectures 50 , 62 , 63 , 3 , 17 , and improved robustness to noise in training data through the weak-form extension 66 , 26 . Section 2.1 provides a brief overview of the LaSDI framework, while a comprehensive discussion is given in 7 . Of particular relevance to the present work is the weak-form extension of LaSDI, WLaSDI 66 , 26 . Instead of identifying latent dynamics using SINDy 9 , which rely on approximating pointwise time derivatives and can therefore be highly sensitive to noise, WLaSDI employs the Weak-form Estimation of Nonlinear Dynamics (WENDy) 8 . This approach avoids explicit differentiation by projecting the dynamics onto a set of smooth, compactly supported test functions and applying integration by parts. As a result, WLaSDI can construct accurate and reliable surrogate models, which is particularly important in PDE-constrained optimization settings. Details of the WLaSDI algorithms used in this work are provided in Section 2.2 . In this paper, we apply WLaSDI to optimization problems constrained by time-dependent PDEs. Specifically, this work makes three main contributions: 1. We formulate a WLaSDI-based reduced framework for optimization constrained by time-dependent PDEs, replacing repeated high-fidelity solves with efficient integration of learned latent dynamics. 2. We derive direct-sensitivity and adjoint-based gradient expressions for the reduced latent dynamics, enabling scalable gradient evaluation as the parameter dimension increases 72 , 16 , 73 . 3. We demonstrate, on Burgers’ equation, the Vlasov–Poisson system, and thermal radiative transfer, that WLaSDI enables accurate and efficient PDE-constrained optimization while exhibiting improved robustness to noisy training data compared with strong-form LaSDI and interpolation-based surrogates. This paper is organized as follows. In Section 1.1 , we present the problem statement and the fully discrete formulation of the PDE-constrained optimization problem. Section 2 provides an overview of the WLaSDI framework. In Section 3 , we describe the application of WLaSDI to accelerate PDE-constrained optimization, derive the gradient and adjoint expressions. Numerical results are presented in Section 4 . 1.1 Problem Statement Consider a parameterized, time-dependent dynamical system obtained from the spatial discretization of an underlying partial differential equation. The state of the system is represented by a finite-dimensional vector \mathbf{u}:[0,T]\times\mathcal{D}\rightarrow\mathbb{R}^{N_{\mathbf{u}}}, which evolves according to the semi-discrete system \frac{d\mathbf{u}}{dt}(t,\boldsymbol{\mu})=\boldsymbol{\mathcal{N}}\big(\mathbf{u}(t,\,\boldsymbol{\mu}),t,\,\boldsymbol{\mu}\big),\qquad\mathbf{u}(0,\boldsymbol{\mu})=\mathbf{g}(\boldsymbol{\mu}), (1) where \boldsymbol{\mu}\in\mathcal{D}\subset\mathbb{R}^{N_{\mathcal{D}}} denotes a finite-dimensional parameter vector, \boldsymbol{\mathcal{N}} is the spatially discretized operator and \mathbf{g}(\boldsymbol{\mu}) is the parameter-dependent initial condition. Temporal discretization of Eq. ( 1 ) using a general time-integration scheme yields a sequence of algebraic equations defining the discrete state evolution. Let t_{n}=n\Delta t , with \Delta t=\frac{T}{N} and n=0,1,\dots,N , and denote the discrete state by \mathbf{u}_{n}(\boldsymbol{\mu}):=\mathbf{u}(t_{n},\boldsymbol{\mu})\in\mathbb{R}^{N_{\mathbf{u}}}. For notational clarity, we omit the explicit dependence of \mathbf{u}_{n} on the parameter \boldsymbol{\mu} in what follows. The fully discrete system can be expressed compactly in residual form as \begin{aligned} &\mathbf{r}_{0}\big(\mathbf{u}_{0},\ \boldsymbol{\mu}\big)=\mathbf{u}_{0}-\mathbf{g}(\boldsymbol{\mu})\\ &\mathbf{r}_{n}\big(\mathbf{u}_{0},\mathbf{u}_{1},\dots,\mathbf{u}_{n},\ \boldsymbol{\mu}\big)\end{aligned}\begin{aligned} &=\mathbf{0}_{N_{\mathbf{u}}},\\ &=\mathbf{0}_{N_{\mathbf{u}}},\qquad n=1,2,\dots,N.\end{aligned} (2) where \mathbf{r}_{n}:\mathbb{R}^{N_{\mathbf{u}}}\times\mathcal{D}\rightarrow\mathbb{R}^{N_{\mathbf{u}}} denotes the discrete PDE residual at time step n . Note that \mathbf{r}_{n} depends on the chosen spatial discretization and time-integration scheme and may involve the full state

Read the complete text