Learning to Solve Optimization Problems Constrained with Partial Differential Equations

Yusuf GüvenIstanbul Technical UniversityControl and Automation Engineering DepartmentIstanbul, Turkey [email protected], Vincenzo Di Vito, Ferdinando FiorettoUniversity of VirginiaDepartment of Computer ScienceCharlottesville, USA {eda8pc,fioretto}@virginia.edu · 2025

Read Learning to Solve Optimization Problems Constrained with Partial Differential Equations by Yusuf GüvenIstanbul Technical UniversityControl and Automation Engineering DepartmentIstanbul, Turkey [email protected], Vincenzo Di Vito, Ferdinando FiorettoUniversity of VirginiaDepartment of Computer ScienceCharlottesville, USA {eda8pc,fioretto}@virginia.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24573.txt.

Introduction

Design problems tied to physics equations are slow to solve, since each design choice changes the state the equations describe. Yusuf Guven and 2 co-authors built a learning framework with two networks to speed that up. One network predicts how the system evolves over time. The other predicts near-best decisions for the design.

Together they give real-time strategies while keeping the link between decisions and physics clear. On test tasks built on Burgers' equation, the heat equation, and voltage control, solution quality matched classic control methods. Speed improved by up to ten thousandfold in the best case.

Catalog record

CREATORYusuf GüvenIstanbul Technical UniversityControl and Automation Engineering DepartmentIstanbul, Turkey [email protected], Vincenzo Di Vito, Ferdinando FiorettoUniversity of VirginiaDepartment of Computer ScienceCharlottesville, USA {eda8pc,fioretto}@virginia.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24573

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning to Solve Optimization Problems Constrained with Partial Differential Equations Yusuf GüvenIstanbul Technical UniversityControl and Automation Engineering DepartmentIstanbul, Turkey [email protected], Vincenzo Di Vito, Ferdinando FiorettoUniversity of VirginiaDepartment of Computer ScienceCharlottesville, USA {eda8pc,fioretto}@virginia.edu Abstract Partial differential equation (PDE)-constrained optimization arises in many scientific and engineering domains, such as energy systems, fluid dynamics, and material design. In these problems, the decision variables (e.g., control inputs or design parameters) are tightly coupled with the PDE state variables, and the feasible set is implicitly defined by the governing PDE constraints. This coupling makes the problems computationally demanding, as it requires handling high-dimensional discretizations and dynamic constraints. To address these challenges, this paper introduces a learning-based framework that integrates a dynamic predictor with an optimization surrogate. The dynamic predictor, a novel time-discrete Neural Operator ( Lu_2021 ) , efficiently approximates system trajectories governed by PDE dynamics, while the optimization surrogate leverages proxy optimizer techniques ( kotary2021end ) to approximate the associated optimal decisions. This dual-network design enables real-time approximation of optimal strategies while explicitly capturing the coupling between decisions and PDE dynamics. We validate the proposed approach on benchmark PDE-constrained optimization tasks including Burgers’ equation, heat equation, and voltage regulation, and demonstrate that it achieves solution quality comparable to classical control-based algorithms such as the Direct Method and Model Predictive Control (MPC), while providing up to four orders of magnitude improvement in computational speed. Antiquus S. Hippocampus, Natalia Cerebro & Amelie P. Amygdale ∗ Equal Contribution Department of Computer Science Cranberry-Lemon University Pittsburgh, PA 15213, USA {hippo,brain,jen}@cs.cranberry-lemon.edu &Ji Q. Ren & Yevgeny LeNet Department of Computational Neuroscience University of the Witwatersrand Joburg, South Africa {robot,net}@wits.ac.za and Coauthor Affiliation Address email 1 Introduction Partial differential equations (PDEs) are central to modeling a wide range of physical and engineering systems, capturing phenomena that evolve jointly over space and time. Applications include fluid transport, which can be modeled with Burgers’ equations which are key in fluid mechanics and gas dynamics, thermal processes captured by heat equations, often used in financial mathematics and image analysis, and voltage dynamics in power systems. Optimizing decisions in such domains requires solving PDE-constrained optimization problems , where control or design objectives must be optimized while ensuring consistency with the underlying governing PDE dynamics. Despite their importance, PDE-constrained optimization remains computationally intractable. Traditional approaches typically rely on finite element and finite difference discretizations combined with adjoint-based optimization. These methods often suffer from high dimensionality, high computational cost, and convergence difficulties when applied to nonlinear dynamics. For example, when applied to the nonlinear Burgers’ equations, our experiments show that the runtimes of the adjoint-based and Nonlinear MPC approaches run in approximately 120\;s and 878\;s ; such computational cost hinder their applicability in large-scale or real-time decision-making tasks. In various classes of continuous optimization tasks not constrained by PDEs, proxy optimizers ( kotary2021end ) have recently emerged as a powerful tool to quickly find approximate solutions. In parallel, researchers have focused on developing a variety of surrogates ( raissi2017physics ; kovachki2024neuraloperatorlearningmaps ; li2021fourier ; chen2019neural ) for capturing system dynamics. Our approach is a unique combination of elements from both these areas, and consists of a dual-network architecture to tackle PDE-constrained optimization problems where both the state dynamics and the control decisions evolve in space and time. Contributions. Specifically, the paper makes the following contributions: (1) It introduces a novel learning-based method to efficiently approximate solutions of PDE-constrained optimization problems. Our approach, PDE-OP (Optimization Proxy), consists of a dual-network architecture in which a dynamic predictor captures the system dynamics, while a surrogate controller approximates the optimal control actions. These components are trained in a synergistic manner in a self-supervised fashion using a primal–dual method. (2) It shows that the proposed time-discrete Neural Operator accurately captures the dynamics governed by PDEs. (3) It demonstrates that the proposed framework achieves decision quality comparable to state-of-the-art numerical solvers, such as Model Predictive Control and the Adjoint-sensitivity method, while providing several orders of magnitude improvements in computational speed. The approach is validated on a set of widely adopted PDE-constrained optimization tasks, including Burgers’, heat, and voltage equations. We believe that these results could boost the adoption of learning-based methods for control problems that require high-fidelity dynamic modeling and near real-time optimal decision-making. 2 Related Work A central paradigm for decision-making coupled with dynamical systems is Model Predictive Control (MPC) ( mayne2000constrained ) . It repeatedly solves an optimization problem over a finite time horizon using predicted system states. While MPC provides high-quality control decisions, its reliance on repeatedly solving an optimization problem makes it computationally intractable and limits its applicability in real-time settings. In a similar fashion, exact PDE-constrained optimization methods rely on time–space discretization of the governing equations, after which the resulting high-dimensional system is incorporated into an optimization problem ( hinze2008optimization ; troeltzsch2010optimal ) . While theoretically well-founded, these approaches become quickly impractical as the problem size grows, especially in the presence of nonlinear dynamics or when real-time feasibility is required. To mitigate these limitations, surrogate models have been developed for reduced-order adjoint solutions ( zahr2014progressive ) , sensitivity PDEs ( dihlmann2015certified ) , and learning PDE operators ( Hwang_2022 ) , offering significant computational advantages. Nevertheless, these methods often face trade-offs between accuracy and efficiency and limited adaptability across operating regimes ( kovachki2024neuraloperatorlearningmaps ; Lu_2021 ; willcox2021physics ) . In parallel, to approximate solutions of constrained optimization problems in real-time setting, machine learning researchers have developed a class of methods known as proxy optimizers . These methods employ machine learning models, to learn mappings from problem parameters or system configurations to optimal decisions, thereby significantly accelerating inference ( kotary2021end ) compared to classical optimization solvers. Both supervised approaches ( fioretto2020lagrangian ) , which rely on precomputed optimal solutions, and self-supervised ones ( park2023self ) , which exploit knowledge of the problem structure, have been proposed, showing promising results. A recurring challenge in this setting is ensuring feasibility: learned solutions may violate problem constraints. This issue has been tackled through penalty-based training ( fioretto2020lagrangian ) , implicit-layer formulations that embed constraints directly into the model architecture ( donti2020dc3 ) , or post-processing projections to restore feasibility ( kotary2024learningjointmodelsprediction ) . A large body of recent work has also focused on learning surrogates for PDE dynamics . Physics-Informed Neural Networks ( 2019JCoPh.378..686R ) directly encode PDE residuals into the loss function, enabling solutions that adhere to the governing equations. Neural operator approaches, such as the Fourier Neural Operator ( li2021fourier ) and DeepONet ( Lu_2021 ) , learn mappings between infinite-dimensional function spaces, which allows them to approximate solution operators of families of PDEs , with strong generalization across different boundary conditions and coefficients ( kovachki2024neuraloperatorlearningmaps ) . Other operator-learning frameworks ( li2020multipole ; bhattacharya2021model ) and kernel-based methods ( raissi2021deepgreen ) have also been developed. While these approaches excel at reproducing PDE solutions, they are typically not designed to incorporate decision variables or to directly solve PDE-constrained optimization problems. The closest related work is ( divito2024learningsolvedifferentialequation ) , where the authors propose a learning-based surrogate solver to tackle ODE or SDE-constrained optimization tasks. Our approach goes further, by integrating operator-learning surrogates within the optimization pipeline, thereby coupling the representation of PDE dynamics with proxy optimizers and enabling real-time

Read the complete text