Was Residual Penalty and Neural Operators All We Needed for Solving Optimal Control Problems?
Oliver G. S. Lundqvist, Fabricio Oliveira · 2025
Read Was Residual Penalty and Neural Operators All We Needed for Solving Optimal Control Problems? by Oliver G. S. Lundqvist, Fabricio Oliveira (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04742.txt.
Introduction
Controlling a system governed by partial differential equations usually means solving the equations repeatedly inside an optimizer. The authors take a leaner route: they train a neural operator once, with physics-informed learning, and optimize the control separately. A penalty term based on the equation's residual keeps the trained model honest to the physics. Gradients for the control come from automatic differentiation through the trained operator, so the optimizer can use it directly.
Once trained, the operator serves many tracking targets without retraining. The team tests it on three control problems: a Poisson equation, the viscous Burgers equation, and a Stokes flow problem. On the time-dependent Burgers case it matches adjoint solvers in accuracy while running up to four times faster per iteration. On the linear Poisson case the classic adjoint method stays more accurate. A reference solver confirms the flow result is feasible.
Catalog record
| CREATOR | Oliver G. S. Lundqvist, Fabricio Oliveira |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-04742
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Was Residual Penalty and Neural Operators All We Needed for Solving Optimal Control Problems? Oliver G. S. Lundqvist, Fabricio Oliveira Abstract Neural networks have been used to solve optimal control problems, typically by training neural networks using a combined loss function that considers data, differential equation residuals, and objective costs. We show that including cost functions in the training process is unnecessary, advocating for a simpler architecture and streamlined approach by decoupling the optimal control problem from the training process. Thus, our work shows that a simple neural operator architecture, such as DeepONet, coupled with an unconstrained optimization routine, can solve multiple optimal control problems with a single physics-informed training phase and a subsequent optimization phase. We achieve this by adding a penalty term based on the differential equation residual to the cost function and computing gradients with respect to the control using automatic differentiation through the trained neural operator within an iterative optimization routine. We showcase our method on nine distinct optimal control problems by training three separate DeepONet models, each corresponding to a different differential equation. For each model, we solve three problems with varying cost functions, demonstrating accurate and consistent performance across all cases. 1 Introduction An optimal control problem is an optimization problem in which the system dynamics are described by differential equations, either ordinary differential equations (ODEs) or partial differential equations (PDEs), that explicitly depends on a control input. These problems arise across a wide range of practical applications, including power plant operation Christensen1987Optimal ; caldon2004optimal ; steinbuch1988optimal , flight trajectory optimization sridhar2011aircraft ; anderson2010optimal ; longuski2014optimal , control of biological systems lenhart2007optimal ; Yin2023optimal , and economic decision-making in areas such as investment and trading leonard1992optimal ; kendrick2005stochastic . Traditional numerical approaches to optimal control problems are computationally intensive, making neural networks an attractive alternative. As such, recent studies have explored physics-informed neural networks (PINNs) and neural operators (NOs) for solving optimal control problems Molawi2023 ; verma2024neural ; Alla2024 ; Tomasetto2024 ; Song2023admm , particularly when the constraints are complex, nonlinear PDEs. Existing neural network models are typically trained for a single task, requiring retraining if problem parameters or cost functions change. For example, in a tracking problem, the tracked target may change, leading to a corresponding change in the cost function. In flight control, the objective may vary depending on the mission phase, such as achieving the fastest climb, the most economical cruise, or the safest landing, each defining a different optimal control problem. Similarly, operating a power plant involves distinct objectives during startup, steady-state operation, and shutdown, resulting in various formulations of the cost function depending on the operational context. To address this limitation, we propose a method that fully decouples neural network training from the optimal control problem, eliminating the need for retraining when cost functions or parameters change. Our approach trains a single NO in advance, allowing it to solve multiple optimal control problems efficiently. Moreover, since neural network inference is fast from a computational perspective, we claim that our method is also suitable for real-time applications. Additionally, we argue that solving a complex optimal control problem is fundamentally equivalent to training a well-generalizable physics-informed NO, making specialized architectures unnecessary. In line with Occam’s razor, we advocate for simpler and less complex architectures, as our results demonstrate that such models are sufficient for solving a wide range of control problems without the need for elaborate or highly specialized designs. In addition, our approach broadens the original scope of NOs beyond their typical use as solvers for differential equations, thus showcasing a valuable discovery of their capabilities. Our method employs a direct optimization approach, integrating automatic differentiation with nonlinear programming to efficiently compute control gradients while enforcing differential equation constraints through residual penalties. A schematic representation of our approach is shown in Figure 1 . We focus on the DeepONet architecture, comparing optimization routines such as gradient descent (GD), adaptive moment estimation (ADAM) kingma2014adam , and Broyden–Fletcher–Goldfarb–Shanno (BFGS) broyden1970convergence across multiple optimal control problems. We note that, although we use DeepONet, our approach is not limited to this architecture, leaving exploration of alternatives for future work. Our main contributions are as follows. We demonstrate that a single NO can be reused with our method across multiple optimal control problems, eliminating the need for retraining, thereby enabling their use in practical settings. We further demonstrate that training a NO alone is sufficient for solving optimal control problems, reducing the need for complex architectural modifications. This suggests that, in many cases, specialized control networks may not be necessary, offering a more streamlined approach for using neural networks with optimal control problems. Our approach is both simple and powerful, showcasing the versatility of NOs in solving a broad range of problems beyond their original task. The rest of this paper is structured as follows: Section 2 reviews related work. Section 3 introduces our direct method. Section 4 presents experimental results on three different DeepONet models, each solves three different optimal control problems. Section 5 concludes the study. Figure 1: The schematic of our proposed method. 2 Related Work In recent years, PINNs have been widely used to solve differential equations raissi2017physics ; raissi2019physics ; jagtap2022physics ; kashefi2022physics ; yang2021b . An extension of PINNs for solving optimization problems was performed by Lu et al. Lu2021 , where the authors used a PINN and a control network for topology optimization for inverse design problems. They trained a neural network on a common loss function consisting of the residual of the differential equation and the cost function of the topology optimization problem. Molawi et al. Molawi2023 extended the idea of a control neural network and a PINN to optimal control problems. Song et al. Song2023admm split the control term into two variables, dividing the training loss into a differential equation term and a regularizing term describing the cost, and used an alternating direction method of multipliers for training the neural networks. Similarly, Demo2023 ; Alla2024 ; Tomasetto2024 have explored the use of two (or more) neural network models, PINNs and a control neural network, to solve optimal control problems. Another common approach is to utilize the adjoint state equation, which arises from Pontryagin’s Minimum Principle Pontryagin1956 together with PINNs. Employing Pontryagin’s Minimum Principle transforms the optimal control problem into a set of differential equations defined by the Hamiltonian of the system and adjoint state equations. Yin et al. Yin2024AONN used a direct adjoint looping approach to solve the optimal control problem by using two separate neural networks to solve it, one for the differential equation and one for the adjoint equation that arises from Pontryagin’s Minimum Principle. Schiassi et al. schiassi2024pontryagin also used Pontryagin’s Minimum Principle and trained a PINN for solving the two-point boundary value problem for a quadratic cost function directly. Demo et al. Demo2023 used a PINN and a control network in sequence, where the output of the PINN was given as input to the control network, which solved for the adjoint equation and derived the optimal control. These methods showed promising results on their respective test problems, but are only capable of solving the particular optimal control problem (i.e., with fixed cost function parameterization) for which the neural networks were trained. Physics-informed