Stochastic Galerkin Method and Hierarchical Preconditioning for PDE-constrained Optimization
Zhendong Li, Akwum Onwunta, Bedřich Sousedík · 2025
Read Stochastic Galerkin Method and Hierarchical Preconditioning for PDE-constrained Optimization by Zhendong Li, Akwum Onwunta, Bedřich Sousedík (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23804.txt.
Introduction
Zhendong Li, Akwum Onwunta, and Bedřich Sousedík speed up hard design problems whose rules involve random inputs. In PDE-constrained optimization under uncertainty, one picks controls for a system ruled by partial differential equations while the material traits are not known for sure. A discretize-then-optimize pipeline with stochastic Galerkin projection then yields huge, badly conditioned linear systems that solvers struggle with.
Preconditioners, rough inverses that reshape the system for the solver, are the fix, and the authors build layered ones that use the sparse shape of the Galerkin system. Their design rests on cut-down stochastic expansions, trading build cost against how much faster the solver runs. Tests on steady and time-dependent control problems showed much faster convergence than existing methods, and the gains held up across the tested problems. For engineers who must design under doubt, that means answers far sooner.
Catalog record
| CREATOR | Zhendong Li, Akwum Onwunta, Bedřich Sousedík |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23804
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stochastic Galerkin Method and Hierarchical Preconditioning for PDE-constrained Optimization Thanks: Dedicated to the memory of Professor Howard C. Elman, our dear colleague and mentor. We also want to thank Lehigh’s High Performance Computing systems for providing computational resources. Zhendong Li, Akwum Onwunta, Bedřich Sousedík Abstract We develop efficient hierarchical preconditioners for optimal control problems governed by partial differential equations with uncertain coefficients. Adopting a discretize-then-optimize framework that integrates finite element discretization, stochastic Galerkin approximation, and advanced time-discretization schemes, the approach addresses the challenge of large-scale, ill-conditioned linear systems arising in uncertainty quantification. By exploiting the sparsity inherent in generalized polynomial chaos expansions, we derive hierarchical preconditioners based on truncated stochastic expansion that strike an effective balance between computational cost and preconditioning quality. Numerical experiments demonstrate that the proposed preconditioners significantly accelerate the convergence of iterative solvers compared to existing methods, providing robust and efficient solvers for both steady-state and time-dependent optimal control applications under uncertainty. 1 Introduction Optimal control problems governed by partial differential equations (PDEs) arise in numerous applications, including fluid mechanics, structural optimization, and inverse problems. These problems have been extensively studied over the past decades. For a theoretical overview and computational methods related to deterministic problems, we refer readers to, e.g., [ 9 , 27 ] . In many practical applications, the PDE coefficients are uncertain. Such uncertainties originate from various sources, including measurement errors, model approximations, and environmental variations, and they are modeled as random variables or stochastic processes. Recently, there has been an increased interest in optimal control problems governed by PDEs with random coefficients, see e.g., [ 17 ] . These stochastic problems are inherently more complex than their deterministic counterparts, thus necessitating specialized numerical methods. Two alternative strategies are used for the optimal control problems: optimize-then-discretize and discretize-then-optimize. The optimize-then-discretize approach involves deriving continuous optimality conditions and then discretizing them. Conversely, the discretize-then-optimize approach discretizes the objective and the PDE first and then solves the resulting discrete optimization problem. The discretize-then-optimize is widely used in practice, because it allows the employment of efficient numerical methods such as finite element or finite difference methods, see e.g., [ 1 , 3 , 4 , 5 , 9 ] . This approach is also used in this study. In the formulation of numerical methods, discretizations in the stochastic space, spatial domain, and potentially time domain are required. For stochastic-space discretization, several methods exist, including Monte Carlo method, stochastic collocation method and stochastic Galerkin method. The stochastic collocation method discretizes random variables using a set of collocation points, solving the resulting deterministic PDEs at these points [ 8 , 13 , 12 , 26 ] . The stochastic Galerkin method expands the solution in terms of orthogonal polynomials and solves the resulting coupled system of equations [ 10 , 14 , 15 , 16 , 21 , 30 ] . Monte Carlo method is simple and therefore popular; however, it typically demands a large number of samples for acceptable accuracy, making it computationally intensive for high-dimensional problems. The stochastic collocation method is in general more efficient, but it may lose efficiency in high-dimensional random spaces, and it becomes challenging to implement in practice. Here, we use the stochastic Galerkin method, which systematically captures uncertainties by employing orthonormal polynomial expansions, preserving optimal convergence properties while improving computational efficiency for large-scale stochastic PDE-constrained optimization problems. In practice, it is common to combine temporal discretization (e.g., backward Euler scheme), stochastic expansions (e.g., generalized polynomial chaos expansions), and spatial discretization (e.g., finite element method). Specifically, let {t_{0},t_{1},\dots,t_{N_{t}}} denote a partition of the time interval of interest, {\phi_{i}(\mathbf{x})}_{i=1}^{N_{h}} represent a spatial discretization basis and {\psi_{k}({\xi})}_{k=1}^{N_{\xi}} represent an orthonormal polynomial basis in the random space. Then the state y(t,\mathbf{x},{\xi}) can be approximated by y(t,\mathbf{x},{\xi})\approx\sum_{n=0}^{N_{t}}\sum_{i=1}^{N_{h}}\sum_{k=1}^{N_{\xi}}y_{n,i,k}\,\Theta_{n}(t)\,\phi_{i}(\mathbf{x})\,\psi_{k}({\xi}), where \Theta_{n}(t) is a temporal basis, and y_{n,i,k} are expansion coefficients (i.e., the degrees of freedom of the numerical solution) in the basis \{\Theta_{n}(t)\,\phi_{i}(\mathbf{x})\,\psi_{k}({\xi})\} , which are determined by a suitable numerical method. The discretize-then-optimize approach leads to large-scale linear systems obtained via finite element (or possibly finite difference) discretizations, which are then typically solved using Krylov subspace methods, e.g., by the generalized minimal residual method (GMRES). These linear systems are often ill-conditioned, which causes a slow convergence of the iterative method. To address this issue, we construct preconditioners that improve the convergence of iterative solvers. We note that the development of efficient solvers is a general challenge in optimal control, including for deterministic problems solved via duality-based approaches [ 28 ] . In this paper, we introduce a hierarchical preconditioning framework specifically tailored for stochastic PDE-constrained optimal control problems. Although the core concepts are inspired by preconditioners for PDE problems [ 6 , 25 , 24 , 31 ] , an application to the Karush-Kuhn-Tucker (KKT) systems arising from optimization problems and an extension to time-dependent problems are nontrivial and constitutes a primary contribution of this work. We provide a systematic derivation of the preconditioner for both steady-state and all-at-once formulation of time-dependent problems. The method is supported by a rigorous spectral analysis, proving that the proposed preconditioner is spectrally equivalent to the ideal but computationally prohibitive exact Schur complement. The performance is then evaluated using a set of numerical experiments. The paper is organized as follows. In Section 2 , we address the steady-state stochastic optimal control problem. We introduce the problem formulation and discretization into a large-scale KKT system. Then, we construct the hierarchical Gauss-Seidel preconditioner for PDE-constrained optimal control problems (hGSoc). In Section 3 , we extend the framework to the time-dependent case. We present an all-at-once discretization and we develop a corresponding parallel-in-time preconditioner. In Section 4 , we provide a spectral analysis of the proposed preconditioners. In Section 5 , we demonstrate the efficiency of the proposed methods by a series of numerical experiments. Finally, in Section 6 we conclude and summarize our work. 2 Steady-state problem Let \left(\Omega,\mathcal{F},\mathcal{P}\right) be a complete probability space, where \Omega is the sample space, \mathcal{F} is the \sigma -algebra generated by \Omega , and \mathcal{P} is the probability measure. We assume that the uncertainty in our model arises from a vector of independent random variables \xi=\left(\xi_{1},\dots,\xi_{m_{\xi}}\right)^{T} defined as \xi:\Omega\rightarrow\Phi\subset\mathbb{R}^{m_{\xi}} . Let \mathcal{B}(\Phi) be the Borel \sigma -algebra on \Phi induced by \xi , and let \mu denote the corresponding probability measure. The expectation of the product of measurable functions u and v depending on \xi defines a Hilbert space L^{2}\left(\Phi\right)\coloneqq L^{2}\left(\Phi,\mathcal{B}(\Phi),\mu\right) equipped with the inner product \left\langle u,v\right\rangle=\mathbb{E}\left[uv\right]=\int_{\Phi}u\left(\xi\right)v\left(\xi\right)\,d\mu\left(\xi\right), where \mathbb{E} denotes the mathematical expectation. We consider a stochastic PDE coefficient \Bbbk(x,\rho) , where x is the coordinate in the physical space, and \rho represents random inputs. It is assumed that \Bbbk(x,\rho) is bounded away from zero and infinity, i.e., 0<\Bbbk_{\min}\leq\Bbbk(x,\rho)\leq\Bbbk_{\max}<\infty for some constants \Bbbk_{\min} , \Bbbk_{\max} , and it can be represented by a truncated Karhunen-Loève(KL) expansion \Bbbk(x,\rho)\approx\kappa_{1}(x)+\sum\nolimits_{i=1}^{m_{\xi}}\sqrt{\theta_{i}}\kappa_{i}(x)\xi_{i}(\rho), (1) where \kappa_{1}(x) is the mean function, and (\theta_{i},\kappa_{i}(x)) is the i -th eigenpair (eigenvalue and eigenfunctions, respectively) of the covariance function C_{\Bbbk}(x,y)=\mathbb{E}\left[\left(\Bbbk(x,\rho)-\kappa_{1}(x)\right)\left(\Bbbk(y,\rho)-\kappa_{1}(y)\right)\right], (2) defined in physical domain \mathcal{D}\subset\mathbb{R}^{n} with piecewise continuous boundary \partial\mathcal{D} , such that \int_{\mathcal{D}}C_{\Bbbk}(x,y)\kappa_{i}(y)dy=\theta_{i}\kappa_{i}(x). (3) The system of eigenfunctions \kappa_{i}(x) is orthonormal in the space L^{2}(\mathcal{D}) , and the eigenvalues \theta_{i} are arranged in a nonincreasing order. We next introduce the random variables \xi_{i}(\rho) .