Multi-fidelity Learning of Reduced Order Models for Parabolic PDE Constrained Optimization
Benedikt Klein, Mario Ohlberger · 2025
Read Multi-fidelity Learning of Reduced Order Models for Parabolic PDE Constrained Optimization by Benedikt Klein, Mario Ohlberger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21252.txt.
Introduction
Benedikt Klein and Mario Ohlberger build a layered trust region method that learns reduced models at many fidelity levels while solving optimization problems bound by parabolic equations. Classic model reduction splits work into offline and online stages. Their work came out in twenty twenty-five.
Here the reduced models grow on the fly inside the outer search loop, by active learning. Three layers share the work: a full model, a reduced model, and a machine learning model. A strict after the fact error gauge guides updates inside an error aware trust region frame. Numeric tests show the approach runs with good efficiency, the authors report.
Catalog record
| CREATOR | Benedikt Klein, Mario Ohlberger |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21252
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-fidelity Learning of Reduced Order Models for Parabolic PDE Constrained Optimization Benedikt Klein, Mario Ohlberger Abstract This article builds on the recently proposed RB-ML-ROM approach for parameterized parabolic PDEs and proposes a novel hierarchical Trust Region algorithm for solving parabolic PDE constrained optimization problems. Instead of using a traditional offline/online splitting approach for model order reduction, we adopt an active learning or enrichment strategy to construct a multi-fidelity hierarchy of reduced order models on-the-fly during the outer optimization loop. The multi-fidelity surrogate model consists of a full order model, a reduced order model and a machine learning model. The proposed hierarchical framework adaptively updates its hierarchy when querying parameters, utilizing a rigorous a posteriori error estimator in an error aware trust region framework. Numerical experiments are given to demonstrate the efficiency of the proposed approach. MSC Classification]49M20, 49K20, 35J20, 65N30, 90C06 keywords Reduced order models, multi-fidelity learning, parabolic PDE constrained optimization, trust region algorithm pacs [ 1 Introduction Optimization problems governed by Partial Differential Equations (PDEs) play a crucial role in various fields, including physics, engineering, and economics, as they enable the modeling, solution and optimization of complex systems that involve spatially distributed phenomena. The ability to efficiently solve such optimization problems has far-reaching implications for applications like optimal control, inverse problems, and design optimization. Typical algorithms require numerous evaluations of the underlying PDE for various parameters that are selected in an outer descent-type optimization loop. In this contribution we are concerned with a novel multi-fidelity learning approach to speed up such algorithms for parameter optimization or optimal control problems with parabolic PDE constraints. The approach builds on a hierarchy of approximate models with increasing accuracy and decreasing efficiency, consisting of a machine learning surrogate, a reduced basis model and a full order finite element model. Such an approach has recently been proposed as a certified “on demand” RB - ML - ROM learning approach to approximate parametrized input-output maps Haasdonk et al. (2023) . In order to efficiently handle optimization problems, we integrated this approach into the error aware trust region framework Yue and Meerbergen (2013) that has recently been advanced theoretically and numerically in Keil et al. (2021) ; Banholzer et al. (2022) ; Keil and Ohlberger (2024) . We now give a more detailed overview to the various techniques involved in our mutli-fidelity approach. Model order reduction for PDE constrained optimization. Model Order Reduction (MOR) methods have gained significant attention in recent years for efficiently solving parameterized PDEs Benner et al. (2017) ; Benner et al. () . These methods aim to reduce the computational complexity by replacing high-dimensional Full Order Models (FOMs) with low-dimensional surrogates. A promising approach is the usage of Reduced Basis (RB) methods, which rely on approximating the solution manifold of parameterized PDEs (pPDEs) by low-dimensional linear approximation spaces. We particularly refer to the POD-Greedy method Haasdonk and Ohlberger (2008) ; Haasdonk (2013) as well as the Hierarchical approximate POD (HaPOD) Himpe et al. (2018) for parameterized parabolic PDEs . There is a large amount of literature using such reduced models for PDE constrained optimization, cf. Kammann et al. (2013) ; Grepl and Kärcher (2011) ; Negri et al. (2013) . For an introduction to MOR methods for optimal control problems we refer, e.g., to Hinze ([2023] ©2023) . More recently, RB methods have been advised with a progressive construction of Reduced Order Models (ROMs) Zahr and Farhat (2015) ; Garmatter et al. (2016) ; Ohlberger et al. (2018) which has lead to a serious of works on error aware trust region reduced basis methods. Error aware Trust-Region – Reduced Basis methods. Trust-Region (TR) approaches are a class of optimization methods that build on the iterative solution of appropriately chosen locally accurate surrogate models. The main idea is to solve optimization sub-problems only in a local area of the parameter domain which resolves the burden of constructing a global RB space. TR optimization methods have been successfully combined with MOR to leverage locally accurate surrogate models, ensuring global convergence while reducing the computational cost Yue and Meerbergen (2013) ; Rogg et al. (2017) . Significant further development and analysis of such approaches were presented in Qian et al. (2017) ; Keil et al. (2021) ; Banholzer et al. (2022) ; Keil and Ohlberger (2024) . We also refer to a related approach with application to shape optimization problems Wen and Zahr (2023) . Data based surrogate modeling and machine learning approaches. In parallel to model-based reduction methods, purely data-based approaches for machine learning of surrogate models have increasingly been developed and mathematically investigated Hesthaven and Ubbiali (2018) ; Kutyniok et al. (2022) ; Fresca and Manzoni (2022) ; Conti et al. (2023) ; Brivio et al. (2024) . Our methodology exploits the strengths of both model-based and data-driven approaches, enabling the construction of certified, adaptive, and efficient surrogate models. The general idea of a full order, reduced order and machine learning model pipeline has first been introduced in Gavrilenko et al. ([2022] ©2022) and subsequently been put in a certified RB - ML - ROM framework in Haasdonk et al. (2023) . Despite deep neural networks, also kernel methods and novel deep kernel approaches have been investigated and compared Wenzel et al. ([2024] ©2024) . For further learning based approaches for related optimization problems we refer to Lye et al. (2021) ; Keil et al. (2022) ; Xu and Darve (2020) ; Kleikamp et al. (2025) We also note that these approaches are complementary to unsupervised learning approaches, such as physics-informed neural networks Raissi et al. (2019) or, e.g., deep Ritz methods E and Yu (2018) . Main results. This work demonstrates the potential of combining the above mentioned approaches to tackle parameter optimization with parabolic PDE constraints or corresponding optimal control problems. We thereby integrate certified and adaptive model order reduction with machine learning techniques in a trust region optimization framework. By doing so in a multi-fidelity fashion, we overcome the limitations of traditional global model reduction methods and purely machine learning based approaches that typically come without error certification. Particular novelties of this contribution include • a posteriori error estimates for the approximate objective function and its derivatives, • a concept for trust region multi-fidelity optimization, • the integration of the RB - ML - ROM surrogate modeling approach with the error aware TR optimization method, • an efficient implementation of the resulting multi-fidelity TR - RB - ML -Opt approach based on the model reduction software framework pyMOR Milk et al. (2016) , • a numerical proof of concept that demonstrate that our new TR - RB - ML -Opt method outperforms existing model reduction approaches. Organization of the article. In Section 2 we introduce the parabolic PDE constrained optimization problem and discuss the adjoint problem resulting from the optimality conditions. A suitable reduced basis approximation and corresponding a posteriori error estimates are discussed in Section 3 . Section 4 then introduces machine learning surrogates and adaptations that are necessary with respect to a posteriori error estimation. Finally, the trust region multi-fidelity optimization framework is introduced in Section 5 . Numerical experiments in Section 6 demonstrate the performance of the resulting approach in comparison to previous TR - RB approaches.