Geometric Autoencoder Priors for Bayesian Inversion: Learn First Observe Later

Arnaud VadeboncoeurDepartment of EngineeringUniversity of CambridgeCambridge, 7a JJ Thomson Ave, UK [email protected], Gregory DuthéInstitute of Structural EngineeringETH ZürichZürich, Stefano-Franscini-Platz 5, Switzerland [email protected] Mark GirolamiDepartment of EngineeringUniversity of Cam · 2025

Read Geometric Autoencoder Priors for Bayesian Inversion: Learn First Observe Later by Arnaud VadeboncoeurDepartment of EngineeringUniversity of CambridgeCambridge, 7a JJ Thomson Ave, UK [email protected], Gregory DuthéInstitute of Structural EngineeringETH ZürichZürich, Stefano-Franscini-Platz 5, Switzerland [email protected] Mark GirolamiDepartment of EngineeringUniversity of Cam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19929.txt.

Introduction

Engineers often must rebuild a full physical field from a handful of noisy sensors, an ill-posed guessing game. Arnaud Vadeboncoeur and three co-authors teach a generative model the shapes that fields can take. Their geometric autoencoders learn from many systems with varying geometry, with no need for the governing equations. The learned prior then guides Bayesian inversion on new systems.

Their slogan is learn first, observe later. Geometry-awareness is the hard part: standard methods assume one fixed shape. Lessons distilled across systems ease the ill-posedness that plagues single-system inference. Uncertainty estimates come with the reconstruction, as engineering decisions demand. Bridges, turbines, and medical phantoms all fit the pattern of sparse sensing on shifting geometry.

Catalog record

CREATORArnaud VadeboncoeurDepartment of EngineeringUniversity of CambridgeCambridge, 7a JJ Thomson Ave, UK [email protected], Gregory DuthéInstitute of Structural EngineeringETH ZürichZürich, Stefano-Franscini-Platz 5, Switzerland [email protected] Mark GirolamiDepartment of EngineeringUniversity of Cam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-19929

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Geometric Autoencoder Priors for Bayesian Inversion: Learn First Observe Later Arnaud VadeboncoeurDepartment of EngineeringUniversity of CambridgeCambridge, 7a JJ Thomson Ave, UK [email protected], Gregory DuthéInstitute of Structural EngineeringETH ZürichZürich, Stefano-Franscini-Platz 5, Switzerland [email protected] Mark GirolamiDepartment of EngineeringUniversity of CambridgeCambridge, 7a JJ Thomson Ave, UK [email protected] Eleni Chatzi Institute of Structural Engineering ETH Zürich Zürich, Stefano-Franscini-Platz 5, Switzerland [email protected] Abstract Uncertainty Quantification (UQ) is paramount for inference in engineering applications. A common inference task is to recover full-field information of physical systems from a small number of noisy observations, a usually highly ill-posed problem. Critically, engineering systems often have complicated and variable geometries prohibiting the use of standard Bayesian UQ. In this work, we introduce Geometric Autoencoders for Bayesian Inversion (GABI), a framework for learning geometry-aware generative models of physical responses that serve as highly informative geometry-conditioned priors for Bayesian inversion. Following a “learn first, observe later” paradigm, GABI distills information from large datasets of systems with varying geometries, without requiring knowledge of governing PDEs, boundary conditions, or observation processes, into a rich latent prior. At inference time, this prior is seamlessly combined with the likelihood of the specific observation process, yielding a geometry-adapted posterior distribution. Our proposed framework is architecture agnostic. A creative use of Approximate Bayesian Computation (ABC) sampling yields an efficient implementation that utilizes modern GPU hardware. We test our method on: steady-state heat over rectangular domains; Reynold-Averaged Navier-Stokes (RANS) flow around airfoils; Helmholtz resonance and source localization on 3D car bodies; RANS airflow over terrain. We find: the predictive accuracy to be comparable to deterministic supervised learning approaches in the restricted setting where supervised learning is applicable; UQ to be well calibrated and robust on challenging problems with complex geometries. The method provides a flexible geometry-aware train-once-use-anywhere foundation model which is independent of any particular observation process. 1 Introduction Many important problems in engineering deal with spatially varying quantities that must be inferred. The task of inferring full-field information from sparse noisy measurement is a type of inverse problem ( Kaipio & Somersalo 2005 ) ; these often need to be regularized due to their inherent ill-posedness ( Calvetti & Reichel 2003 ) . Statistically interpretable regularization can be achieved through the Bayesian paradigm ( Stuart 2010 ) , where we combine a likelihood function characterizing data fit for a particular observation process, and a prior which characterizes assumptions about the data-generating process. Bayesian inference allows for robust and principled uncertainty quantification, where we obtain a distribution on the estimated quantity of interest given data from a particular physical system. The main challenge in enacting a Bayesian program is prior specification; often, not much can be said about the prior which often leads to diffuse and vague posteriors with relatively poor predictive accuracy when compared to deterministic methods. To alleviate this vagueness, one possible strategy is to learn a suitable prior from a dataset of related but distinct physical setups where more data may be available. This is explored in general-purpose AI applications ( Shwartz-Ziv et al. 2022 ; Feng et al. 2023 ; Boys et al. 2024 ) and physical applications ( Meng et al. 2022 ; Akyildiz et al. 2025 ; Patel & Oberai 2021 ; Patel et al. 2022 ; Laloy et al. 2018 ; Laloy et al. 2017 ) . However, in engineering, geometry plays a crucial role in determining the dynamics arising for a physical system. Hence, for truly general purpose, practical methodology, learned priors must incorporate knowledge about the geometry of the problem at hand. But changing geometries hinder the direct learning of a prior over fields as the probability spaces involved are tied to the geometry of each individual physical system, prohibiting a direct Bayesian treatment. In this work we propose a methodology, using graph autoencoders, to learn highly informative priors as geometry-aware generative models for use in Bayesian inversion tasks. We also show how to effectively solve the Bayesian inverse problems resulting from these priors through a pushfoward model. Importantly, the proposed scheme decouples the task of “learning” and the task of ”inferring from observations”, resulting in train-once use everywhere approach which is independent of the particular observation process for solving inverse problems, a trait not shared by related supervised learning approaches. We make the following contributions: (C1) We propose a methodology to encode geometries and physical fields into a learned latent prior; without specifying the governing PDE or boundary conditions. (C2) We prove that solving the Bayesian inverse problem in the learned latent representation solves the same problem as the inversion in the original space with a pushforward prior. (C3) The proposed methodology is naturally extended to the Bayesian estimation of other important information about the observation process such as learning the observational noise. (C4) We test the proposed methodology on: a steady-state heat problem, RANS flow around airfoils of varying geometries, damped Helmholtz resonance and source localization on car geometries. We compare our methods to supervised neural network-based methods and Graph Gaussian Processes where relevant. (C5) We demonstrate the scalability of the method on a large terrain flow problem through a multi-GPU implementation; showing potential for training GABI foundation models. Section 1.1 discusses the inference setup in detail; Section 1.2 goes over relevant related works; Section 2 describes the proposed methodology; Section 3 discusses the implementation of the proposed method; Section 4 tests and compares the proposed method; Appendices A , B , C , elaborate on proofs, additional numerical results and implementation details, relevant discussions on VAEs. 1.1 Setup Let u_{n}\in\mathcal{U}_{n}:=\mathcal{U}(\mathcal{M}_{n};\mathbb{R}^{d_{u}}) be a (possibly vector valued) function representing the full field state of a physical system on the bounded domain \mathcal{M}_{n}\subset\mathbb{R}^{d} . This domain may be a manifold as we will see later. In this work, u_{n} will be: heat on a surface, fluid flow in a domain, and resonance patterns on an object. Here the index n refers to the different physical systems which have possibly different geometries, forcing, and boundary conditions. In numerically representing these continuous systems we obtain discretized node values \mathbf{u}_{n}\in\mathsf{U}_{n}:=\mathsf{U}(\mathsf{M}_{n};\mathbb{R}^{d_{u}}) which live on \mathsf{M}_{n}=(\mathsf{V}_{n},\mathcal{E}_{n}) where \mathsf{V}_{n}=\{x_{1},\ldots,x_{d_{n}}\}\subset\mathcal{M}_{n} is a set of vertices and \mathcal{E}_{n} is a set of edges connecting the vertices. As such, we represent \mathsf{M}_{n} as an undirected graph describing the physical geometries on which the physics is taking place, i.e. a computational mesh. We assume to have a dataset \mathcal{D}=\{\mathbf{u}_{n},\mathsf{M}_{n}\}_{n=1}^{N} 1 1 1 A dataset with multiple full-fields per geometry \mathsf{M}_{n} , as \{\{\mathbf{u}_{n,i}\}_{i=1}^{N_{n}},\mathsf{M}_{n}\}_{n=1}^{N} , can viewed as a dataset \{\mathbf{u}_{k},\mathsf{M}_{k}\}_{k=1}^{K} indexed by a dummy variable k such that k maps to (i,n) . . This dataset can be constructed from simulation data, as is the case in this paper, or from full-field data from experiment such as through particle image velocimetry, digital image correlation, magnetic resonance, electrical impedance tomography, infrared thermography etc. First, in the proposed methodology we learn a \mathsf{M}_{n} -dependent prior generative model for \mathbf{u}_{n} . Second, using this learned highly informative prior and sparse noisy observations, \mathbf{y}_{o}\in\mathbb{R}^{d_{o}} 2 2 2 When discussing observations which are associated to a geometry not in the dataset \mathcal{D} we change the index from n to o for clarity. , of a new physical system on a new geometry, \mathsf{M}_{o} , we solve the Bayesian inverse problem to obtain the posterior

Read the complete text