Generative Inverse Design with Abstention via Diagonal Flow Matching

Miguel de Campos, Werner Krebs, Hanno Gottschalk · 2026

Read Generative Inverse Design with Abstention via Diagonal Flow Matching by Miguel de Campos, Werner Krebs, Hanno Gottschalk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15925.txt.

Introduction

de Campos, Krebs, and Gottschalk fix ordering glitches in generative inverse design. Design tools learn maps between parameters and target traits. Plain conditional flow matching reacts badly to coordinate order and scale. Training then wobbles across runs and layouts. Their Diagonal Flow Matching anchors designs to noise and labels to zero. The learning task becomes provably blind to coordinate shuffles. Round-trip error drops far below flow and invertible baselines. Two doubt scores flag shaky candidates. Abstention and out-of-distribution spotting follow from those scores.

Catalog record

CREATORMiguel de Campos, Werner Krebs, Hanno Gottschalk
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69832
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.15925

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generative Inverse Design with Abstention via Diagonal Flow Matching Miguel de Campos, Werner Krebs, Hanno Gottschalk Abstract Inverse design aims to find design parameters x x achieving target performance y ∗ y^{*} . Generative approaches learn bidirectional mappings between designs and labels, enabling diverse solution sampling. However, standard conditional flow matching (CFM), when adapted to inverse problems by pairing labels with design parameters, exhibits strong sensitivity to their arbitrary ordering and scaling, leading to unstable training. We introduce Diagonal Flow Matching (Diag–CFM), which resolves this through a zero-anchoring strategy that pairs design coordinates with noise and labels with zero, making the learning problem provably invariant to coordinate permutations. This yields order-of-magnitude improvements in round-trip accuracy over CFM and invertible neural network baselines across design dimensions up to P = 100 P{=}100 . We develop two architecture-intrinsic uncertainty metrics, Zero-Deviation and Self-Consistency, that enable three practical capabilities: selecting the best candidate among multiple generations, abstaining from unreliable predictions, and detecting out-of-distribution targets; consistently outperforming ensemble and general-purpose alternatives across all tasks. We validate on airfoil, gas turbine combustor, and an analytical benchmark with scalable design dimension. 1 Introduction In many engineering domains, the design process involves finding geometric or parametric configurations that achieve desired performance characteristics. Traditional approaches to this problem rely on forward design, where engineers iteratively propose designs and evaluate their performance through simulations or experiments. This process can be time-consuming and may not efficiently explore the design space, and often ends with a single feasible design alternative. Inverse design reverses this paradigm: given target performance specifications, the goal is to directly generate designs that satisfy those requirements. This approach has gained significant attention in fields ranging from aerodynamics ( Sekar et al. 2019 ) to photonics ( Molesky et al. 2018 ) and materials science ( Noh et al. 2020 ) , where the ability to efficiently navigate complex, high-dimensional design spaces is crucial. Recent advances in generative modeling have enabled a new paradigm: generative design, where deep learning models learn from data to generate design parameters ( Ardizzone et al. 2019 ) . These models, including variational autoencoders (VAEs), generative adversarial networks (GANs) ( Chen et al. 2020 ) , and more recently diffusion models ( Ni et al. 2023 ) , can generate novel designs conditioned on desired performance criteria. Unlike optimization-based inverse design methods that solve for a single design per query, generative models can produce diverse design candidates that all satisfy the given specifications, offering engineers multiple options to choose from based on additional constraints or preferences not captured in the performance metrics. In this work, we develop an invertible conditional flow matching architecture ( Lipman et al. 2022 ) for generative design that operates bidirectionally, and is capable of both generating parametric designs given performance labels and computing performance predictions from designs. However, this generative capability introduces a critical challenge: the network will produce a design for any input performance specification, even those that are physically unfeasible or lie outside the training distribution. For instance, in aerodynamic design, the model might generate an airfoil shape for lift and drag coefficients that violate fundamental physical constraints. Without a mechanism to assess the reliability of generated designs, practitioners cannot distinguish between trustworthy predictions and spurious outputs. We address this challenge through uncertainty quantification (UQ) ( Abdar et al. 2021 ) , introducing methods to quantify the model’s confidence that a generated design genuinely achieves the specified performance. We develop two architecture-specific metrics—Zero-Deviation and Self-Consistency—that exploit the bidirectional structure of our flow, and compare against general-purpose baselines including ensemble methods ( Dietterich 2000 ) . These UQ metrics enable users to filter out unreliable designs and focus on candidates that the model confidently predicts will meet the desired specifications. We demonstrate the effectiveness of our approach on three design tasks: airfoil aerodynamics ( Kanchi et al. 2025 ) , gas turbine combustor design ( Krueger et al. 2024 ) , and a scalable multi-objective benchmark ( Deb et al. 2005 ) . 1.1 Contributions • Diagonal Flow Matching (Diag–CFM) : a zero-anchoring strategy for conditional flow matching that induces a learning problem whose difficulty is provably independent of coordinate ordering. This eliminates the sensitivity to design and label permutations present in standard CFM, yielding order-of-magnitude improvements in round-trip accuracy across design dimensions up to P{=}100 . • Architecture-specific uncertainty metrics : two novel methods—Zero-Deviation and Self-Consistency—that exploit Diag–CFM’s bidirectional structure. Zero-Deviation is computed as a byproduct of generation with no additional forward passes. We compare against ensemble variance and flow matching loss baselines. • Comprehensive evaluation on three datasets (gas turbine combustor, airfoil aerodynamics, and DTLZ benchmark) demonstrating that our uncertainty metrics enable three practical capabilities: selecting the best candidate among multiple generations, abstaining from unreliable predictions, and detecting out-of-distribution targets. This paper is structured as follows: In Section 2 we discuss related work, and make our problem set-up explicit in Section 3 . Section 4 introduces diagonal flow matching (Diag–CFM) and our Uncertainty Quantification (UQ) metrics. Section 5 explains experiments and results. We conclude in Section 6 with summary and outlook. 2 Related Work 2.1 Inverse Design Inverse design refers to the class of methods that, given target performance specifications y^{\star} , aim to directly synthesize designs x such that the forward response f(x) matches y^{\star} as closely as possible. In its most common formulation, one seeks a solution of the constrained optimization problem \arg\min_{x\in\mathcal{X}}\mathcal{L}\!\big(f(x),y^{\star}\big)+R(x) , where f denotes a (possibly expensive) simulator or surrogate, \mathcal{L} measures the mismatch between achieved and desired performance, and R encodes regularization or additional engineering constraints. This framework has been widely adopted across engineering disciplines, including aerodynamic shape optimization ( Sekar et al. 2019 ) , nanophotonics ( Molesky et al. 2018 ) , and materials design ( Noh et al. 2020 ) . In many of these applications, gradients of f with respect to x are obtained via adjoint methods or automatic differentiation, enabling efficient gradient-based optimization even in high-dimensional design spaces. However, the inverse design problem is typically ill-posed: the mapping f is many-to-one, so there may exist a manifold of designs \{x:f(x)\approx y^{\star}\} , while non-convexity leads to local minima and optimization trajectories that are sensitive to initialization and hyperparameters. In many cases, forward surrogate models like neural networks or Gaussian processes are used for inverse design tasks, see e.g. ( Forrester et al. 2008 ; Martins & Ning 2021 ) . Here first a fast surrogate model is trained on expensive simulation data and the costly inverse search is then performed on the surrogate model. Despite considerable speedup, this method still suffers from being based on a forward model and in general is not capable to provide a comprehensive set of design alternatives ( Krueger et al. 2024 ) . 2.2 Generative Inverse Design Recent approaches replace iterative optimization with learned mappings. Physics-informed neural networks ( Raissi et al. 2019 ; Cai et al. 2021 ) and operator learning models ( Lu et al. 2021 ; Li et al. 2021 ; Drygala et al. 2022 ; Ross et al. 2025 ) learn fast forward surrogates but remain unidirectional. Domain-specific generative models have been developed for applications including airfoil parameterization via GANs ( Chen et al.

Read the complete text