EngiBench: A Framework for Data-Driven Engineering Design Research

Florian Felten, Gabriel Apaza, Gerhard Bräunlich, Cashen Diniz, Xuliang Dong, Arthur Drake, Milad Habibi, Nathaniel J. Hoffman, Matthew Keeler, Soheyl Massoudi, Francis G. VanGessel, Mark Fuge · 2025

Read EngiBench: A Framework for Data-Driven Engineering Design Research by Florian Felten, Gabriel Apaza, Gerhard Bräunlich, Cashen Diniz, Xuliang Dong, Arthur Drake, Milad Habibi, Nathaniel J. Hoffman, Matthew Keeler, Soheyl Massoudi, Francis G. VanGessel, Mark Fuge (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00831.txt.

Introduction

Florian Felten and co-authors present an open library for data-driven design work in a paper from two thousand twenty-five. Design search looks for shapes and settings that score best on physics tests. Those tests are costly to run and hard to set up, which slows the search.

Their library, EngiBench, gives one common front end and curated test sets across fields such as flight, heat flow, and light devices. A second library adds search and learning methods built for the same front end. Tools cover data making, checks for valid designs, plots, and reports. Tests of leading methods showed the tasks stay hard for standard machine learning, the authors say.

Catalog record

CREATORFlorian Felten, Gabriel Apaza, Gerhard Bräunlich, Cashen Diniz, Xuliang Dong, Arthur Drake, Milad Habibi, Nathaniel J. Hoffman, Matthew Keeler, Soheyl Massoudi, Francis G. VanGessel, Mark Fuge
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00831

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EngiBench: A Framework for Data-Driven Engineering Design Research Florian Felten, Gabriel Apaza, Gerhard Bräunlich, Cashen Diniz, Xuliang Dong, Arthur Drake, Milad Habibi, Nathaniel J. Hoffman, Matthew Keeler, Soheyl Massoudi, Francis G. VanGessel, Mark Fuge Abstract Engineering design optimization seeks to automatically determine the shapes, topologies, or parameters of components that optimize performance under given conditions. This process often depends on physics-based simulations, which are difficult to install, computationally expensive, and require domain-specific expertise. To mitigate these challenges, we introduce EngiBench, the first open-source library and datasets spanning diverse domains for data-driven engineering design. EngiBench provides a unified API and a curated set of benchmarks—covering aeronautics, heat conduction, photonics, and more—that enable fair, reproducible comparisons of optimization and machine learning algorithms, such as generative or surrogate models. We also release EngiOpt, a companion library offering a collection of such algorithms compatible with the EngiBench interface. Both libraries are modular, letting users plug in novel algorithms or problems, automate end-to-end experiment workflows, and leverage built-in utilities for visualization, dataset generation, feasibility checks, and performance analysis. We demonstrate their versatility through experiments comparing state-of-the-art techniques across multiple engineering design problems, an undertaking that was previously prohibitively time-consuming to perform. Finally, we show that these problems pose significant challenges for standard machine learning methods due to highly sensitive and constrained design manifolds. 1 1 1 Documentation: https://engibench.ethz.ch . Benchmarks code: https://github.com/IDEALLab/EngiBench . Datasets: https://huggingface.co/IDEALLab . Learning and optimization library code: https://github.com/IDEALLab/EngiOpt . Figure 1 : Overview of EngiBench and EngiOpt components. 1 Introduction Designing complex engineering systems has traditionally relied on iterative optimization processes and computationally expensive simulations. Recent advances in machine learning (ML)—particularly in inverse design (ID) and surrogate modeling (SM)—offer promising alternatives. Rather than repeatedly evaluating candidate designs through costly simulations, ID methods aim to generate designs directly from desired conditions and performance specifications, while surrogate models approximate simulation outputs. By significantly reducing the number of simulation calls, these approaches enable more efficient exploration of design spaces and lower computational costs. Engineering design researchers have explored ML methods for accelerating design exploration and optimization in many different directions: approximating optimal designs [ 9 ] , comparing neural operators or surrogate models [ 15 ] , exploring design spaces/configurations [ 35 ] , studying transfer learning [ 4 ] , among many others. However, progress in data-driven engineering design has been significantly slowed by the lack of standardized simulation environments and publicly available, diverse datasets [ 60 ] . Most existing datasets are not shared, making it difficult to reproduce results or compare methods fairly. Even for datasets that do exist, different problem formulations often use different conventions or metrics, making it difficult or time consuming to compare algorithms across problems. Lastly, generating new datasets is not only computationally expensive, but also requires configuring and deploying complex simulation software—such as for computational fluid dynamics (CFD), finite element analysis (FEA), or circuit simulation—which can take weeks or even months and demands considerable domain expertise. This complexity presents a barrier to entry for ML researchers without an engineering background, narrowing research in these domains. As a result, researchers often focus on a single application domain, limiting broader generalization and hindering cross-domain benchmarking of algorithms. To address this gap, we introduce EngiBench —an open-source library supporting multiple domains in data-driven engineering design. 2 2 2 EngiBench builds on the Maryland Inverse Design Benchmark (MIDBench) project ( https://ideal.umd.edu/midbench/ ), which served as an initial prototype but did not reach the maturity needed for publication or widespread adoption. It provides an intuitive and extensible Python API that unifies the modeling of diverse design problems and includes a suite of rigorously tested problem implementations. Each EngiBench problem comprises a simulation engine and an associated dataset—encapsulating designs, objective values, attributes, and conditions—accessible via a standardized interface (see Fig. 1 ). To showcase the possibilities of using our framework, we also open-source a CleanRL-style [ 31 ] companion library called EngiOpt , which contains a collection of ML and optimization algorithms integrated with EngiBench . The key contributions of this paper are: 1. Novel challenging ML tasks that include hard constraints on what defines a feasible solution, and domain-specific metrics going further than statistical similarity, see Section 2.1 . We show that the proposed problems are far from trivial, as these manifolds are highly sensitive to slight changes in the design space ( e.g. , keeping the continuity of an airfoil spline), making them difficult to learn with traditional methods, see Section 4 . 2. A unified API which can be used in various optimization or ML paradigms, including inverse design, surrogate-based optimization, physics-informed neural networks (PINNs), etc. This API eases testing algorithms on a diverse set of problems for the engineering design community, see Section 3.1 . 3. Easy access to a diverse collection of real-world engineering design problems and associated physics simulators modeling different physical laws. The datasets collected on these problems are also made publicly available. These include problems across aerodynamics, heat transfer, power electronics design, photonics, etc., see Section 3.3 . 4. A curated set of well-known generative and optimization algorithms implementations compatible with our API. This allows for benchmarking of multiple baseline algorithms across various design problems. In our proof-of-concept experiments, we observe that, contrary to popular belief, unconditional generative adversarial networks (GANs) may outperform their conditional counterparts and diffusion models on specific metrics relevant to engineering design; see Section 4 . 2 Preliminaries and Related Work EngiBench aims at easing the work of researchers in ML for engineering design, but also proposes new challenges for the ML community. This section first defines the problem, its solutions, and how progress is generally measured in the field, it then discusses existing related works and how EngiBench differs from those. 2.1 Problem setting The problem of finding optimal designs in engineering, often approached computationally, can be formulated as the following optimization problem. Let x\in\mathcal{X}\subseteq\mathbb{R}^{d} represent the design variables ( e.g. , spline parameters of an airfoil), a:\mathcal{X}\mapsto\mathcal{A}\subseteq\mathbb{R}^{k} be attributes computed for each design ( e.g. , mass), c\in\mathcal{C}\subseteq\mathbb{R}^{l} represent the environmental conditions ( e.g. , cruising velocity), f:\mathcal{X}\times\mathcal{C}\mapsto\mathcal{F}\subseteq\mathbb{R}^{o} be a (multi-)objective function ( e.g. , drag and lift), \sigma represent simulation assumptions and limitations ( e.g. , numerical approximations), and g and h represent inequality and equality constraints, respectively ( e.g. , a constraint ensuring the lift coefficient must exceed a given minimum). Then, without loss of generality, \underset{x\in\mathcal{X}}{\text{minimize}}\,\tilde{f}(x,c,\sigma)\quad\text{subject to}\quad\begin{aligned} &g_{i}(x,a(x),c,\sigma)\leq 0,\quad i=1,\dots,q,\\ &h_{j}(x,a(x),c,\sigma)=0,\quad j=1,\dots,r,\end{aligned} where \tilde{f} only approximates the true objective f due to the simulation assumptions & limitations \sigma . 3 3 3 For conciseness, we often omit \sigma and denote \tilde{f}(x,c,\sigma) as \tilde{f}(x,c) . The solutions to this problem depend on the specific context and can take different forms: a single optimal design, a Pareto set of optimal designs when multiple objectives are considered, or a diverse set of near-optimal designs, allowing the human designer to select the most suitable one when exploring the design space. Solving methods In engineering design, optimization methods such as genetic algorithms (GAs) or adjoint solvers have traditionally been used to search for the optimal design variables x^{*}\in\mathcal{X} . However, this process is computationally expensive, as it requires running simulation software to evaluate each design. ML approaches, such as inverse

Read the complete text