PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems

Divyam Goel [email protected], Nithin Chalapathi [email protected], Sanjeev Raja [email protected], Aditi S. Krishnapriyan [email protected] · 2026

Read PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems by Divyam Goel [email protected], Nithin Chalapathi [email protected], Sanjeev Raja [email protected], Aditi S. Krishnapriyan [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25353.txt.

Introduction

Divyam Goel and colleagues fill a gap in machine learning for physics: benchmarks for inverse problems, where the goal is to recover hidden parameters from observed solutions. Their PDEInvBench dataset covers time-dependent and steady partial differential equations across varied physical behaviors and parameters, with splits testing both familiar and shifted settings. The team explores training methods, problem encodings, and scaling in one design study. Two-stage training works best, derivative features consistently help, and diverse starting conditions beat wider parameter ranges. Dataset and code are public.

Catalog record

CREATORDivyam Goel [email protected], Nithin Chalapathi [email protected], Sanjeev Raja [email protected], Aditi S. Krishnapriyan [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96971
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25353

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems Divyam Goel [email protected], Nithin Chalapathi [email protected], Sanjeev Raja [email protected], Aditi S. Krishnapriyan [email protected] Abstract Inverse problems in partial differential equations (PDEs) involve estimating the physical parameters of a system from observed spatiotemporal solution fields, a fundamental task in numerous scientific domains. Neural networks are well-suited for PDE parameter estimation due to their capability to model function-to-function space transformations. While existing benchmarks of machine learning methods for PDEs primarily focus on the forward problem — mapping physical parameters to solution fields—to our knowledge, there are no similar comprehensive studies and benchmark datasets on PDE inverse problems, i.e., mapping solution fields to underlying physical parameters. We fill this gap by introducing PDEInvBench , a comprehensive benchmark dataset consisting of numerical simulations for both time-dependent and time-independent PDEs across a wide range of physical behaviors and parameters. Our dataset includes evaluation splits that assess performance in both in-distribution and various out-of-distribution settings. Using our benchmark dataset, we comprehensively explore the design space of neural networks for PDE inverse problems along three key dimensions: (1) optimization procedures, analyzing the role of supervised, self-supervised, and test-time training objectives on performance, (2) problem representations, where we study the value of architectural choices with different inductive biases and various conditioning strategies, and (3) scaling, which we perform with respect to both model and data size. Our experiments reveal several practical insights: 1) neural networks perform best with a two-stage training procedure: initial supervision with PDE parameters followed by test-time fine-tuning using the PDE residual, 2) incorporating PDE derivatives as input features consistently improves accuracy, and 3) increasing the diversity of initial conditions in the training data yields greater performance gains than expanding the range of PDE parameters. We make our dataset and evaluation codebase freely available to facilitate reproducibility and further development of our work. The dataset is available at https://huggingface.co/datasets/DabbyOWL/PDE_Inverse_Problem_Benchmarking , and the codebase is available at https://github.com/ASK-Berkeley/PDEInvBench . 1 Introduction Inverse problems involve inferring unknown parameters or governing laws of a physical system using observed data, such as measurements of system behavior over space and time. They are ubiquitous in numerous domains including geophysics ( 58 ) , nanophotonics ( 49 ) , biomedical imaging ( 63 ) , and fluid dynamics ( 30 ) . In the case of systems modeled by partial differential equations (PDEs), the inverse modeling task is to map observed spatiotemporal solution fields to the underlying PDE parameters, which are typically physical constants such as viscosity, diffusivity, or the Reynolds number. Recent advances in machine learning (ML) have shown promise in learning effective representations for PDE-related tasks ( 54 ; 60 ; 26 ) . In particular, neural operators (NO) ( 42 ; 38 ) have emerged as powerful tools for modeling the mapping between function spaces. While significant progress has been made in establishing effective NO recipes for the forward problem ( 20 ; 57 ; 47 ) —predicting spatiotemporal solution fields from known PDE parameters—there has been comparatively less investigation into PDE inverse problems. The ill-posedness of PDE inverse problems, including issues of non-existence, non-uniqueness, and instability with respect to noisy observational measurements ( 18 ; 58 ; 32 ; 28 ) , represents a challenging regime with distinct challenges compared to the forward problem. In this work, we seek a principled understanding of the design space of neural network approaches — both within and outside the neural operator framework — for solving PDE inverse problems. As the first step, we introduce PDEInvBench , which is, to our knowledge, the first comprehensive dataset dedicated to benchmarking the performance of ML approaches for solving PDE inverse problems. Our dataset consists of high-quality numerical simulations of 5 PDE systems at various spatial resolutions, including Darcy flow (241x241, 421x421), reaction-diffusion (128x128, 512x512), unforced (64x64, 256x256) and forced Navier-Stokes (64x64, 2048x2048), and Korteweg-De Vries (256), at a wide range of physical parameter values and initial conditions. The PDEs cover a range of mathematical forms, including elliptic, hyperbolic and parabolic ( 19 ) . Similarly, parameter ranges are chosen to exhibit a variety of behaviors including Turing bifurcations, diffusion, steady-states, turbulence, and laminar flow. We construct evaluation splits for each PDE system to investigate performance in both in-distribution and various challenging out-of-distribution settings. Our second main contribution is the comprehensive benchmarking of ML-based methods for PDE inverse problems. We organize our investigation around three fundamental design axes: 1. Model optimization procedure: What is the optimal strategy for training neural networks for PDE inverse problems? Is a supervised loss from paired parameter-solution data sufficient, or is it also beneficial to incorporate physics-based PDE residual terms? How can test-time adaptation be used to improve generalization to new parameter regimes without explicit data? 2. Problem representation and inductive bias: The choice of neural architecture encodes implicit assumptions about the underlying problem. Do spectral biases (as in the Fourier Neural Operator), local convolutional patterns (as in ResNets), or global attention mechanisms (as in Transformers) best capture the relationship between solution fields and physical parameters? Should features like the derivative terms of the PDE be explicitly provided as input, or left for the network to learn implicitly? 3. Scaling properties: Resource constraints often force tradeoffs. Is it more beneficial to increase model size or to generate more training data? When generating data, should one prioritize covering more physical parameter values or more initial conditions? We evaluate models using standard ML metrics such as relative error and the slope of scaling curves. We also perform physically motivated evaluations, such as checking whether the energy spectra of numerical simulations evolved with the predicted PDE parameter match that of reference simulations. From our extensive experiments, we distill key insights that can guide practitioners in deploying neural networks for inverse problems. • A two-stage training approach is preferable when learning neural networks for PDE inverse problems: 1) training with a supervised data loss, followed by 2) test-time training using the PDE residual. • Explicitly conditioning networks on spatial and temporal derivatives significantly improves performance across all models and datasets. • For time-dependent PDEs, the FNO architecture generally outperforms ResNet and Transformer-style architectures. However, given the vast space of architectural factors, more studies should be conducted to better understand how model inductive biases affect predictions for PDE inverse problems. • For a fixed computational budget, generating multiple trajectories for each parameter value using different initial conditions yields greater performance gains than expanding parameter coverage. We release the PDEInvBench dataset 1 1 1 https://huggingface.co/datasets/DabbyOWL/PDE_Inverse_Problem_Benchmarking and evaluation codebase 2 2 2 https://github.com/ASK-Berkeley/PDEInvBench as a modular, standardized environment designed to facilitate systematic exploration of the PDE inverse problem design space and serve as a foundation for future methodological advancements by the community. Figure 1: Overview of design investigation of neural networks for PDE inverse problems. (A) We consider the inverse problem setting in which a neural network learns to map from PDE solution fields u(\phi) to predicted PDE parameters \hat{\phi} , using a dataset D consisting of parameter-solution pairs as supervision. (B) Our investigation is split across three key design axes: optimization procedures, problem representation, and scaling properties. (C) We benchmark on diverse datasets spanning different PDE families, including 2D Reaction

Read the complete text