A Physics Informed Machine Learning Framework for Optimal Sensor Placement and Parameter Estimation

Georgios Venianakis, Constantinos Theodoropoulos, Michail Kavousanakis · 2025

Read A Physics Informed Machine Learning Framework for Optimal Sensor Placement and Parameter Estimation by Georgios Venianakis, Constantinos Theodoropoulos, Michail Kavousanakis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15543.txt.

Introduction

Georgios Venianakis, Constantinos Theodoropoulos, and Michail Kavousanakis build a framework that decides where to place sensors and estimates unknown parameters at the same time. Measuring data can be costly, sparse, or noisy, so sensor placement matters most for systems that vary across space. Their tool is a physics-informed neural network, a network trained to respect the governing equations while fitting data.

Unknown parameters enter the network as extra inputs, so sensitivity of outputs to those parameters comes out through automatic differentiation. A classic D-optimality criterion then picks sensor spots that carry the most information. On two reaction and flow problems of rising complexity, the method estimated parameters more accurately than estimates from other placements.

Catalog record

CREATORGeorgios Venianakis, Constantinos Theodoropoulos, Michail Kavousanakis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-15543

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Physics Informed Machine Learning Framework for Optimal Sensor Placement and Parameter Estimation Georgios Venianakis, Constantinos Theodoropoulos, Michail Kavousanakis Abstract Parameter estimation remains a challenging task across many areas of engineering. Because data acquisition can often be costly, limited, or prone to inaccuracies (noise, uncertainty) it is crucial to identify sensor configurations that provide the maximum amount of information about the unknown parameters, in particular for the case of distributed-parameter systems, where spatial variations are important. Physics-Informed Neural Networks (PINNs) have recently emerged as a powerful machine-learning (ML) tool for parameter estimation, particularly in cases with sparse or noisy measurements, overcoming some of the limitations of traditional optimization-based and Bayesian approaches. Despite the widespread use of PINNs for solving inverse problems, relatively little attention has been given to how their performance depends on sensor placement. This study addresses this gap by introducing a comprehensive PINN-based framework that simultaneously tackles optimal sensor placement and parameter estimation. Our approach involves training a PINN model in which the parameters of interest are included as additional inputs. This enables the efficient computation of sensitivity functions through automatic differentiation, which are then used to determine optimal sensor locations exploiting the D-optimality criterion. The framework is validated on two illustrative distributed-parameter reaction-diffusion-advection problems of increasing complexity. The results demonstrate that our PINNs-based methodology consistently achieves higher accuracy compared to parameter values estimated from intuitively or randomly selected sensor positions. † † highlights: A PINN framework for joint sensor placement and parameter estimation is presented. Sensor locations are optimized using sensitivity functions and D-optimal design. The framework is demonstrated for reaction-diffusion-advection systems. Optimal placement yields improved parameter estimates over heuristic choices. keywords ,Machine Learning ,Physics Informed Neural Networks ,D-optimality,distributed-parameter systems,Fisher Information matrix ,automatic differentiation † † corresponding: Corresponding authors Nomenclature NN Neural Network PINN Physics Informed Neural Network FIM Fisher Information Matrix AD Automatic Differentiation RAR-D Residual-based Adaptive Refinement with Distribution FEM Finite Element Method \mathbf{u} General state variable(s) \lambda Unknown parameters vector \lambda^{prior} A priori parameter estimate vector s_{\lambda_{j}} Sensitivity function to the parameter \lambda_{j} F FIM \mathbf{x}^{*}_{1},\dots,\mathbf{x}^{*}_{N} Selected spatial coordinates of N sensors \tilde{\cdot} Dimensionless form of a variable \hat{\mathbf{u}} Approximation of \tilde{\mathbf{u}} (Numerical or PINN) \theta NN’s trainable parameters (weights and biases) \mathcal{L}(\theta) NN’s total loss function \mathcal{L}_{f}(\theta) Loss function term corresponding to the PDE residual(s) \mathcal{L}_{ic}(\theta) Loss function term corresponding to the initial condition residual \mathcal{L}_{bc}(\theta) Loss function term corresponding to the boundary conditions residuals \mathcal{L}_{sens}(\theta) Loss function term corresponding to the sum of partial derivatives of all residuals w.r.t. all the parameters of interest c Species concentration (kg/m^{3}) \mathbf{v} Velocity Field (m/s) p Pressure (Pa) D Diffusion coefficient (m^{2}/s) k Reaction rate constant of an n-th order reaction ((kg/m^{3})^{1-n}\cdot s^{-1}) U Fluid’s mean inlet velocity (m/s) \rho Fluid density (kg/m^{3}) \mu Fluid viscosity (Pa\cdot s) \tau Characteristic time scale (s) Pe Péclet number Da Damköhler number Re Reynolds number 1 Introduction Distributed-parameter systems, based on partial differential equations (PDEs), typically describing spatiotemporal variations, represent a wide range of physical systems and phenomena in science and engineering. These PDE-based models typically involve multiple unknown parameters, often corresponding to physical properties of the system, whose accurate identification from available data is essential for reliable prediction and effective system design. In general, the accuracy of parameter estimation improves as more data is collected. Nevertheless, acquiring large datasets is often expensive or impractical. This motivates the development of systematic methods for selecting sensor locations that maximize the information gained about the unknown parameters under constraints on the number of sensors. Most research on Optimal Sensor Placement has focused on state estimation, while comparatively fewer studies have addressed parameter estimation directly ( 1 ; 2 ) . Existing approaches typically rely on scalar measures derived from the Fisher Information Matrix (FIM), which captures the sensitivity of observable quantities with respect to parameters. For example, the modified E-criterion ( 34 ; 45 ; 36 ) minimizes the ratio of the largest to the smallest eigenvalue of the FIM, while 22 proposed minimizing the expected Bayesian loss involving the trace of the inverse FIM. The widely used D-optimality criterion ( 41 ; 44 ) maximizes the determinant of the FIM (or the Gram determinant), and a closely related approach minimizes the information entropy ( 38 ) , reflecting the uncertainty of the parameter under a given sensor configuration. In large-scale distributed systems, parameter estimation can be facilitated by combining model reduction with optimal sensor placement. In 3 , the proposed workflow is to construct a Proper Orthogonal Decomposition (POD) reduced-order model that captures the dominant spatio-temporal dynamics and then determine measurement locations by optimizing an observability-based criterion on this reduced model. 1 further streamline this process by proposing sensor placement directly at the extrema of the dominant POD modes, an approach that circumvents costly sensitivity-matrix computations while still providing near-optimal parameter estimation performance. Once sensor locations are defined, the next step is parameter estimation. Optimization-based methods, such as Maximum Likelihood Estimation (MLE) ( 35 ) , remain the most established, with Least Squares as the most common implementation under the assumption of Gaussian measurement noise ( 6 ; 14 ) . While effective, these methods typically require repeated model evaluations, resulting in high computational cost, particularly when gradients with respect to parameters must also be computed. Moreover, the accuracy of estimated parameters may degrade under sparse or noisy data ( 28 ) . Bayesian methods offer an alternative by incorporating prior information and providing full uncertainty quantification through posterior distributions ( 12 ; 23 ; 27 ) . Nevertheless, Bayesian inference often relies on Markov Chain Monte Carlo (MCMC) sampling ( 21 ) , which requires extensive forward model evaluations and can be sensitive to prior selection in data-limited settings ( 30 ) . Recent advances in machine learning have substantially enhanced the field of parameter estimation by introducing data-driven methodologies capable of capturing complex relationships between model parameters and observed data. Traditional statistical approaches, such as maximum likelihood estimation and Bayesian inference, have been extended through modern techniques, such as variational inference ( 7 ) and neural density estimation ( 39 ) that enable efficient and accurate parameter recovery, even in complex or high-dimensional settings. Furthermore, deep neural architectures, coupled with gradient-based optimization algorithms, including stochastic gradient descent and its adaptive variants ( 8 ) , facilitate scalable and robust inference across a wide range of applications. Hybrid modeling frameworks that integrate data with first-principles formulations have merged as powerful tools for scientific computing. Among these, Physics-Informed Neural Networks (PINNs) ( 42 ) exploit the expressivity of deep neural networks ( 24 ) while embedding governing PDEs as soft constraints. PINNs have proven particularly useful in scenarios where traditional solvers face challenges: complex geometries (since PINNs are mesh-free), high-dimensional problems ( 25 ) . and systems with incomplete physics that require data-driven enhancement ( 43 ) . Importantly, PINNs enable parameter estimation by directly incorporating unknown parameters into the training process, making them robust even under sparse or noisy observations, which is of particular relevance to this work. Numerous studies have applied PINNs to inverse problems in chemical engineering and related fields. Examples include the estimation of thermal properties in additive manufacturing ( 32 ) , thermal diffusivity

Read the complete text