IGA-ODIL: Optimizing DIscretre robust Loss with Isogeometric Analysis to solve forward and inverse problems faster using machine learning tools.

Maciej Paszyński, Tomasz Służalec · 2026

Read IGA-ODIL: Optimizing DIscretre robust Loss with Isogeometric Analysis to solve forward and inverse problems faster using machine learning tools. by Maciej Paszyński, Tomasz Służalec (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30272.txt.

Introduction

Maciej Paszyński and Tomasz Służalec present IGA-ODIL, a spline-based residual minimization method mixing discrete loss, variational minimization, and Isogeometric Analysis. PINNs solve equations by residual minimization, but gradient descent is expensive. Instead, IGA-ODIL models the solution with B-spline functions, giving sparse Jacobians and fast Gauss-Newton optimization. Gram weights tie the loss to the true error. Tests on Poisson, advection-diffusion, Helmholtz, Allen-Cahn and inverse problems show large speedups over PINNs with accuracy.

Catalog record

CREATORMaciej Paszyński, Tomasz Służalec
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57184
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30272

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IGA-ODIL: Optimizing DIscretre robust Loss with Isogeometric Analysis to solve forward and inverse problems faster using machine learning tools. Maciej Paszyński, Tomasz Służalec Abstract Physics-informed neural networks (PINNs) formulate the solution of partial differential equations as residual minimization problems over neural network parameterizations. Although highly flexible, optimization of PINNs using modern variants of Stochastic Gradient Descent algorithms is expensive. On the other hand, iterative computation of PINN parameterization using the Gauss-Newton method suffers from convergence difficulties, dense Jacobian structures, and poor conditioning that limit the effectiveness of second-order optimization methods. In this work, we introduce IGA-ODIL, a spline-based residual minimization framework combining ideas from Optimizing DIscrete Loss (ODIL), robust variational residual minimization, and Isogeometric Analysis (IGA). Instead of neural-network parameterizations of PINNs, the unknown solution is represented by smooth B-spline basis functions, leading to sparse structured Jacobians and efficient Gauss–Newton optimization. We also derive robust residual formulations based on weighted Gram operators, making the loss function related with the true error. The resulting systems inherit locality, sparsity, and approximation-theoretic properties of classical finite element and isogeometric methods while preserving the residual-learning philosophy of scientific machine learning. The proposed methodology is evaluated on several benchmark problems, including Poisson equations, convection-dominated advection–diffusion equations, Helmholtz problems with highly oscillatory solutions, nonlinear Allen–Cahn equations, and inverse Helmholtz parameter identification. Numerical experiments demonstrate orders-of-magnitude speedups compared with PINNs and CRVPINNs while maintaining high accuracy and robustness. 1 Introduction Scientific machine learning has recently emerged as a rapidly developing research direction at the intersection of numerical analysis, partial differential equations (PDEs), optimization, and machine learning. Among the most influential approaches are Physics-Informed Neural Networks (PINNs), introduced by Raissi, Perdikaris, and Karniadakis [ 1 ] . PINNs formulate the numerical solution of PDEs as residual minimization problems in which the unknown solution is represented by a neural network and the governing equations are enforced through collocation-based residual losses. Numerous extensions and variants have appeared, including Variational PINNs (VPINNs) [ 9 ] , Deep Ritz methods [ 10 ] , adaptive and domain-decomposition formulations, as well as operator-learning approaches such as Fourier Neural Operators [ 21 ] . More general overviews of scientific machine learning and physics-informed learning frameworks can be found in [ 20 ] . Recent applications show that PINNs are used particularly often in fluid mechanics, where they support flow reconstruction, inverse parameter identification, and data assimilation from sparse or noisy measurements [ 2 ] . They have been applied to wake flows, biomedical flows, supersonic flows, and experimental stratified flows, demonstrating their potential for combining measurement data with Navier–Stokes-type models [ 2 , 6 ] . PINNs have been used for heat transfer in porous media, where they can estimate temperature fields, heat fluxes, and effective thermal conductivity without requiring dense labeled data [ 3 ] . They have also been applied to two-phase flow and heat transfer problems, where the physics-informed loss helps enforce the governing equations while learning from simulation data [ 4 ] . More recently, PINNs have been considered as components of digital twins, where the goal is to combine sensor data, reduced-order modeling, and physical constraints for real-time prediction and uncertainty-aware monitoring [ 5 ] . Despite their flexibility, PINNs suffer from several important numerical and theoretical difficulties. Optimization landscapes associated with deep neural-network parameterizations are highly nonconvex and frequently exhibit poor conditioning, flat directions, vanishing gradients, and parameter symmetries [ 8 ] . As a consequence, first-order optimization methods such as stochastic gradient descent (SGD) and Adam [ 24 ] often converge slowly and unreliably. Furthermore, second-order methods such as Newton or Gauss–Newton optimization are difficult to apply effectively because the resulting Jacobians are typically large, dense, and ill-conditioned [ 19 ] . An additional difficulty is that the classical PINN residual loss generally lacks robustness with respect to physically meaningful norms. In many cases, the residual loss does not accurately represent the discretization error measured in Sobolev norms, leading to poor correlation between optimization convergence and physical solution quality [ 11 ] . This observation motivated the development of Robust Variational PINNs [ 11 ] , based on the weak residuals of Variational PINNs (VPINNs) [ 9 ] . Additionally, to speed up the loss estimation, Collocation-based Robust Variational Physics-Informed Neural Networks (CRVPINNs) [ 12 ] have been recently proposed. In particular, the robust loss takes the form \Phi(u)=R(u)^{T}G^{-1}R(u), (1) where G is a Gram matrix associated with a suitable variational inner product [ 11 ] , and R(u) is a weak residual in the case of VPINNs or a discrete weak residual (computed with Kronecker product delta test functions) in the case of CRVPINNs. Although robust residual formulations improve the stability of PINN losses, the optimization challenges associated with deep nonlinear parameterizations remain. Neural-network Jacobians remain globally coupled and dense, limiting the scalability and effectiveness of second-order optimization methods. A complementary research direction was recently proposed by Karnakov, Litvinov, and Koumoutsakos through the Optimizing DIscrete Loss (ODIL) framework [ 13 ] . The central idea of ODIL is that residual minimization does not fundamentally require neural-network parameterizations. Instead, the unknown solution is represented directly through discrete degrees of freedom optimized using PDE residual losses. ODIL demonstrated that many scientific machine learning ideas can be interpreted as optimization-based PDE discretizations rather than purely neural-network methods. ODIL interprets PDE solving as optimization over discrete degrees of freedom using residual losses evaluated at collocation points. The resulting formulation preserves many advantages of scientific machine learning, including natural extensions to inverse problems and PDE-constrained optimization. However, point-based ODIL discretizations are not globally continuous like neural network representations. They also lack several important properties associated with classical spline and finite element approximation spaces. In particular, point-value parameterizations do not naturally provide high-order smoothness, compactly supported basis functions, and approximation-theoretic properties associated with spline spaces and classical Galerkin discretizations [ 18 ] . Isogeometric Analysis, introduced by Hughes, Cottrell, and Bazilevs [ 14 ] , establishes spline-based discretizations as powerful alternatives to classical finite element methods. B-splines and NURBS provide smooth, high-order approximation spaces with excellent approximation properties, sparse local support, and direct compatibility with CAD geometries [ 14 , 15 , 16 , 25 , 26 ] . Recent applications of isogeometric analysis (IGA) show that it is widely used in problems where smoothness, high-order accuracy, and exact geometry representation are important. In fracture mechanics, IGA has been applied to phase-field models of brittle, anisotropic, and polycrystalline fracture, where the higher continuity of spline spaces is advantageous for fourth-order and gradient-enhanced formulations [ 30 , 31 , 32 , 38 ] . Another active direction is design and topology optimization, where the common representation of geometry and analysis fields supports design-through-analysis workflows [ 33 ] . Recent developments also extend IGA to complex CAD geometries using analysis-suitable T-splines and G-spline surfaces [ 34 , 35 ] . In fluid mechanics and aerodynamics, IGA has been used for turbulent flows, moving domains, fluid–structure interaction, and space–time simulations of complex engineering configurations [ 36 , 40 ] . Applications in biomechanics include cardiac electrophysiology and ventricular mechanics, where smooth patient-specific geometries and coupled multiphysics models are essential [ 37 , 39 ] . We propose an unified framework IGA-ODIL. The proposed methodology replaces

Read the complete text