Soft Partition-based KAPI-ELM for Multi-Scale PDEs

Vikas Dwivedi, Monica Sigovan, Bruno Sixou · 2026

Read Soft Partition-based KAPI-ELM for Multi-Scale PDEs by Vikas Dwivedi, Monica Sigovan, Bruno Sixou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08719.txt.

Introduction

Vikas Dwivedi, Monica Sigovan, and Bruno Sixou work on hard math problems that come from physics. Such problems can change fast in one place and slow in a next place. Old tools that learn from physics rules often fail on them. They need much time to train, and they need hand set wave sizes to work well.

The team builds a new tool with the short name KAPI-ELM. It splits the space into soft parts that can shift and grow. Those parts set both the test points and the width of small bell shaped curves. In this way the tool can move from a wide view to a fine view in one smooth step. It needs no fixed wave parts and no hard walls in the space.

Catalog record

CREATORVikas Dwivedi, Monica Sigovan, Bruno Sixou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-08719

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Soft Partition-based KAPI-ELM for Multi-Scale PDEs Vikas Dwivedi, Monica Sigovan, Bruno Sixou Abstract Physics-informed machine learning holds great promise for solving differential equations, yet existing methods struggle with highly oscillatory, multiscale, or singularly perturbed PDEs due to spectral bias, costly backpropagation, and manually tuned kernel or Fourier frequencies. This work introduces a soft partition–based Kernel-Adaptive Physics-Informed Extreme Learning Machine (KAPI–ELM), a deterministic low-dimensional parameterization in which smooth partition lengths jointly control collocation centers and Gaussian kernel widths, enabling continuous coarse-to-fine resolution without Fourier features, random sampling, or hard domain interfaces. A signed-distance–based weighting further stabilizes least-squares learning on irregular geometries. Across eight benchmarks—including oscillatory ODEs, high-frequency Poisson equations, irregular-shaped domains, and stiff singularly perturbed convection–diffusion problems—the proposed method matches or exceeds the accuracy of state-of-the-art Physics-Informed Neural Network (PINN) and Theory of Functional Connections (TFC) variants while using only a single linear solve. Although demonstrated on steady linear PDEs, the results show that soft-partition kernel adaptation provides a fast, architecture-free approach for multiscale PDEs with broad potential for future physics-informed modeling. For reproducibility, the reference codes are available at https://github.com/vikas-dwivedi-2022/soft_kapi K eywords PINN \cdot PIELM \cdot Domain Decomposition \cdot Multi-scale PDEs \cdot Singularly Perturbed 1 Introduction Physics-informed machine learning has become a widely used paradigm for solving differential equations across science and engineering, offering mesh-free formulations that embed physical laws directly into the learning process. However, many real-world models exhibit multiscale structure , highly oscillatory dynamics , or stiff boundary layers —regimes in which existing approaches often become inaccurate, unstable, or computationally expensive. Physics-Informed Neural Networks (PINNs ( 17 ) ) have achieved impressive results on smooth PDEs, but they suffer from spectral bias ( 22 ; 16 ; 23 ) , slow gradient-based training ( 11 ) , and strong sensitivity to architectural choices for PDEs with sharp gradients ( 1 ; 14 ) . Fourier-feature PINNs ( 21 ) and sinusoidal embeddings partially mitigate high-frequency underfitting, yet introduce additional frequency hyperparameters and lead to high computational cost ( 15 ) . Domain-decomposition PINNs ( 12 ) improve local resolution but require hard interface constraints , complicating the loss landscape and becoming fragile for extremely thin boundary layers ( 13 ; 2 ; 10 ) . Physics-Informed Extreme Learning Machines (PI–ELMs ( 9 ; 6 ; 5 ) ) remove backpropagation entirely and train through a single least-squares solve, but their randomly sampled Gaussian centers and widths cannot adapt to localized multiscale features ( 7 ) . Recent extensions using Fourier feature mappings ( 18 ) improve high-frequency accuracy but again depend on manual frequency tuning. Kernel-Adaptive PI–ELM (KAPI–ELM ( 8 ) ) introduced distributional hyperparameters to adapt sampling, yet the method remains slightly overparameterized, heuristic-driven in terms of RBF width decay rate, and has not been systematically extended to a general multiscale-cum-singularly perturbed PDE solver. Despite significant progress, there remains no simple adaptive sampling strategy that can: (i) simultaneously resolve high-frequency oscillations and exponentially thin boundary layers within a single formulation, (ii) avoid Fourier feature mappings and their frequency-tuning burden, (iii) eliminate interface penalties required by domain-decomposition approaches, and (iv) retain the analytic efficiency and speed of PI–ELM. Existing methods rely either on heavy backpropagation (PINNs, Fourier-PINNs), manual frequency engineering (Fourier-feature PINNs/ELMs), or stochastic and heuristic distributional tuning (original KAPI–ELM). None of them provide a unified geometric mechanism that smoothly allocates resolution across the domain, especially for multiscale PDEs where layer thickness can vary by orders of magnitude. To bridge these gaps, we introduce a soft partition–based Kernel-Adaptive PI–ELM (KAPI–ELM) framework that resolves multiscale, oscillatory, and singularly perturbed PDEs without Fourier embeddings, neural-network architectures, or domain-decomposition interface losses. The core idea is to replace pointwise or stochastic adaptivity with a deterministic soft partition of the domain: smoothly varying partition lengths jointly control (i) the density of collocation centers and (ii) the local scaling of Gaussian kernels. This yields continuous rather than abrupt refinement, avoids hard interfaces, and provides a natural coarse-to-fine mechanism aligned with boundary layers, interior gradients, and high-frequency modes. In parallel, an SDF-weighted PDE residual formulation stabilizes learning near irregular boundaries, enabling high accuracy on complex geometries without meshing or reparameterization. The resulting method remains fully backpropagation-free: all solutions are obtained from a single linear least-squares system, and only a handful of hyperparameters (partition lengths) are optimized externally. Contributions The main contributions of this work are as follows: • Soft partition–based sampling for adaptive multiscale resolution. We introduce a deterministic, low-dimensional parameterization in which smooth partition lengths govern both the placement of collocation centers and their associated Gaussian widths, producing stable coarse-to-fine adaptivity without hard interfaces. • Unified framework for oscillatory, multiscale, and singularly perturbed PDEs. The proposed method is, to our knowledge, the first PI–ELM-based approach capable of resolving high-frequency oscillations and exponentially thin boundary layers within the same formulation, without Fourier feature mappings or domain decomposition. • Fourier-free high-frequency accuracy. The method achieves multiscale expressivity purely through analytically prescribed Gaussian widths tied to partition lengths—requiring no Fourier embeddings, frequency heuristics, or manual tuning. • Geometry-agnostic SDF-weighted residuals. We introduce a signed-distance–based weighting strategy that stabilizes least-squares learning near irregular boundaries while remaining fully mesh-free and easily applicable to arbitrary domains. • Efficient, backprop-free, and low-dimensional optimization. All solutions reduce to a single linear least-squares solve, and the external optimization acts on only a small number of partition parameters, yielding significant speedups over PINNs, Fourier-PINNs, and earlier KAPI–ELM variants. Organization The remainder of this paper is organized as follows. Section 2 revisits PI–ELM and the original KAPI–ELM framework. Section 3.1 introduces the proposed soft partition–based KAPI–ELM, including center and width construction in one and two dimensions, the associated optimization strategy, and the SDF-weighted residual formulation. Section 4 presents extensive numerical experiments—covering highly oscillatory ODEs, high-frequency 2D Poisson problems, irregular-domain elliptic PDEs, and stiff singularly perturbed boundary-layer equations—demonstrating the method’s accuracy, robustness, and multiscale capability. Section 5 outlines current limitations and opportunities for extending soft partitioning to transient, nonlinear, and higher-dimensional PDEs. Finally, Section 6 summarizes the main findings and discusses broader implications for mesh-free physics-informed kernel methods. 2 Preliminaries: PI–ELM and Kernel-Adaptive PI–ELM We consider a linear differential operator \mathcal{L}_{\nu}(\cdot) defined on a domain \Omega\subset\mathbb{R} with boundary \partial\Omega , parameterized by a PDE coefficient \nu . The goal is to approximate the solution of \mathcal{L}_{\nu}(u)=R(x),\qquad x\in\Omega,\qquad u(x)=g(x),\qquad x\in\partial\Omega, (1) where R is the source term and g the boundary data. 2.1 Physics-Informed Extreme Learning Machine (PI–ELM) PI–ELM ( 9 ; 3 ) represents the solution as a global expansion of N^{*} Gaussian radial basis functions, \hat{u}(x)=\sum_{i=1}^{N^{*}}c_{i}\exp\!\left[-\frac{(x-\alpha_{i}^{*})^{2}}{2\sigma_{i}^{2}}\right], (2) where the RBF centers \alpha_{i}^{*} and widths \sigma_{i} are drawn randomly from prescribed distributions, and the output weights \mathbf{c}=[c_{1},\ldots,c_{N^{*}}]^{\top} are determined analytically. Enforcing the PDE residual and boundary conditions at the collocation points yields a linear system H\mathbf{c}=\mathbf{r}, (3) whose minimum-norm least-squares solution is obtained via the Moore–Penrose pseudoinverse, \mathbf{c}=H^{\dagger}\mathbf{r}. (4) Thus PI–ELM requires no backpropagation and trains in a single least-squares step. However, its accuracy depends strongly on the randomly sampled kernel parameters (\alpha_{i}^{*},\sigma_{i}) , which remain fixed during training and cannot adapt to sharp layers or multiscale behavior. 2.2 Kernel-Adaptive PI–ELM (Original KAPI–ELM) The original KAPI–ELM ( 8 ) augments PI–ELM by introducing a low-dimensional set of distributional hyperparameters that govern the sampling of RBF centers

Read the complete text