Stability and Discretization Error of State Space Model Neural Operators
Abderrahim Bendahi, Adrien Fradin, Johan Peralez, Julie Digne, Madiha Nadri · 2026
Read Stability and Discretization Error of State Space Model Neural Operators by Abderrahim Bendahi, Adrien Fradin, Johan Peralez, Julie Digne, Madiha Nadri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18905.txt.
Introduction
Abderrahim Bendahi and four colleagues prove discretization error and stability bounds for neural operators for partial differential equations. Operator networks can approximate operators, but the link between continuous theory and discrete implementation had stayed loose. The authors prove bounds linking input smoothness to discretization, with a new error theorem for state-space-model and Fourier neural operators. An input-to-state analysis gauges how discretization affects results, and tests on one- and two-dimensional benchmarks back the bounds and show strength across resolutions.
Catalog record
| CREATOR | Abderrahim Bendahi, Adrien Fradin, Johan Peralez, Julie Digne, Madiha Nadri |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 147635 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18905
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stability and Discretization Error of State Space Model Neural Operators Abderrahim Bendahi, Adrien Fradin, Johan Peralez, Julie Digne, Madiha Nadri Abstract Neural operators have emerged as a powerful, discretization-invariant framework for solving partial differential equations (PDEs). Although established approaches like the Deep Operator Network (DeepONet) have successfully achieved universal approximation for operators, and architectures such as Fourier Neural Operators (FNOs) have shown algebraic convergence rates, a precise theoretical connection between the continuous theory and its discrete numerical implementation remains a challenge. Specifically, the relationship between the continuous formulation and the discrete numerical stability has yet to be fully explored. In this paper, we address this gap by establishing theoretical guarantees for the discretization error and stability of neural operator approximation schemes. We prove analytical bounds that link solution regularity to input discretization, providing a formal quantification of neural operator accuracy under real-world numerical constraints. We derive these bounds to the specific cases of State Space Model-based Neural Operators (SS-NOs) and FNOs, thus providing a new discretization error theorem for these models. Additionally, through an input-to-state stability (ISS) analysis, we formally assess the impact of discretization on the stability of SS-NOs results obtained in the continuous domain. Our empirical experiments on 1D and 2D benchmarks validate our theoretical bounds and show the robustness of SS-NOs under varying resolutions. 1 Introduction Scientific machine learning increasingly uses neural networks to solve partial differential equations Brunton and Kutz 2023 . Since solving PDEs amounts to learning solution operators, neural operators (NOs) Kovachki et al. 2023 have emerged as models between infinite-dimensional function spaces that can generalize across grid resolutions. Architectures such as DeepONet Lu et al. 2021 , Fourier Neural Operators (FNOs) Li et al. 2021 , and State Space Neural Operators (SS-NOs) are defined in the continuous domain, but their implementation requires discretizing the convolution kernel. Most analyses focus on the continuous setting Kovachki et al. 2021 , leaving open how discretization affects accuracy and stability. While discretization error has recently been studied for FNOs Lanthaler et al. 2025 , analogous guarantees for SS-NOs are still missing. In this work, we bridge this gap through three contributions: • Continuous stability. We prove Lipschitz stability of deep SS-NO architectures in infinite-dimensional Hilbert spaces. • Discretization error. We derive explicit continuous-to-discrete error bounds that account for the kernel and activation regularity. Compared with prior FNO results Lanthaler et al. 2025 , our analysis covers fractional Sobolev regularity, more general convolution kernels, and non-smooth activations such as ReLU and LeakyReLU . • Discrete stability. We prove a global stability bound for the discretized model, including both discretization error and input perturbations. 2 Related Work Neural operators aim to approximate mappings between infinite-dimensional function spaces Boullé and Townsend 2024 ; Lanthaler et al. 2025 ; Kovachki et al. 2024 . Unlike classical neural networks designed for finite-dimensional Euclidean spaces Boullé and Townsend 2024 ; Kovachki et al. 2023 ; Li et al. 2021 , neural operators are discretization-invariant, allowing them to share model parameters across different grid resolutions and providing significant speedups over traditional numerical solvers Boullé and Townsend 2024 ; Li et al. 2023a ; Li et al. 2021 . Foundational Approaches in Neural Operator Learning Deep Operator Networks (DeepONets) are a seminal neural-operator architecture based on the universal approximation theorem for operators, using a branch net for input functions and a trunk net for output locations Lu et al. 2021 . They achieve high-order error convergence and reduced generalization error compared to fully-connected networks on dynamic systems and PDEs Lu et al. 2021 . Theory has mainly studied universal approximation for neural operators composed of linear integral operators and nonlinear activations Kovachki et al. 2023 ; Boullé and Townsend 2024 . Subsequent architectures use graph kernels Li et al. 2020 ; Anandkumar et al. 2020 , learned physical-space kernels Gin et al. 2020 , physics priors Li et al. 2024 , or geometry-aware designs Li et al. 2023b . We focus on two theoretically relevant neural-operator families below. Fourier Neural Operators The Fourier Neural Operators (FNOs) introduced by Li et al. 2021 parameterize the integral kernel in Fourier space, enabling the modeling of turbulent flows with high efficiency. To handle complex geometries beyond uniform grids, Li et al. 2023a proposed Geo-FNO, which uses a learnable deformation to map irregular domains into a canonical latent space. On the theoretical side, Lanthaler et al. 2025 established convergence rates for FNOs, quantifying the discretization error between the continuous operator and its numerical implementation. We extend their results to SS-NOs, and beyond discretization error, we study the discrete stability of SS-NOs. State Space Models and SS-NO In parallel, Gu et al. 2022 introduced S4D, a simplified diagonal state space model (SSM) that captures long-range dependencies with minimal computational overhead. Building on this, the State Space Neural Operator (SS-NO) Koren and Lanthaler 2025 extends SSMs to joint spatiotemporal modeling. This architecture introduces adaptive damping and learnable frequency modulation, proving a universality theorem for full field-of-view convolutional architectures while maintaining high parameter efficiency on benchmarks like Navier-Stokes Koren and Lanthaler 2025 . Related efforts in computational efficiency also include generative frameworks like LD3 Tong et al. 2025 , which optimize time discretization to improve sampling efficiency in diffusion probabilistic models without retraining. However, a rigorous theoretical quantification of the discretization error and numerical stability for SS-NO architectures is currently missing. We address this gap by establishing explicit error bounds linked to the kernel parameters. 3 Preliminaries and Continuous Stability We introduce the neural-operator architecture and the FNO/SS-NO kernels, then prove continuous stability for SS-NO layers on the torus. 3.1 Definitions and Notation Notations. We let \mathbb{N}:=\left\{1,2,\ldots\right\} , \mathbb{T}^{d}\cong[0,1)^{d} the d -dimensional torus, and \mathcal{A} , \mathcal{U} are the Banach spaces of input and output functions respectively. For M\in\mathbb{R}^{H\times H} , {\left|\kern-1.07639pt\left|\kern-1.07639pt\left|M\right|\kern-1.07639pt\right|\kern-1.07639pt\right|}:=\sup_{\left\|x\right\|_{2}=1}\left\|Mx\right\|_{2} is the operator norm and \left\|M\right\|_{F}:=\sqrt{\mathop{\mathrm{Tr}}(MM^{\top})} is the Frobenius norm. Standard L^{p}(\mathbb{T}^{d}) and Sobolev H^{s}(\mathbb{T}^{d}) norms are denoted \left\|\cdot\right\|_{L^{p}} and \left\|\cdot\right\|_{H^{s}} . We define the discrete torus as the uniform grid \mathbb{T}^{d}_{N}:=\frac{1}{N}\left\{0,\ldots,N-1\right\}^{d}=\frac{1}{N}[N]^{d} , which we equip, for 1\leq p<+\infty , with the norm \left\|f\right\|_{\ell^{p}(\mathbb{T}_{N}^{d})}:=\left(\sum_{x\in\mathbb{T}_{N}^{d}}\left\|f(x)\right\|^{p}\right)^{1/p} . See Appendix B for more details on the function spaces considered. Building on the work of Lanthaler et al. 2025 , we consider neural operators acting on the torus \mathbb{T}^{d} : Definition 3.1 (Neural Operator) . Let \mathcal{A} and \mathcal{U} be Banach spaces of functions on \mathbb{T}^{d} . The operator \Psi_{\theta}\colon\mathcal{A}\to\mathcal{U} is composed of lifting ( \mathcal{P} ), projection ( \mathcal{Q} ), and T layers: \displaystyle\Psi_{\theta}:\! \displaystyle=\mathcal{Q}\circ\mathcal{L}_{T-1}\circ\cdots\circ\mathcal{L}_{0}\circ\mathcal{P} (1) \displaystyle v_{t+1} \displaystyle=\mathcal{L}_{t}v_{t}:=\sigma_{t}\left(W_{t}v_{t}+\mathcal{K}_{t}*v_{t}+b_{t}\right), (2) for t=0,\ldots,T-1 , with v_{0}=\mathcal{P}(a) . \mathcal{P}\colon\mathbb{R}^{d_{a}}\to\mathbb{R}^{d_{0}} and \mathcal{Q}\colon\mathbb{R}^{d_{T}}\to\mathbb{R}^{d_{u}} are shallow networks with smooth ( \mathscr{C}^{\infty} ) Lipschitz activations, \sigma_{t} is a L_{\sigma} –Lipschitz continuous activation function, W_{t}\in\mathbb{R}^{d_{t+1}\times d_{t}} and b_{t}\in\mathbb{R}^{d_{t+1}} are weights and biases, \mathcal{K}_{t} is the convolution kernel, and \theta denotes the collection of all learnable parameters. We now specify the kernel parameterizations for FNO and SS-NO architectures. Definition 3.2 (FNO Kernel) . For 1\leq K\leq N/2 and learnable matrices P_{t}^{(k)}\in\mathbb{C}^{d_{t+1}\times d_{t}} , we let: \mathcal{K}_{t}^{\text{FNO}}(z):=\sum_{k\in\left\{-K,\ldots,K\right\}^{d}}P_{t}^{(k)}e^{2i\pi k\cdot z}. (3) Definition 3.3 (SS-NO Kernels) . SS-NO kernels rely on 1D directional components. We distinguish the Product-Form (left) and the Sum-Form (right) in ( 4 ): \displaystyle\mathcal{K}_{t}^{\text{SS-NO}}(z):=\prod_{j=1}^{d}\left(\mathcal{K}^{(j)}_{t,+}(z_{j})+\mathcal{K}^{(j)}_{t,-}(z_{j})\right)\quad\mathcal{K}_{t}^{\text{SS-NO-FF}}(z):=\sum_{j=1}^{d}\left(\mathcal{K}^{(j)}_{t,+}(z_{j})+\mathcal{K}^{(j)}_{t,-}(z_{j})\right), (4) where each directional component \mathcal{K}^{(i)}_{t,\pm}(z_{i}) is defined as: \displaystyle\hskip-14.22636pt\mathcal{K}^{(i)}_{t,\pm}(z_{i}):=\mathbbm{1}_{\left\{\pm z_{i}\geq 0\right\}}\sum_{k=1}^{K}c_{t,k,i}e^{-\rho_{t,k,i}\left\lvert z_{i}\right\rvert}e^{i\omega_{t,k,i}z_{i}}C_{t,\pm}^{(k)}\left(B_{t,\pm}^{(k)}\right)^{\top}. The variables c_{t,k,i}\in\mathbb{R}