Efficient Dilated Squeeze and Excitation Neural Operator for Differential Equations
Prajwal Chauhan [email protected], Salah Eddine Choutri [email protected], Saif Eddin Jabari [email protected] · 2026
Read Efficient Dilated Squeeze and Excitation Neural Operator for Differential Equations by Prajwal Chauhan [email protected], Salah Eddine Choutri [email protected], Saif Eddin Jabari [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17407.txt.
Introduction
Prajwal Chauhan, Salah Eddine Choutri, and Saif Eddin Jabari present a lean neural operator for physics equations. Fast surrogate models stand in for costly solvers. They serve aerodynamics, porous media design, and flow control. Many current operators are heavy, with too many parameters. Heavy models train slowly and deploy poorly. The team's design uses dilated squeeze and excitation blocks.
Those blocks widen the view while keeping size in check. The aim is speed with care kept high. A light operator can run on modest hardware in real time. That opens live design loops that heavy models block. Engineers gain a tool that fits the pace of design work.
Catalog record
| CREATOR | Prajwal Chauhan [email protected], Salah Eddine Choutri [email protected], Saif Eddin Jabari [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17407
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Dilated Squeeze and Excitation Neural Operator for Differential Equations Prajwal Chauhan [email protected], Salah Eddine Choutri [email protected], Saif Eddin Jabari [email protected] Abstract Fast and accurate surrogates for physics-driven partial differential equations (PDEs) are essential in fields such as aerodynamics, porous media design, and flow control. However, many transformer-based models and existing neural operators remain parameter-heavy, resulting in costly training and sluggish deployment. We propose D-SENO (Dilated Squeeze-Excitation Neural Operator), a lightweight operator learning framework for efficiently solving a wide range of PDEs, including airfoil potential flow, Darcy flow in porous media, pipe Poiseuille flow, and incompressible Navier–Stokes vortical fields. D-SENO combines dilated convolution (DC) blocks with squeeze-and-excitation (SE) modules to jointly capture wide receptive fields and dynamics alongside channel-wise attention, enabling both accurate and efficient PDE inference. Carefully chosen dilation rates allow the receptive field to focus on critical regions, effectively modeling long-range physical dependencies. Meanwhile, the SE modules adaptively recalibrate feature channels to emphasize dynamically relevant scales. Our model achieves training speed of up to ≈ 20 × \approx 20\times faster than standard transformer-based models and neural operators, while also surpassing (or matching) them in accuracy across multiple PDE benchmarks. Ablation studies show that removing the SE modules leads to a slight drop in performance. 1 Introduction Partial differential equations (PDEs) dictate many natural phenomena, from synoptic-scale weather systems to wingtip vortices, to subsurface multiphase flow, and many more. Conventional numerical solvers such as finite difference, finite volume, spectral, and finite element schemes deliver high fidelity, yet their cost explodes with mesh resolution, geometric complexity, and parametric sweeps 15 . To close this computational gap, the focus is increasingly shifting to machine learning surrogates, which reduce the cost of high-resolution data in training and then provide accurate predictions at lower cost. Recent neural PDE solvers range from physics-informed regressor to fully data-driven operator learners, each occupying a different point on the spectrum of accuracy, flexibility, and computational efficiency. At the physics-heavy end of the spectrum, physics-informed neural networks (PINNs) embed the governing equations, initial conditions, and boundary conditions directly into the loss via automatic differentiation, allowing them to train on sparse or even entirely unlabeled solution data. However, their stiff multiscale residuals make optimization delicate, and each change in geometry or forcing profile usually requires an expensive full retraining or at least substantial fine-tuning 17 . To reduce training and inference costs, recent work has focused on operator learning, where a single neural network approximates the solution operator, mapping input functions to their corresponding PDE solutions across a family of problems. The first operator–learning model, DeepONet 13 , represents the mapping with two sub-networks: a branch net that processes the input function and a trunk net that evaluates basis functions at the query points. Its mesh-free design and small parameter count make it attractive for parametric problems, yet running both nets at every spatial point slows training and inference as the grid becomes large 14 . To mitigate this scaling bottleneck and capture interactions that extend across the entire domain, subsequent work turned to architectures with built-in global couplings. The Fourier Neural Operator (FNO) addresses these goals by exchanging, to certain extent, spatial locality for spectral mixing 11 : Fast Fourier transforms (FFT) reduce complexity to \mathcal{O}(N\log N) and grant mesh invariance, but the resulting all-to-all convolution can blur sharp discontinuities and inflate GPU memory on large three-dimensional domains such as wind-tunnel flows. To enhance spatial locality, some variants perform FFTs over overlapping windows or decompose the integral kernels onto wavelet bases 4 , 21 . While, these approaches partially recover local interactions, the necessary window overlap or boundary padding adds computational overhead and can introduce artifacts that complicates training. In fixed Cartesian grids, U - NO 16 combines global Fourier-based integral layers with a U-Net-style encoder–decoder and multiscale skip connections. whereas F - FNO 20 employs separable spectral (Fourier) layers factorized across dimensions alongside residual shortcuts. Like FNO, both U - NO and F - FNO inherit its core limitations: they depend on global FFTs, making them naturally suitable for periodic and uniform grids. They also share FNO’s high memory and computational costs, especially in higher dimensions. Their spectral kernels require deeper architectures or windowed variants to capture fine - scale locality, which further increases overhead and can destabilize training. Transformer-based neural operators have recently advanced the state of the art by leveraging multi-head attention to capture long-range dependencies. However, standard self-attention scales quadratically with the number of spatial grid points \mathcal{O}(N^{2}) , making high-resolution problems computationally demanding without aggressive sparsification or patching strategies 1 ; 3 . Among these models, Transolver 24 introduces a physics-aware clustering mechanism that groups flow-aligned regions before applying intra- and inter-cluster attention. This approach yields state-of-the-art accuracy across several PDE benchmarks, outperforming FNO, UNO, and prior transformer-based baselines. Despite its accuracy gains, Transolver incurs substantial computational overhead: its iterative clustering, multi-stage refinement, and large hidden dimensions lead to training and inference times an order of magnitude higher than many neural operator architectures. Our Contribution We introduce D-SENO, a lightweight neural operator architecture designed for fast and accurate surrogate modeling of partial differential equations (PDEs). While previous convolution-based neural operators (e.g., CNO 18 ) rely on fixed receptive fields and uniform filter patterns, D-SENO advances this paradigm by effectively integrating two key components within a unified framework: 1. Dilated Convolutional Blocks: We apply residual blocks with non-uniform, dataset-specific dilation rates across spatial dimensions. This allows the model to flexibly expand its receptive field and capture multiscale spatial dependencies, while maintaining strict locality and linear computational complexity. In contrast to the Dilated Convolution Neural Operator (DCNO) 26 , which employs all dilation rates in every process block, our approach customizes and selects a single, dataset - specific rate per block and connects them via residual links for improved expressiveness and adaptability. 2. Convolutional Channel Attention: To enhance channel-wise expressiveness without global operations, we incorporate Squeeze-and-Excitation (SE) blocks 7 using pointwise convolutions. These blocks dynamically recalibrate feature channels based on global context, improving relevance to physical patterns without incurring the overhead of transformer-style attention. This architecture remains strictly local and fully convolutional, requiring neither Fourier transforms nor self-attention mechanisms. All layers preserve spatial resolution and scale linearly with input size, making D-SENO particularly efficient for high-resolution PDE inference. We validate our model on diverse PDE benchmarks, including airfoil potential flow, Poiseuille pipe flow, heterogeneous Darcy flow, and Navier–Stokes vortices. D-SENO achieves high accuracy while offering up to a 20\times speedup in training and inference over state-of-the-art neural operator and transformer-based surrogates. The remainder of this paper is organized as follows: we begin by reviewing the relevant prior work, followed by discussing the core components of our approach, then detail the architecture and training protocol of D-SENO, and finally evaluate its accuracy, efficiency, and generalization across multiple PDE benchmarks. 2 Related Work While the literature contains a wide array of neural PDE surrogates, we focus our discussion on representative models that are most relevant to our approach: the Fourier Neural Operator (FNO), the Convolutional Neural Operator (CNO), and the Dilated Convolutional Neural Operator (DCNO). We briefly summarize their core methodologies and highlight their limitations in the context of our work. Fourier Neural Operator (FNO). The Fourier