Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers

Shyam Sankaran, Hanwen Wang, Paris Perdikaris · 2026

Read Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers by Shyam Sankaran, Hanwen Wang, Paris Perdikaris (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25949.txt.

Description

Sankaran, Wang and Perdikaris argue that clever structure beats sheer size in neural solvers for partial differential equations. Those equations govern fields like waves and fluids. WaveLiT combines wavelet transforms, which split signals across scales, with linear attention and a multiscale feature pyramid. Models of one to ten million parameters rival foundation models up to a thousand times larger on eight benchmarks. The biggest wins come on wave-dominated problems, and a ten-million-parameter joint variant transfers best where the wavelet prior fits the physics.

Catalog record

CREATORShyam Sankaran, Hanwen Wang, Paris Perdikaris
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73256
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25949

Browse the full library · About the Tower of Babel