Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers
Shyam Sankaran, Hanwen Wang, Paris Perdikaris · 2026
Read Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers by Shyam Sankaran, Hanwen Wang, Paris Perdikaris (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25949.txt.
Description
Sankaran, Wang and Perdikaris argue that clever structure beats sheer size in neural solvers for partial differential equations. Those equations govern fields like waves and fluids. WaveLiT combines wavelet transforms, which split signals across scales, with linear attention and a multiscale feature pyramid. Models of one to ten million parameters rival foundation models up to a thousand times larger on eight benchmarks. The biggest wins come on wave-dominated problems, and a ten-million-parameter joint variant transfers best where the wavelet prior fits the physics.
Catalog record
| CREATOR | Shyam Sankaran, Hanwen Wang, Paris Perdikaris |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73256 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25949