SUPRA: Subspace Parameterized Attention for Neural Operator on General Domains
Zherui Yang, Zhengyang Xue, Ligang Liu · 2025
Read SUPRA: Subspace Parameterized Attention for Neural Operator on General Domains by Zherui Yang, Zhengyang Xue, Ligang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15897.txt.
Description
Zherui Yang, Zhengyang Xue, and Ligang Liu present a 2025 arXiv paper on faster computer solvers for partial differential equations. Neural operators learn to mimic such solvers, but their accuracy tricks carry costs: attention grows too slow on big meshes, and spectral methods demand neat grids and flat shapes. The authors rebuild attention itself to escape both traps.
They note that attention's matrix work can be read as operations on whole functions, then shrink that endless space down to a small subspace. For odd-shaped domains, the subspace is built from the domain's own vibration modes, which fit its geometry and capture smooth functions well. On several equation data sets the resulting operator, SUPRA, cut errors by up to a third while keeping top-tier speed. The work suits engineering problems on real, messy shapes.
Catalog record
| CREATOR | Zherui Yang, Zhengyang Xue, Ligang Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15897