SUPRA: Subspace Parameterized Attention for Neural Operator on General Domains

Zherui Yang, Zhengyang Xue, Ligang Liu · 2025

Read SUPRA: Subspace Parameterized Attention for Neural Operator on General Domains by Zherui Yang, Zhengyang Xue, Ligang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15897.txt.

Description

Zherui Yang, Zhengyang Xue, and Ligang Liu present a 2025 arXiv paper on faster computer solvers for partial differential equations. Neural operators learn to mimic such solvers, but their accuracy tricks carry costs: attention grows too slow on big meshes, and spectral methods demand neat grids and flat shapes. The authors rebuild attention itself to escape both traps.

They note that attention's matrix work can be read as operations on whole functions, then shrink that endless space down to a small subspace. For odd-shaped domains, the subspace is built from the domain's own vibration modes, which fit its geometry and capture smooth functions well. On several equation data sets the resulting operator, SUPRA, cut errors by up to a third while keeping top-tier speed. The work suits engineering problems on real, messy shapes.

Catalog record

CREATORZherui Yang, Zhengyang Xue, Ligang Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15897

Browse the full library · About the Tower of Babel