Integrating Locality-Aware Attention with Transformers for General Geometry PDEs
Minsu Koh Beom-Chul Park Dept. of Artificial Intelligence Dept. of Artificial Intelligence Korea University, Seoul, South Korea Korea University, Seoul, South Korea [email protected] [email protected], Heejo Kong Seong-Whan Lee * Dept. of Brain and Cognitive Engineering Dept. of Artificial · 2025
Read Integrating Locality-Aware Attention with Transformers for General Geometry PDEs by Minsu Koh Beom-Chul Park Dept. of Artificial Intelligence Dept. of Artificial Intelligence Korea University, Seoul, South Korea Korea University, Seoul, South Korea [email protected] [email protected], Heejo Kong Seong-Whan Lee * Dept. of Brain and Cognitive Engineering Dept. of Artificial (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13480.txt.
Description
Minsu Koh, Beom-Chul Park, Heejo Kong, and Seong-Whan Lee improve machine learning for physics equations in a 2025 paper. Many science and engineering problems are stated as partial differential equations, and learned solvers can be much faster than classic ones. Grid-based solvers struggle on odd shapes, while attention-based solvers often miss fine local detail.
Their model, LA2Former, groups nearby points into patches that adapt to the shape at hand. It mixes a fast attention that reads the whole field with a close-range attention that reads local structure. Across six test data sets, accuracy rose by more than half over existing methods. The design keeps computing cost in check while handling complex shapes and fine detail together.
Catalog record
| CREATOR | Minsu Koh Beom-Chul Park Dept. of Artificial Intelligence Dept. of Artificial Intelligence Korea University, Seoul, South Korea Korea University, Seoul, South Korea [email protected] [email protected], Heejo Kong Seong-Whan Lee * Dept. of Brain and Cognitive Engineering Dept. of Artificial |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13480