Integrating Locality-Aware Attention with Transformers for General Geometry PDEs

Minsu Koh Beom-Chul Park Dept. of Artificial Intelligence Dept. of Artificial Intelligence Korea University, Seoul, South Korea Korea University, Seoul, South Korea [email protected] [email protected], Heejo Kong Seong-Whan Lee * Dept. of Brain and Cognitive Engineering Dept. of Artificial · 2025

Read Integrating Locality-Aware Attention with Transformers for General Geometry PDEs by Minsu Koh Beom-Chul Park Dept. of Artificial Intelligence Dept. of Artificial Intelligence Korea University, Seoul, South Korea Korea University, Seoul, South Korea [email protected] [email protected], Heejo Kong Seong-Whan Lee * Dept. of Brain and Cognitive Engineering Dept. of Artificial (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13480.txt.

Description

Minsu Koh, Beom-Chul Park, Heejo Kong, and Seong-Whan Lee improve machine learning for physics equations in a 2025 paper. Many science and engineering problems are stated as partial differential equations, and learned solvers can be much faster than classic ones. Grid-based solvers struggle on odd shapes, while attention-based solvers often miss fine local detail.

Their model, LA2Former, groups nearby points into patches that adapt to the shape at hand. It mixes a fast attention that reads the whole field with a close-range attention that reads local structure. Across six test data sets, accuracy rose by more than half over existing methods. The design keeps computing cost in check while handling complex shapes and fine detail together.

Catalog record

CREATORMinsu Koh Beom-Chul Park Dept. of Artificial Intelligence Dept. of Artificial Intelligence Korea University, Seoul, South Korea Korea University, Seoul, South Korea [email protected] [email protected], Heejo Kong Seong-Whan Lee * Dept. of Brain and Cognitive Engineering Dept. of Artificial
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-13480

Browse the full library · About the Tower of Babel