Size Transferability of Graph Transformers with Convolutional Positional Encodings

Javier Porras-Valenzuela, Zhiyang Wang, Xiaotao Shang, Alejandro Ribeiro · 2026

Read Size Transferability of Graph Transformers with Convolutional Positional Encodings by Javier Porras-Valenzuela, Zhiyang Wang, Xiaotao Shang, Alejandro Ribeiro (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15239.txt.

Description

Porras-Valenzuela and colleagues study size-transferability of graph transformers with convolutional positional encodings. Such models succeed widely, motivating graph transformers as focus-based designs for graph-structured data. A key design choice is graph neural network-based position codes that add shape information. The team views such models through manifold limit models for graph series and shows a theory link between them with such codes and manifold neural networks.

Building on size-transfer results for graph neural networks under limit meeting, they show such models inherit size-transfer pledges from their position codes. Notably, models trained on small graphs provably carry over to larger graphs under mild assumptions. Tests on standard graph benchmarks show scaling behavior on par with graph neural networks. A real-world build for shortest path distance gauging over terrains further shows the speed of movable models, suggesting usable paths for lean training at large scale.

Catalog record

CREATORJavier Porras-Valenzuela, Zhiyang Wang, Xiaotao Shang, Alejandro Ribeiro
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-15239

Browse the full library · About the Tower of Babel