WaveGAS: Waveform Relaxation for Scaling Graph Neural Networks

Jana Vatter, Mykhaylo Zayats, Marcos Martínez Galindo, Vanessa López, Ruben Mayer, Hans-Arno Jacobsen, Hoang Thanh Lam · 2025

Read WaveGAS: Waveform Relaxation for Scaling Graph Neural Networks by Jana Vatter, Mykhaylo Zayats, Marcos Martínez Galindo, Vanessa López, Ruben Mayer, Hans-Arno Jacobsen, Hoang Thanh Lam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-19986.txt.

Description

Jana Vatter and co-authors present WaveGAS, a way to train graph neural networks on graphs too big for one graphics card's memory. A known method splits the graph into parts and stores old node codes from the last pass to share facts across the split. Those stored codes go stale, and the error grows layer by layer.

WaveGAS borrows a trick from circuit math: run several forward passes before the step that updates the weights, so the stored codes get refined. A second trick stores better records of past slopes. In tests the method beat the older split method and even beat tools that train on the whole graph at once.

Catalog record

CREATORJana Vatter, Mykhaylo Zayats, Marcos Martínez Galindo, Vanessa López, Ruben Mayer, Hans-Arno Jacobsen, Hoang Thanh Lam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-19986

Browse the full library · About the Tower of Babel