Convergence of gradient based training for linear Graph Neural Networks

Dhiraj Patel, Anton Savostianov, Michael T. Schaub · 2025

Read Convergence of gradient based training for linear Graph Neural Networks by Dhiraj Patel, Anton Savostianov, Michael T. Schaub (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14440.txt.

Description

Graph neural networks learn from connected data, from molecules to social webs, yet their training is poorly understood in theory. Dhiraj Patel, Anton Savostianov, and Michael Schaub strip the model to its linear core and ask a clean question: does gradient training find the best possible fit? For the continuous version of training, the answer is yes.

They prove the loss falls to its global minimum exponentially fast. The speed depends plainly on the starting weights and on the operator that spreads information along the graph. Synthetic and real datasets confirmed the predicted rates. The team also studies the discrete, step-by-step version used in practice. Their work gives linear graph networks a firm theoretical floor.

Catalog record

CREATORDhiraj Patel, Anton Savostianov, Michael T. Schaub
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14440

Browse the full library · About the Tower of Babel