Convergence of gradient based training for linear Graph Neural Networks
Dhiraj Patel, Anton Savostianov, Michael T. Schaub · 2025
Read Convergence of gradient based training for linear Graph Neural Networks by Dhiraj Patel, Anton Savostianov, Michael T. Schaub (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14440.txt.
Description
Graph neural networks learn from connected data, from molecules to social webs, yet their training is poorly understood in theory. Dhiraj Patel, Anton Savostianov, and Michael Schaub strip the model to its linear core and ask a clean question: does gradient training find the best possible fit? For the continuous version of training, the answer is yes.
They prove the loss falls to its global minimum exponentially fast. The speed depends plainly on the starting weights and on the operator that spreads information along the graph. Synthetic and real datasets confirmed the predicted rates. The team also studies the discrete, step-by-step version used in practice. Their work gives linear graph networks a firm theoretical floor.
Catalog record
| CREATOR | Dhiraj Patel, Anton Savostianov, Michael T. Schaub |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-14440