On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning
Álvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero, Claudio Gallicchio, Xiaowen Dong, Michael Bronstein, Pierre Vandergheynst · 2025
Read On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning by Álvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero, Claudio Gallicchio, Xiaowen Dong, Michael Bronstein, Pierre Vandergheynst (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10818.txt.
Description
Alvaro Arroyo and co-authors trace three graph network diseases, vanishing gradients, over smoothing, and over squashing, to one root in training dynamics, in work from twenty twenty-five. Graph networks pass messages between nodes, but deep stacks blur node identities and strangle far away signals. The trio of flaws was usually treated apart.
Reading graph networks as recurrent models, they apply control theory tools to the message flow. Proofs and tests show gradients die within a few layers by design. Over smoothing follows from the same mechanism. A plain state space rewrite of the network eased both flaws at no extra parameter cost. Over squashing yields best to rewiring plus gradient care together.
Catalog record
| CREATOR | Álvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero, Claudio Gallicchio, Xiaowen Dong, Michael Bronstein, Pierre Vandergheynst |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-10818