The Riemannian Geometry associated to Gradient Flows of Linear Convolutional Networks
El Mehdi Achour [email protected], Kathlén Kohn [email protected], Holger Rauhut [email protected] · 2025
Read The Riemannian Geometry associated to Gradient Flows of Linear Convolutional Networks by El Mehdi Achour [email protected], Kathlén Kohn [email protected], Holger Rauhut [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06367.txt.
Description
El Mehdi Achour, Kathlén Kohn, and Holger Rauhut study the geometry behind training for a simple class of neural networks in this 2025 paper. Their networks apply learned filters across images but stay linear, which keeps the math tractable. Training moves the filters downhill on an error surface, a path called gradient flow.
For fully connected linear networks, earlier work showed the training path can be rewritten as a flow measured by a curved geometry on the space of functions. That result needed a special balanced start. The authors prove the rewrite holds for convolutional networks no matter how training starts. The result covers multi-dimensional filters, and the one-dimensional case when the filter strides exceed one. The geometry itself still depends on the starting point. The findings give a cleaner picture of how these networks learn.
Catalog record
| CREATOR | El Mehdi Achour [email protected], Kathlén Kohn [email protected], Holger Rauhut [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06367