The Riemannian Geometry associated to Gradient Flows of Linear Convolutional Networks

El Mehdi Achour [email protected], Kathlén Kohn [email protected], Holger Rauhut [email protected] · 2025

Read The Riemannian Geometry associated to Gradient Flows of Linear Convolutional Networks by El Mehdi Achour [email protected], Kathlén Kohn [email protected], Holger Rauhut [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06367.txt.

Description

El Mehdi Achour, Kathlén Kohn, and Holger Rauhut study the geometry behind training for a simple class of neural networks in this 2025 paper. Their networks apply learned filters across images but stay linear, which keeps the math tractable. Training moves the filters downhill on an error surface, a path called gradient flow.

For fully connected linear networks, earlier work showed the training path can be rewritten as a flow measured by a curved geometry on the space of functions. That result needed a special balanced start. The authors prove the rewrite holds for convolutional networks no matter how training starts. The result covers multi-dimensional filters, and the one-dimensional case when the filter strides exceed one. The geometry itself still depends on the starting point. The findings give a cleaner picture of how these networks learn.

Catalog record

CREATOREl Mehdi Achour [email protected], Kathlén Kohn [email protected], Holger Rauhut [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06367

Browse the full library · About the Tower of Babel