Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifolds

Krisanu Sarkar · 2025

Read Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifolds by Krisanu Sarkar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02999.txt.

Introduction

Krisanu Sarkar, writing alone in two thousand twenty-five, builds new bounds on how well neural networks can do on fresh data when the data lie on curved spaces. Past theory used flat-space tools.

Flat tools miss the true shape of data that sit on a curved, low-dim sheet inside a high-dim space. Sarkar brings the sheet's own traits into the count of cases a net must cover: its bend, how its bulk grows, and how far one can go before paths cross. The new bounds match the flat results when the bend is zero. They grow in sharp ways where the bend is strong, in both the up and down sense.

Catalog record

CREATORKrisanu Sarkar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-02999

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifolds Krisanu Sarkar Abstract In this work, we develop new generalization bounds for neural networks trained on data supported on Riemannian manifolds. Existing generalization theories often rely on complexity measures derived from Euclidean geometry, which fail to account for the intrinsic structure of non-Euclidean spaces. Our analysis introduces a geometric refinement: we derive covering number bounds that explicitly incorporate manifold-specific properties such as sectional curvature, volume growth, and injectivity radius. These geometric corrections lead to sharper Rademacher complexity bounds for classes of Lipschitz neural networks defined on compact manifolds. The resulting generalization guarantees recover standard Euclidean results when curvature is zero but improve substantially in settings where the data lies on curved, low-dimensional manifolds embedded in high-dimensional ambient spaces. We illustrate the tightness of our bounds in negatively curved spaces, where the exponential volume growth leads to provably higher complexity, and in positively curved spaces, where the curvature acts as a regularizing factor. This framework provides a principled understanding of how intrinsic geometry affects learning capacity, offering both theoretical insight and practical implications for deep learning on structured data domains. 1 Introduction Deep neural networks have achieved remarkable success across various domains, yet understanding their generalization remains challenging, especially when data lies on non-Euclidean spaces such as Riemannian manifolds. Classical generalization bounds based on VC-dimension [ 18 ] or Rademacher complexity [ 2 ] typically depend on ambient Euclidean dimension and thus become overly loose when data is intrinsically low-dimensional but curved. For instance, many real-world datasets, including images and speech, can be modeled as samples from low-dimensional manifolds embedded in high-dimensional spaces [ 9 , 7 ] . Furthermore, recent geometric deep learning approaches exploit curved latent spaces like spheres or hyperbolic manifolds [ 4 , 13 ] . Ignoring manifold geometry—curvature, volume growth, and injectivity radius—leads to vacuous bounds that fail to capture the true complexity of neural networks on such domains. This raises the fundamental question: can generalization guarantees explicitly incorporate intrinsic geometry to yield tighter, more meaningful bounds? In this work, we propose a novel framework integrating intrinsic Riemannian geometry into classical complexity measures. Using tools such as Bishop-Gromov volume comparison [ 3 , 10 ] and injectivity radius estimates [ 6 ] , we derive curvature-dependent covering numbers for the data manifold. This enables a new Rademacher complexity bound for Lipschitz neural networks on manifolds, which significantly improves over Euclidean-based results. Our contributions are: • Curvature-penalized covering number bounds that capture how sectional curvature and injectivity radius affect manifold complexity. • A sharp generalization error bound reflecting intrinsic dimension and curvature, recovering classical Euclidean results as a special case. • Demonstrations of tighter guarantees for spheres, hyperbolic spaces, and manifold-modeled data such as images. This work bridges manifold learning and statistical learning theory, offering new insights for learning in non-Euclidean settings with applications to geometric deep learning and generative modeling [ 4 , 16 ] . 2 Related Work The problem of understanding generalization in machine learning has a rich history, with classical results primarily grounded in Euclidean settings. VC-dimension and Rademacher complexity [ 18 , 2 ] provide foundational tools for bounding generalization error. However, these classical measures scale with the ambient dimension of the input space, which can be prohibitively large and often misleading when data lies on a low-dimensional manifold [ 9 ] . This discrepancy motivates the study of intrinsic complexity measures that reflect the true geometry of the data domain. Manifold learning has emerged as a key paradigm for modeling high-dimensional data with low-dimensional geometric structure [ 15 , 17 , 7 ] . These methods exploit the assumption that data is sampled from or near a smooth manifold embedded in a high-dimensional ambient space. While these approaches provide empirical benefits, theoretical guarantees for learning on manifolds remain less developed, particularly in the context of neural networks. Several prior works have explored generalization bounds for functions defined on manifolds. Fefferman et al. [ 9 ] provided pioneering analysis on the sample complexity of testing the manifold hypothesis, though their bounds do not explicitly incorporate curvature or other geometric invariants. More recently, works such as [ 14 , 19 ] consider complexity measures that depend on intrinsic dimension but treat the manifold geometry extrinsically, ignoring curvature effects that can critically influence volume growth and metric entropy. From a differential geometric perspective, classical volume comparison results such as the Bishop-Gromov inequality [ 3 , 10 ] provide powerful tools to characterize how curvature constrains the volume growth of geodesic balls. Such geometric controls have been exploited in analysis on manifolds [ 5 ] , but their integration into statistical learning theory remains limited. In the context of neural networks, Lipschitz continuity and spectral norm constraints have been utilized to bound complexity [ 1 , 12 ] , yet these results typically assume Euclidean domains. Recent advances in geometric deep learning [ 4 ] extend neural architectures to non-Euclidean domains such as graphs and manifolds, often using intrinsic geometric operators like the Laplace-Beltrami operator [ 7 ] . These developments motivate the need for corresponding theoretical tools that account for the geometry of the input space. Hyperbolic neural networks [ 13 , 16 ] highlight the impact of negative curvature on representation learning, revealing increased complexity and expressiveness in such spaces. Yet, generalization bounds that explicitly reflect curvature-induced complexity remain scarce. Our work contributes to this growing body of literature by deriving intrinsic , curvature-dependent complexity bounds for Lipschitz neural networks on Riemannian manifolds. To our knowledge, this is the first work to explicitly incorporate sectional curvature, volume growth, and injectivity radius into covering number and Rademacher complexity estimates, thereby providing a more precise characterization of generalization behavior on curved domains. Summary: While classical generalization theory offers valuable tools, it fails to capture the nuanced geometry of manifold-supported data. Existing manifold learning theory and geometric deep learning literature acknowledge intrinsic dimension and some geometric properties but generally lack explicit curvature-dependent generalization guarantees. Our work bridges this gap by integrating differential geometric insights directly into statistical learning bounds, paving the way for sharper and more relevant theoretical understanding of neural networks trained on manifolds. 3 Methodology 3.1 Problem Setup We consider a compact, smooth Riemannian manifold (\mathcal{M},g,\mu) where: • \mathcal{M} is a d -dimensional manifold equipped with a Riemannian metric g inducing a geodesic distance d_{g} . • \mu is a probability measure supported on \mathcal{M} . • The sectional curvature \sec is bounded as \kappa_{\min}\leq\sec\leq\kappa_{\max} . • The injectivity radius \mathrm{inj}(\mathcal{M})>0 , ensuring well-defined exponential maps. • The volume \mathrm{Vol}(\mathcal{M})<\infty . Our goal is to analyze the generalization properties of neural networks f:\mathcal{M}\to\mathbb{R} from a class \mathcal{F} of L -Lipschitz functions bounded by |f|\leq B , trained with an L_{\ell} -Lipschitz loss \ell on data S=\{x_{i}\}_{i=1}^{n} drawn i.i.d. from \mu . 3.2 Curvature-Dependent Covering Numbers Classical covering number bounds for function classes typically scale with the ambient Euclidean dimension and ignore manifold geometry. To capture the intrinsic geometry, we leverage volume comparison theorems from Riemannian geometry, specifically the Bishop-Gromov inequality [ 3 , 10 ] , to control the covering numbers of \mathcal{M} in terms of curvature and injectivity radius. Theorem 3.1 (Manifold Covering

Read the complete text