Curvature-Aware PCA with Geodesic Tangent Space Aggregation for Semi-Supervised Learning
Alexandre Luis Magalhães Levada · 2026
Read Curvature-Aware PCA with Geodesic Tangent Space Aggregation for Semi-Supervised Learning by Alexandre Luis Magalhães Levada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18816.txt.
Introduction
Levada proposes GTSA-PCA, a geometric variant of principal component analysis for data on curved manifolds, adding curvature awareness and geodesic consistency. Standard PCA is globally linear and misses curved structure, while manifold methods lose the spectral structure and stability of PCA. The method swaps the global covariance operator for curvature weighted local versions over a nearest neighbor graph, then aligns local tangent spaces globally. Labeled information guides the fit, and tests show steady gains over PCA and strong graph rivals, notably with small samples and high curves.
Catalog record
| CREATOR | Alexandre Luis Magalhães Levada |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 117770 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18816
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Curvature-Aware PCA with Geodesic Tangent Space Aggregation for Semi-Supervised Learning Alexandre Luis Magalhães Levada Abstract Principal Component Analysis (PCA) is a fundamental tool for representation learning, but its global linear formulation fails to capture the structure of data supported on curved manifolds. In contrast, manifold learning methods model nonlinearity but often sacrifice the spectral structure and stability of PCA. We propose Geodesic Tangent Space Aggregation PCA (GTSA-PCA) , a geometric extension of PCA that integrates curvature awareness and geodesic consistency within a unified spectral framework. Our approach replaces the global covariance operator with curvature-weighted local covariance operators defined over a k k -nearest neighbor graph, yielding local tangent subspaces that adapt to the manifold while suppressing high-curvature distortions. We then introduce a geodesic alignment operator that combines intrinsic graph distances with subspace affinities to globally synchronize these local representations. The resulting operator admits a spectral decomposition whose leading components define a geometry-aware embedding. We further incorporate semi-supervised information to guide the alignment, improving discriminative structure with minimal supervision. Experiments on real datasets show consistent improvements over PCA, Kernel PCA, Supervised PCA and strong graph-based baselines such as UMAP, particularly in small sample size and high-curvature regimes. Our results position GTSA-PCA as a principled bridge between statistical and geometric approaches to dimensionality reduction. 1 Introduction Dimensionality reduction is a central problem in machine learning and data analysis, aiming to extract compact and informative representations from high-dimensional data while preserving its underlying structure. Classical linear techniques, most notably Principal Component Analysis (PCA) 22 , achieve this by identifying directions of maximal variance, offering computational efficiency and strong statistical interpretability. However, such global linear models are fundamentally limited when data lie on or near nonlinear manifolds embedded in high-dimensional spaces. To address this, a rich class of nonlinear methods, often referred to as manifold learning, has been developed, including ISOMAP 45 , Locally Linear Embedding (LLE) 40 , Laplacian Eigenmaps 5 , DIffusion Maps 10 , t-SNE 49 and UMAP 30 , 31 . These approaches leverage neighborhood graphs to capture intrinsic geometry, typically relying on geodesic distances or local linear reconstructions. Despite their success, they often suffer from sensitivity to sampling density, graph construction, and noise, and may lack the stability, scalability, or out-of-sample extension properties that make PCA attractive. More recent graph-based and spectral methods attempt to bridge this gap, yet a principled framework that simultaneously preserves local linear structure, respects global manifold geometry, and retains the statistical grounding of PCA remains an open challenge. In recent years, geometric machine learning has emerged as a powerful paradigm for understanding and exploiting the non-Euclidean structure of data, drawing tools from differential geometry, topology, and spectral theory to design more expressive learning algorithms 6 . Within this perspective, data are no longer treated as points in a flat ambient space, but as samples from structured geometric objects such as Riemannian manifolds or graphs endowed with intrinsic metrics. A key insight in this line of research is that curvature encodes fundamental information about local and global geometry, influencing distances, neighborhood relationships, and the behavior of diffusion processes. Consequently, incorporating curvature into learning algorithms has the potential to significantly enhance both dimensionality reduction and metric learning. Recent works have explored curvature-aware constructions in discrete settings, including Ricci curvature on graphs 35 and its applications to network analysis and learning 34 , as well as connections between curvature and robustness or generalization in deep architectures 8 . These developments suggest that curvature is not merely a geometric descriptor, but a functional ingredient that can guide the design of adaptive representations. However, despite these advances, the integration of curvature into classical dimensionality reduction frameworks, particularly in a way that preserves their statistical interpretability and spectral structure, remains largely underexplored. The central problem addressed in this work is the development of a dimensionality reduction framework that simultaneously preserves the statistical optimality of linear methods and the geometric fidelity required to model data supported on nonlinear manifolds. Classical approaches such as PCA provide efficient and well-understood solutions, but their reliance on a single global linear subspace leads to significant distortions when the underlying data exhibit curvature or complex topology. On the other hand, nonlinear manifold learning techniques capture intrinsic geometry more effectively, yet often lack stability, scalability, and a coherent statistical interpretation. This dichotomy highlights a fundamental gap: existing methods either prioritize global statistical structure or local geometric consistency, but rarely both in a unified and principled manner. Addressing this challenge is particularly important in modern machine learning, where high-dimensional data frequently reside on structured, non-Euclidean domains, and where the quality of learned representations directly impacts downstream tasks such as clustering, classification, and semi-supervised learning. The goal of this work is therefore to design a method that reconciles these competing objectives, enabling geometry-aware, robust, and discriminatively meaningful representations. Building on these observations, we propose Geodesic Tangent Space Aggregation PCA (GTSA-PCA), a novel dimensionality reduction framework that overcomes key limitations of both classical PCA and existing manifold learning methods. Unlike PCA, which relies on a single global covariance operator, and unlike manifold methods that often lack a coherent statistical interpretation, GTSA-PCA introduces a two-stage geometric construction that unifies local linear modeling with global nonlinear structure. Specifically, the method replaces the global covariance matrix with a collection of curvature-aware local covariance operators defined over a k-nearest neighbor graph, yielding reliable tangent space approximations even in highly curved regions. These local models are then globally synchronized through a geodesic alignment operator that couples intrinsic graph distances with subspace affinities, leading to a well-defined spectral problem whose solution provides a consistent low-dimensional embedding. This formulation is fundamentally different from existing approaches such as Locally Linear Embedding or Laplacian-based methods, as it explicitly models the interaction between curvature, geodesic structure, and subspace alignment within a single operator-theoretic framework. The main contributions of this work are threefold: (i) the introduction of curvature-weighted local covariance estimation for robust tangent space recovery; (ii) a novel geodesic alignment operator that enables the global aggregation of local linear models; and (iii) a semi-supervised extension that incorporates label information to guide the embedding toward discriminative structures. Together, these elements establish GTSA-PCA as a principled and flexible generalization of PCA to nonlinear, graph-structured domains. The remainder of this paper is organized as follows. In Section 2, Theoretical Background, we review the fundamental concepts underlying our approach, including classical PCA, manifold learning, graph-based representations, and notions of curvature in differential geometry. Section 3, Geodesic Tangent Space Aggregation PCA, presents the proposed method in detail, describing both the curvature-aware local modeling and the global geodesic alignment framework, along with its semi-supervised extension. In Section 4, Computational Experiments and Results, we evaluate the performance of GTSA-PCA on a variety of synthetic and real-world datasets, comparing it against established dimensionality reduction and graph-based techniques. Finally, Section 5, Conclusions and Final Remarks, summarizes the main findings, discusses limitations, and outlines directions for future research. 2 Related Work Dimensionality reduction remains a central problem in machine learning, with classical methods such as Principal Component Analysis (PCA) providing a statistically optimal linear framework. Extensions such as Kernel PCA 42 introduce nonlinearity via implicit feature mappings, but still rely on global operators and predefined kernels, limiting their ability to