A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction
\authororcid Zeyang Huang0000-0003-3945-1274, \authororcid Angelos Chatzimparmpas0000-0002-9079-2376, \authororcid Thomas Höllt0000-0001-8125-1650, and \authororcid Takanori Fujiwara0000-0002-6382-2752 · 2026
Read A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction by \authororcid Zeyang Huang0000-0003-3945-1274, \authororcid Angelos Chatzimparmpas0000-0002-9079-2376, \authororcid Thomas Höllt0000-0001-8125-1650, and \authororcid Takanori Fujiwara0000-0002-6382-2752 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02535.txt.
Introduction
Huang and three colleagues introduce SDMP, a nonlinear method for shrinking high-dimensional data to fewer dimensions, built on an explicit spectral split. Each new dimension is written as a weighted mix of Laplacian eigenvectors from a neighbor graph, with weights learned by a UMAP-style goal. Expanding the spectral subspace step by step makes the trade-off between global layout and local detail visible and controllable, and tests show strong structure preservation.
Catalog record
| CREATOR | \authororcid Zeyang Huang0000-0003-3945-1274, \authororcid Angelos Chatzimparmpas0000-0002-9079-2376, \authororcid Thomas Höllt0000-0001-8125-1650, and \authororcid Takanori Fujiwara0000-0002-6382-2752 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70380 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02535
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction \authororcid Zeyang Huang0000-0003-3945-1274, \authororcid Angelos Chatzimparmpas0000-0002-9079-2376, \authororcid Thomas Höllt0000-0001-8125-1650, and \authororcid Takanori Fujiwara0000-0002-6382-2752 Abstract Dimensionality reduction (DR) is characterized by two longstanding trade-offs. First, there is a global–local preservation tension: methods such as t-SNE and UMAP prioritize local neighborhood preservation, yet may distort global manifold structure, while methods such as Laplacian Eigenmaps preserve global geometry but often yield limited local separation. Second, there is a gap between expressiveness and analytical transparency: many nonlinear DR methods produce embeddings without an explicit connection to the underlying high-dimensional structure, limiting insight into the embedding process. In this paper, we introduce a spectral framework for nonlinear DR that addresses these challenges. Our approach embeds high-dimensional data using a spectral basis combined with cross-entropy optimization, enabling multi-scale representations that bridge global and local structure. Leveraging linear spectral decomposition, the framework further supports analysis of embeddings through a graph-frequency perspective, enabling examination of how spectral modes influence the resulting embedding. We complement this analysis with glyph-based scatterplot augmentations for visual exploration. Quantitative evaluations and case studies demonstrate that our framework improves manifold continuity while enabling deeper analysis of embedding structure through spectral mode contributions. \onlineid 1263 \vgtccategory Research \authorfooter Zeyang Huang is with Linköping University, Sweden. E-mail: [email protected]. Angelos Chatzimparmpas is with Utrecht University, The Netherlands. E-mail: [email protected] Thomas Höllt is with Delft University of Technology, The Netherlands. E-mail: [email protected] Takanori Fujiwara is with the University of Arizona, United States. E-mail: [email protected]. Introduction keywords Visualization, dimensionality reduction, manifold learning, embedding algorithms, spectral graph, UMAP Dimensionality reduction (DR) methods are widely used to visualize high-dimensional data, such as gene expressions [ 2 ] , images [ 8 ] , or feature descriptors [ 14 ] . Among existing approaches, neighborhood embeddings such as t-SNE [ 68 ] and UMAP [ 47 ] are particularly popular. These methods construct a weighted neighborhood graph in the high-dimensional space and optimize a low-dimensional embedding to preserve local similarities. These approaches contrast with classical spectral methods such as Laplacian Eigenmaps [ 3 ] , reflecting a global–local trade-off: methods like UMAP prioritize local separation, whereas Laplacian Eigenmaps better preserves global structure. Recent work has sought to understand and mitigate this trade-off by analyzing the embedding process [ 12 , 6 , 7 , 14 , 15 ] . In particular, Böhm et al. [ 7 ] characterize neighbor embedding methods along an attraction–repulsion continuum. Stronger attraction during optimization leads to more continuous manifold structure, while stronger repulsion produces sharper cluster separation. Böhm et al. characterize the global–local trade-off at the level of the optimization mechanism [ 7 , 14 ] , rather than establishing an explicit connection between the graph representation of data—which encodes both local and global structure—and its low-dimensional embedding. When an embedding shows separated clusters, it remains unclear whether this separation reflects true data structure or arises from the optimizer distorting the underlying manifold to favor local compactness. The key unresolved challenge is therefore not only the existence of a global–local trade-off in commonly used DR methods [ 37 , 1 , 32 ] , but also how to make this trade-off explicit and controllable. Furthermore, most nonlinear DR methods, including parametric variants [ 54 , 26 ] , ultimately produce only a fixed set of point coordinates without an explicit account of how it is constructed. Many visual analytics systems attempt to provide explanations by post-hoc parameter tuning or by visualizing certain data properties to compare embeddings [ 35 ] . These analyses can show that the resulting embedding changes under parameter variations, however, they do not explain which structures in the graph representation of the data drive these changes or at what scale they influence the embedding. In contrast, Laplacian Eigenmaps [ 22 , 3 ] provide a direct connection between graph structure and embeddings, but are often too rigid to be expressive enough to depict real-world high-dimensional data. In this paper, we investigate the global–local trade-off from a different perspective by focusing on the graph representation underlying the embedding rather than on the optimization process alone. Inspired by graph signal processing methods [ 57 , 17 ] , we introduce a spectral framework that constrains the cross-entropy optimization used in UMAP [ 47 ] by using spectral modes (graph frequencies) induced by the graph Laplacian [ 57 ] (see Section 1 ). Specifically, the embedding is expressed as a linear combination of spectral modes, and the optimization operates on the coefficients of these modes rather than directly on embedding coordinates. As a result, the objective remains neighborhood-preserving, while the degrees of freedom are explicitly controlled through a selected spectral subspace. This spectral formulation addresses the challenge of controlling the global–local trade-off by replacing a single embedding produced by an implicit force balance with an explicit multi-scale optimization process. We optimize the embedding within progressively expanding spectral subspaces, producing a sequence of coarse-to-fine intermediate embeddings. From a spectral perspective, low-frequency modes capture coarse global organization and manifold continuity, while higher-frequency modes introduce increasingly fine local variations and detail. With a few low-frequency modes, the embedding resembles Laplacian Eigenmaps, whereas when all spectral modes are used, it gains greater optimization flexibility and approaches a UMAP-like solution. The lack of analytical transparency can be addressed by explicitly expressing the embedding as a linear combination of spectral modes with learned coefficients. This formulation enables analysis of which modes dominate the embedding, how efficiently the data can be approximated within a reduced spectral subspace, and how individual data points participate in these modes. This explicit mapping spectral modes and the embedding further enables new forms of visual analysis. In summary, our spectral formulation enables the following analytical capabilities: • combining neighborhood-preserving cross-entropy optimization with spectral modes, making the optimization space explicit; • transforming the global–local trade-off into a progressive multi-scale embedding sequence; • enabling direct global and local analysis of the embedding through spectral decompositions; and • improving global structure preservation while quantifying how compactly the embedding can be represented within a reduced spectral subspace. 1 Background and Related Work Our framework is inspired by the complementary strengths used for neighbor embeddings: spectral methods such as Laplacian Eigenmaps and force-based approaches such as UMAP. In this section, we position our work in relation to these paradigms, as well as prior research on the analysis of DR results and spectral graph methods. 1.1 Neighbor Embeddings DR aims to extract low-dimensional embeddings (also referred to as projections or representations) of high-dimensional data while preserving meaningful structure [ 69 , 13 ] . Among various methods, neighbor embedding methods such as UMAP [ 47 ] , t-SNE [ 68 ] , and Laplacian Eigenmaps [ 3 ] focus on preserving relationships between nearby data points. These methods typically construct a k -nearest neighbor ( k NN) graph and define similarities between instances, followed by an embedding process that balances attractive forces between neighbors and repulsive forces among all points. In recent work, Böhm et al. [ 7 ] analyze these methods within an attraction–repulsion framework, showing that commonly used neighbor embedding methods such as LE [ 3 ] and UMAP [ 47 ] can be placed along a continuum of force balance. They further highlight