Local Neighborhood Instability in Parametric Projections: Quantitative and Visual Analysis

Frederik L. Dennig 1 and Daniel A. Keim 1 1 University of Konstanz, Germany · 2026

Read Local Neighborhood Instability in Parametric Projections: Quantitative and Visual Analysis by Frederik L. Dennig 1 and Daniel A. Keim 1 1 University of Konstanz, Germany (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21617.txt.

Introduction

Frederik Dennig and Daniel Keim present a stability framework for parametric projections, which embed new points live but shift with noise or drift. The framework probes projections with Gaussian noise around anchors and gauges neighborhood shifts. It joins mean displacement, bias, and nearest-anchor error with vectors, PCA ellipsoids, and Voronoi misassignment views. They test it on UMAP- and t-SNE-based projectors, probing Jacobian regularization as a defense, and apply it to MNIST and Fashion-MNIST. It finds unstable regions hidden from reconstruction error or local metrics.

Catalog record

CREATORFrederik L. Dennig 1 and Daniel A. Keim 1 1 University of Konstanz, Germany
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28434
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21617

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Local Neighborhood Instability in Parametric Projections: Quantitative and Visual Analysis Frederik L. Dennig 1 and Daniel A. Keim 1 1 University of Konstanz, Germany Abstract Parametric projections let analysts embed new points in real time, but input variations from measurement noise or data drift can produce unpredictable shifts in the 2D layout. Whether and where a projection is locally stable remains largely unexamined. In this paper, we present a stability evaluation framework that probes parametric projections with Gaussian perturbations around selected anchor points and assesses how neighborhoods deform in the 2D embedding. Our approach combines quantitative measures of mean displacement, bias, and nearest-anchor assignment error with per-anchor visualizations of displacement vectors, local PCA ellipsoids, and Voronoi misassignment for detailed inspection. We demonstrate the framework’s effectiveness on UMAP- and t-SNE-based neural projectors of varying network sizes and study the effect of Jacobian regularization as a gradient-based robustness strategy. We apply our framework to the MNIST and Fashion-MNIST datasets. The results show that our framework identifies unstable projection regions invisible to reconstruction error or neighborhood-preservation metrics. \WsPaper ccs Human-centered computing Visualization ccs Computing methodologies Machine learning † † year: 2026 † † editors: D. Archambault and A. Vilanova † † subject: \p@ConfName ( \p@ConfYear ) † † orcid: 0000-0003-1116-8450 † † orcid: 0000-0001-7966-9740 † † teaser: Framework overview on MNIST. (1) A baseline UMAP projection is computed. (2) Class centroid-based anchors are selected. (3) Isotropic Gaussian noise is added to perturb anchor samples. (4) A multi-layer perceptron (MLP) projects all noisy samples into 2D. (5) Stability is assessed with three metrics: Mean displacement ( D_{\mathrm{dev}} ), displacement bias ( D_{\mathrm{bias}} ), and nearest-anchor assignment error ( E_{\mathrm{NA}} ); lower is better. Here, we show a local PCA visualization of displacement bias and the amplification or attenuation along principal directions. 1 Introduction Making sense of high-dimensional data requires reducing it to a form humans can interpret. Dimensionality reduction (DR) methods address this by mapping data to two or three dimensions while preserving relationships such as distances and neighborhood structures [ 29 ] . A common shortcoming of these approaches is that they cannot represent the projection as an explicit parametric function, preventing consistent and efficient projection of new or synthetic data without recomputing the entire embedding [ 34 ] . In recent years, neural networks (NNs) have increasingly been used to learn such parametric mappings [ 12 ] . These approaches can approximate non-linear projections and can generalize to a variety of DR techniques [ 9 ] . With NNs, once trained, the mapping can be evaluated in constant time per point, enabling fast out-of-sample projection of new or synthetic data without recomputing global pairwise relationships [ 30 ] . In contrast, classical DR techniques such as UMAP [ 26 ] and t-SNE [ 33 ] are non-parametric and require full recomputation when new data arrives. This makes feed-forward multi-layer perceptron (MLP) projections attractive for streaming and interactive settings , for deployment scenarios where embeddings must be produced on demand, and for workflows that require a consistent layout across updates. For visual analytics, this consistency is essential, since analysts must be able to trust that spatial patterns reflect data structures rather than artifacts of recomputation [ 28 ] . However, parametric projections introduce a concern: The learned mapping is constrained only by the training data and objective, and its behavior under small input perturbations is rarely examined [ 9 ] . Current evaluation methods emphasize accurate local neighborhood preservation [ 35 ] , but ignore sensitivity to inputs that are slightly perturbed. In this work, we analyze MLP projection architectures and how well they preserve local neighborhoods under input variations (see ). Our evaluation combines quantitative measures with visual analysis to reveal systematic and sometimes surprising differences in how MLP-based parametric projections respond to small Gaussian perturbations. In this paper, we contribute: (1) Three quantitative measures to assess local neighborhood stability in parametric projections under small input perturbations. (2) Three visualizations that link our local stability measures to spatial and neighborhood changes in the projection. (3) Empirical comparisons of parametric projections for UMAP and t-SNE, validating the effectiveness of stability assessment. (4) We share the analysis, results, and source code on OSF and GitHub for reproducibility . 2 Related Work Projection Methods for Visualization: We define a high-dimensional dataset as D=\{x_{i}\}_{1\leq i\leq n} with n samples x_{i}\in\mathbb{R}^{d} and a projection method P that maps D to a lower-dimensional representation as P(D)=\{P(x_{i})\mid x_{i}\in D\}=\{y_{i}\}_{1\leq i\leq n} , where P(D)\subset\mathbb{R}^{q} with q\ll d . In our setting, q=2 , allowing P(D) to be visualized as a two-dimensional scatterplot. Projection methods have been extensively studied and evaluated in several surveys [ 8 , 13 , 29 ] . They are commonly categorized as either linear or non-linear methods [ 24 , 13 ] , and further distinguished by whether they primarily preserve global structure or local neighborhood relations. Linear projection techniques such as PCA can be computed very efficiently and are known to preserve global variance structure, while MDS [ 20 ] provides a non-linear alternative with a similar global emphasis. In contrast, many non-linear methods prioritize the preservation of local neighborhoods at the expense of global structure, including t-SNE [ 33 ] and UMAP [ 26 ] . Among other projection quality measures [ 13 ] , Venna and Kaski [ 35 ] proposed Trustworthiness and Continuity , measuring intrusions and extrusions in local neighborhoods. Parametric Projections: Standard non-linear DR methods [ 20 , 33 , 26 ] are non-parametric and typically require recomputation when projecting new data points [ 16 ] . Parametric approaches address this limitation by learning explicit mapping functions, often implemented using neural networks (NNs), from the input space to a lower-dimensional embedding [ 4 ] . Van der Maaten [ 34 ] introduced parametric t-SNE using a feed-forward NN to approximate the non-parametric embedding. Similarly, parametric UMAP [ 30 ] employs NNs, including autoencoder-based architectures, to replace the non-parametric optimization step. By training NNs to directly infer low-dimensional coordinates, Espadoto et al. [ 12 ] demonstrated that sufficiently expressive models can approximate a wide range of existing non-parametric DR techniques. HyperNP [ 1 ] extends this idea by learning parametric approximations across DR hyperparameters (e.g., perplexity in t-SNE), enabling interactive exploration. Finally, ParaDime [ 16 ] formalizes the design of NN-based DR methods through a grammar for parametric DR. Recent approaches use autoencoders to learn parametric mappings [ 9 ] . Robustness and Adversarial Perturbations: Adversarial robustness concerns carefully crafted input perturbations designed to cause maximal change in model output under minimal input changes (i.e., small-norm constraint) [ 15 ] . Recent work has highlighted that parametric DR models can be vulnerable to attacks [ 14 ] . Adversarial robustness is a training objective [ 25 ] . Cohen et al. [ 6 ] show that classifiers robust to Gaussian input noise are certifiably robust to adversarial perturbations. Fast adversarial training [ 37 ] provides a baseline defense mechanism, while Kabaha and Drachsler-Cohen [ 18 ] introduced verification methods for computing global robustness bounds of neural networks. Lin and Fukuyama [ 23 ] developed a framework for calibrating DR hyperparameters in the presence of noise, addressing overfitting issues in t-SNE

Read the complete text