Low-dimensional embeddings of high-dimensional data

Cyril de Bodt, Alex Diaz-Papkovich, Michael Bleher, Kerstin Bunte, Corinna Coupette, Sebastian Damrich, Enrique Fita Sanmartin, Fred A. Hamprecht, Emőke-Ágnes Horvát, Dhruv Kohli, Smita Krishnaswamy, John A. Lee, Boudewijn P. F. Lelieveldt, Leland McInnes, Ian T. Nabney, Maximilian Noichl, Pavlin G. · 2025

Read Low-dimensional embeddings of high-dimensional data by Cyril de Bodt, Alex Diaz-Papkovich, Michael Bleher, Kerstin Bunte, Corinna Coupette, Sebastian Damrich, Enrique Fita Sanmartin, Fred A. Hamprecht, Emőke-Ágnes Horvát, Dhruv Kohli, Smita Krishnaswamy, John A. Lee, Boudewijn P. F. Lelieveldt, Leland McInnes, Ian T. Nabney, Maximilian Noichl, Pavlin G. (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15929.txt.

Introduction

De Bodt and a large team of co-authors review methods that flatten complex data into pictures, in this two thousand twenty-five paper. Modern datasets often carry hundreds of measurements per item, so researchers project them into two or three dimensions to explore and present.

Dozens of embedding algorithms exist, and the field has grown fragmented, leaving users unsure which to pick and how to set them. The review explains the main families, derives a list of best practices, and benchmarks popular methods on varied datasets. It also names open problems, from judging quality to handling huge collections. The guide aims to help scientists in fields from biology to the humanities use these maps of data with more care and confidence.

Catalog record

CREATORCyril de Bodt, Alex Diaz-Papkovich, Michael Bleher, Kerstin Bunte, Corinna Coupette, Sebastian Damrich, Enrique Fita Sanmartin, Fred A. Hamprecht, Emőke-Ágnes Horvát, Dhruv Kohli, Smita Krishnaswamy, John A. Lee, Boudewijn P. F. Lelieveldt, Leland McInnes, Ian T. Nabney, Maximilian Noichl, Pavlin G.
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15929

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Low-dimensional embeddings of high-dimensional data Cyril de Bodt, Alex Diaz-Papkovich, Michael Bleher, Kerstin Bunte, Corinna Coupette, Sebastian Damrich, Enrique Fita Sanmartin, Fred A. Hamprecht, Emőke-Ágnes Horvát, Dhruv Kohli, Smita Krishnaswamy, John A. Lee, Boudewijn P. F. Lelieveldt, Leland McInnes, Ian T. Nabney, Maximilian Noichl, Pavlin G. Poličar, Bastian Rieck, Guy Wolf, Gal Mishne, Dmitry Kobak Abstract Large collections of high-dimensional data have become nearly ubiquitous across many academic fields and application domains, ranging from biology to the humanities. Since working directly with high-dimensional data poses challenges, the demand for algorithms that create low-dimensional representations, or embeddings , for data visualization, exploration, and analysis is now greater than ever. In recent years, numerous embedding algorithms have been developed, and their usage has become widespread in research and industry. This surge of interest has resulted in a large and fragmented research field that faces technical challenges alongside fundamental debates, and it has left practitioners without clear guidance on how to effectively employ existing methods. Aiming to increase coherence and facilitate future work, in this review we provide a detailed and critical overview of recent developments, derive a list of best practices for creating and using low-dimensional embeddings, evaluate popular approaches on a variety of datasets, and discuss the remaining challenges and open problems in the field. 1 Introduction At the heart of scientific inquiry lie curiosity and intuition. Scientists observe the world, detect patterns, create hypotheses, and make inferences. The ever-increasing amount of data collected as part of virtually all scientific endeavors requires researchers to observe the data, detect patterns in the data, and formulate hypotheses about the data. Since John Tukey famously summarized these aims as exploratory data analysis (EDA) in the 1970s ( Tukey 1977 ) , both the number of samples and the number of features in a typical dataset have increased by several orders of magnitude, motivating the development of new analytical approaches. One of these approaches is dimensionality reduction . Large collections of high-dimensional data have become widespread in almost every discipline, with samples of interest ranging from molecules in chemistry to publications in the digital humanities and single cells or organisms in biology. These samples are typically characterized by thousands of features, such as atomic properties, word frequencies, or gene-expression measurements, resulting in high-dimensional data. However, empirical observations in many domains suggest that while the data are observed in high dimensions, the number of intrinsic dimensions that characterize the variability in the data is often much smaller. This has motivated the development of multiple dimensionality-reduction methods that learn low-dimensional representations, commonly referred to as embeddings , of high-dimensional data. Low-dimensional embeddings typically have to sacrifice some high-dimensional information and distort the original data ( Welch 1974 ; Johnson and Lindenstrauss 1984 ; Larsen and Nelson 2017 ; Nonato and Aupetit 2018 ) . This has motivated the development of many algorithms that make different trade-offs and preserve different properties of the data, resulting in a fast-growing and dynamic area of machine-learning research ( Lee and Verleysen 2007 ; Espadoto et al. 2019 ; Nguyen and Holmes 2019 ; Armstrong et al. 2022 ; Wang et al. 2023a ; Meilă and Zhang 2024 ; Wayland et al. 2024 ) . The resulting methods are often used as a preprocessing step to reduce high-dimensional noise or to render downstream tasks such as clustering or prediction more computationally tractable. Embeddings have also become a powerful and popular tool in exploratory data analysis, enabling interpretable representations in two or three dimensions that are amenable to direct visualization and human interaction. This has motivated the widespread adoption of low-dimensional embeddings across disciplines as different as single-cell biology ( Kobak and Berens 2019 ; Becht et al. 2019 ) , human genetics ( Diaz-Papkovich et al. 2019 ) , biochemistry ( Durairaj et al. 2023 ) , philosophy ( Noichl 2021 ) , metascience ( González-Márquez et al. 2024 ) , and sports analytics ( García-Aliaga et al. 2021 ) . As the field evolves, it becomes increasingly important to not only develop better embedding methods but also establish best practices for the creation, evaluation, application, presentation, and documentation of low-dimensional embeddings in the scientific process. In this review, following a reflection on the role of low-dimensional embeddings in the scientific enterprise ( Section 2 ), we provide an overview of common approaches to dimensionality reduction and highlight popular algorithms representing each approach, focusing on their underlying motivations, advantages, and limitations ( Section 3 ). We showcase selected algorithms on several example datasets from different research areas to illustrate the trade-offs involved ( Section 4 ), offer specific guidance and best practices relevant to real-world applications ( Section 5 ), and outline important challenges that remain in the field ( Section 6 ). The paper is co-authored by the participants of the Dagstuhl seminar 24122 on Low-Dimensional Embeddings of High-Dimensional Data , held in March 2024, and builds on our seminar discussions ( Kobak et al. 2024 ) . 2 Epistemic roles of embeddings In scientific fields that collect large quantities of high-dimensional data, such as single-cell transcriptomics, embedding and visualizing data in 2D has become a nearly ubiquitous practice. This has generated some debate and controversy, with critics emphasizing inevitable distortions ( Wang et al. 2023b ; Chari and Pachter 2023 ) and advocates emphasizing practical usefulness ( Lause et al. 2024 ) . Studies have also noted artifacts that can arise from visualizing data in low dimensions ( Diaconis et al. 2008 ; Morton et al. 2017 ; Lebedev et al. 2019 ) , and drew attention to frequent misuse of such embeddings ( Jeon et al. 2025 ) . This raises an epistemological question: What role do low-dimensional embeddings play in the scientific endeavor? One answer is that (low-dimensional) embeddings fall into the category of exploratory data analysis. EDA ( Tukey 1977 ) was developed as a hypothesis-free approach to data analysis, complementing confirmatory approaches such as hypothesis testing. Visualization techniques play a critical role in EDA because, as Tukey argued, “the picture-examining eye is the best finder we have of the wholly unanticipated” ( Tukey 1980 ) . Hence, a low-dimensional visualization can reveal properties of the data that the researchers were not even considering ( Yanai and Lercher 2020 ) , sometimes referred to as unknown unknowns . Two-dimensional embeddings depicted as a scatter plot can be easily interpreted due to the Gestalt principles of human perception ( Koffka 1935 ) , which characterize how humans group elements and recognize patterns. For example, the principle of proximity and the principle of common region state that objects placed near each other are perceived as similar, whereas those in separate areas are seen as distinct. Under this interpretation, rather than serving as tools for testing predefined hypotheses, embeddings serve a purpose similar to that of traditional box plots, scatter plots, and histograms, allowing researchers to inspect the data distribution. This inspection process can yield new insights and hypotheses that should subsequently be tested in a confirmatory framework — i.e., embeddings help with hypothesis generation . In EDA, the epistemic role of low-dimensional embeddings resembles that of microscopes in biomedicine or telescopes in astronomy: They can immediately reveal information that

Read the complete text