\system : Low-Friction, Interactive Embedding Visualization

Donghao Ren Apple, Fred Hohman ∗ Apple, Halden Lin Apple, Dominik Moritz Apple · 2025

Read \system : Low-Friction, Interactive Embedding Visualization by Donghao Ren Apple, Fred Hohman ∗ Apple, Halden Lin Apple, Dominik Moritz Apple (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06386.txt.

Introduction

Donghao Ren and co-authors (2025) present Embedding Atlas, a tool for exploring the maps that machine learning makes of data. Embedding projections turn large data sets into scatter plots, but existing tools fight their users. Loading data is tedious, big sets crawl, and results do not flow back into other work. Metadata views sit in separate programs. The authors built their tool on modern web technology to remove that friction.

Density-based clustering and automatic labeling help users read structure at a glance. Linked views show metadata beside the map, inside the same tool. Benchmarks show the tool rendering millions of points in real time. A competitive analysis against popular rivals found its feature set aimed precisely at the friction points. The authors release the tool as open source. They hope easy, fast maps become a default step in how teams inspect models and data, not a specialist chore.

Catalog record

CREATORDonghao Ren Apple, Fred Hohman ∗ Apple, Halden Lin Apple, Dominik Moritz Apple
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06386

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

\system : Low-Friction, Interactive Embedding Visualization Donghao Ren Apple, Fred Hohman ∗ Apple, Halden Lin Apple, Dominik Moritz Apple Abstract Embedding projections are popular for visualizing large datasets and models. However, people often encounter “friction” when using embedding visualization tools: (1) barriers to adoption, e.g., tedious data wrangling and loading, scalability limits, no integration of results into existing workflows, and (2) limitations in possible analyses, without integration with external tools to additionally show coordinated views of metadata. In this paper, we present \system , a scalable, interactive visualization tool designed to make interacting with large embeddings as easy as possible. \system uses modern web technologies and advanced algorithms—including density-based clustering, and automated labeling—to provide a fast and rich data analysis experience at scale. We evaluate \system with a competitive analysis against other popular embedding tools, showing that \system ’s feature set specifically helps reduce friction, and report a benchmark on its real-time rendering performance with millions of points. \system is available as open source to support future work in embedding-based analysis. \onlineid 1147 \vgtccategory Research \vgtcinsertpkg \teaser The \system user interface visualizing the embedding of 196,630 wine reviews. A user has filtered the embedding to only show wines from the US, France, and Italy with “points” in a specific range, and selected one outlier from the embedding to read its review and inspect its metadata. Try it at \url https://apple.github.io/embedding-atlas \definecolor RoyalBlueHTML0071BC \definecolor tableRowAltHTMLF2F2F7 Introduction keywords Embedding visualization, visual analytics. Effectively visualizing and summarizing large-scale, unstructured datasets remains a persistent challenge for developing machine learning (ML) models. One popular technique is to embed data (e.g., text, images) into high-dimensional (yet uninterpretable) vectors, and then project the vectors into 2D using dimensionality reduction techniques (e.g., PCA [ 10 ] , t-SNE [ 24 ] , or UMAP [ 14 ] ) for visualization. Projections may preserve local neighborhoods and global structure to ultimately make sense of the original data. These embedding visualizations have recently seen a resurgence [ 25 , 17 , 11 , 1 ] . Although static embedding visualizations are common, interactive tools enhance exploration and reveal deeper insights through user-driven analysis. Like any data analysis tool, the usability of embedding visualizations hinge upon their “utility-to-tedium” ratio. The best embedding tools make it easy to get data in, do work, and get insight and resulting data out, meshing seamlessly into existing development workflows. Every bit of friction encountered by a user during installation, set up, and use, lowers the chance of them engaging with the tool and their data. Other examples of friction include if loading data is cumbersome or requires extra preprocessing, sluggish performance as data size increases, or if one cannot cross-filter and examine other metadata alongside the embedding. Existing tools today can be a dead end for people’s analyses. In this paper, we introduce \system , a scalable, interactive embedding visualization tool designed to make exploring large embeddings as easy as possible. A core design principle of \system is to minimize friction , focusing people’s time on looking at their data rather than configuring the tool. \system builds upon the latest web technologies [ 19 , 9 ] and visualization research [ 5 ] for browser-based data analysis, implements recent algorithms for automatic data clustering and labeling [ 21 ] , and scales to millions of points while keeping smoother interactivity performance than previous work. We detail \system ’s features compared to existing tools, and evaluate its performance on embedding rendering. Our contributions include: • \system : a scalable, interactive, low-friction embedding visualization tool. • A competitive analysis of \system against other popular embedding visualizers, and a benchmark of its rendering performance. • An open-source implementation of the tool and its in-browser algorithms: order-independent transparency, density clustering and labeling, sentence transformers, and UMAP. 1 1 1 Code available at https://apple.github.io/embedding-atlas 1 Related Work One of the most widely adopted tools for exploring embeddings is the TensorBoard Embedding Projector [ 23 ] . It offers an interactive web-based environment that supports multiple dimensionality reduction techniques, including UMAP [ 14 ] , t-SNE [ 24 ] , and PCA [ 10 ] . Users can load model checkpoints, attach metadata (such as labels or images), and navigate the embedding space by zooming, panning, and inspecting neighborhoods on the fly. Its popularity in the deep learning community stems from its built-in integration with model training libraries and workflows (e.g., TensorFlow and TensorBoard). More recently, tools like WizMap [ 25 ] have pushed the frontier of embedding visualization by targeting scalability and performance. WizMap is designed to handle millions of points in browsers using technologies such as WebGL and Web Workers. By using a novel multi-resolution summarization technique along with a map-like interaction paradigm, WizMap allows users to smoothly navigate embedding spaces. In the commercial space, Nomic Atlas [ 16 ] is a cloud-based platform for scalable, interactive embedding visualization. It leverages Nomic’s embedding models and has full text and vector search, plus an AI assistant. Another tool, DataMapPlot [ 13 ] , is designed to help users create embedding plots for use in presentations, posters, and papers. It focuses on producing static plots or simple interactive plots that are visually appealing with minimal effort. Lastly, Latent Scope [ 8 ] leverages sparse-autoencoders [ 18 , 15 , 20 ] , to bring notions of ML interpretability [ 3 ] for better search and clustering to embedding visualizations. We compare \system ’s features with these existing tools in Section 3 . Beyond these established tools that emphasize the embedding view, embedding visualizations also often appear in task-specific visual analytics systems that handle unstructured data such as text and images [ 6 ] . They are often accompanied with filters, charts, or tables to support specific analytic goals. \system , as a general-purpose embedding visualization tool, aims to cover a significant portion of the design space of such systems. \system integrates web-based interactive embedding visualization with dynamic charts and data tables. Through Mosaic [ 5 ] , it enables smooth cross-filtering across all of its components. We strive to deliver a streamlined analytical experience with minimal setup overhead, allowing even novice users to start exploring their data quickly. At the same time, advanced users can seamlessly embed the system into their analytical applications. 2 \system Features 2.1 Motivating Example Before introducing the features of \system , we begin with an overview and a motivating usage example. Imagine Robin , a data analyst, who receives a new dataset containing \sim 200k wine reviews. She starts by loading the Parquet file into \system by simply dragging and dropping the file into the browser, and selects the wine description column to generate embeddings. \system automatically generates high-dimensional vectors, projects them into 2D, and computes clusters and labels automatically in the browser. The initial view presents an embedding visualization with cluster labels for easier exploration, along with charts displaying the distributions of all metadata columns (as shown in \system : Low-Friction, Interactive Embedding Visualization ). From looking at the country metadata chart, Robin notices that the dataset is skewed: most of the wines are from the United States. She then colors the embedding points by country to see the distribution of reviews across regions. Because

Read the complete text