Towards Scalable Visual Data Wrangling via Direct Manipulation
El Kindi Rezig, Mir Mahathir Mohammad, Nicolas Baret, Ricardo Mayerhofer, Andrew McNutt, Paul Rosen · 2025
Read Towards Scalable Visual Data Wrangling via Direct Manipulation by El Kindi Rezig, Mir Mahathir Mohammad, Nicolas Baret, Ricardo Mayerhofer, Andrew McNutt, Paul Rosen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18405.txt.
Introduction
El Kindi Rezig leads a six author team building Buckaroo, a visual tool for cleaning messy data by direct touch. Data prep is a known choke point in analysis, and scripts hide how a fix in one corner ripples elsewhere. Buckaroo instead groups records on its own and flags flaws like gaps, outliers, and wrong types inside and across those groups.
Scale is the hard part: drawing every row is impossible, yet a plain sample can hide rare but grave errors. Their answer samples with an eye for errors and folds data into layers that support smooth pan and zoom. A link to the Hopara viewing engine shows the idea at work, and expert reviewers found the fit strong.
Catalog record
| CREATOR | El Kindi Rezig, Mir Mahathir Mohammad, Nicolas Baret, Ricardo Mayerhofer, Andrew McNutt, Paul Rosen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-18405
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Scalable Visual Data Wrangling via Direct Manipulation El Kindi Rezig, Mir Mahathir Mohammad, Nicolas Baret, Ricardo Mayerhofer, Andrew McNutt, Paul Rosen Abstract . Data wrangling—the process of cleaning, transforming, and preparing data for analysis—is a well-known bottleneck in data science workflows. Existing tools either rely on manual scripting, which is error-prone and hard to debug, or automate cleaning through opaque black-box pipelines that offer limited control. We present Buckaroo , a scalable visual data wrangling system that restructures data preparation as a direct manipulation task over visualizations. Buckaroo enables users to explore and repair data anomalies—such as missing values, outliers, and type mismatches—by interacting directly with coordinated data visualizations. The system extensibly supports user-defined error detectors and wranglers, tracks provenance for undo/redo, and generates reproducible scripts for downstream tasks. Buckaroo maintains efficient indexing data structures and differential storage to localize anomaly detection and minimize recomputation. To demonstrate the applicability of our model, Buckaroo is integrated with the Hopara pan-and-zoom engine, which enables multi-layered navigation over large datasets without sacrificing interactivity. Through empirical evaluation and an expert review we show that Buckaroo makes visual data wrangling scalable—bridging the gap between visual inspection and programmable repairs. \settopmatter printacmref=false 1. introduction The promise of data-driven decision-making relies critically on the quality and readiness of underlying datasets 5 . Yet, before any analysis, modeling, or visualization can occur, practitioners must invest substantial effort into data wrangling —the process of transforming raw, messy data into a structured form suitable for downstream tasks. Despite its importance, data wrangling remains one of the most labor-intensive and error-prone phases of the data science lifecycle, accounting for up to 80% of the total project time 24 . Data wrangling involves a wide range of tasks, including parsing, deduplication, missing value imputation, anomaly detection, and type normalization. These tasks are often executed through manual scripts or ad-hoc spreadsheet operations, introducing two significant problems: (1) errors introduced during wrangling are difficult to detect and propagate silently into downstream models, and (2) the lack of interactivity and visibility in existing tools limits user understanding and trust, especially when dealing with complex group-level anomalies. Bridging the gap between iterative scripting and visual exploration is essential. Data wrangling is rarely a one-shot operation—it is inherently iterative, involving trial-and-error, context-aware corrections, and domain judgment 30 . While prior work has proposed automated or script-based approaches to support cleaning operations 10 , these systems often assume a fixed pipeline and offer little visibility into how each transformation affects the dataset, i.e., fixing one error might lead to new errors in the dataset. This limits their usability in real-world settings where errors are heterogeneous, subtle, and contextual. Conversely, visualization tools excel at surfacing structure 31 ; 26 , guiding attention, and enabling human reasoning, but they are typically detached from the wrangling process itself. That is, they are used post-hoc for validation rather than as integral components of repair. This disconnect leads to workflows where users must constantly switch between error inspection and editing scripts to fix problems in the data, which is laborious and error-prone. Our proposed system, Buckaroo , bridges this gap by reimagining data wrangling as a visual, interactive, and iterative process. It allows users to identify and resolve data anomalies by directly manipulating visual representations of data groups. Buckaroo automatically detects anomalous groups—e.g., those with missing values or outliers—maps them to interactive charts, and offers recommended repairs that can be applied, visualized, and reverted in real time. This tight integration of detection, visualization, and repair enables users to understand the impact of each action across the dataset and supports the inherently exploratory nature of data preparation. Figure 1 . An overview of repairing an error through Buckaroo ’s user interface. A highlights a user working through iterative and backtrack-laden process of cleaning a dataset. B shows the full interface for a sample of the StackOverflow dataset. Each error type has a distinct color (e.g., red groups correspond to average anomalies), Upon selecting the group, Buckaroo shows a list of wrangling/repair actions on the right and shows a visual preview of the chart after the repair. Transforming visualizations into repair interfaces. A key technical insight of Buckaroo is to treat visualizations not merely as passive outputs but as active substrates for user-driven data transformation. By constructing index structures that link anomalies to data groups and anomaly types, Buckaroo enables responsive, bidirectional interactions: users can trigger repairs through visual selections and observe the systemic consequences instantly. Moreover, through user-defined detector and repair functions, the system accommodates domain-specific anomalies while preserving flexibility and reproducibility through automatic code generation. Motivating Example. Consider the table in Figure 1 , which shows two groups from a larger dataset: G1 = { \texttt{Income}\mid\texttt{Country}=\text{"Bhutan"} } and G2 = { \texttt{Income}\mid\texttt{Degree}=\text{"BS"} }. Both groups have Income anomalies, including outliers, missing values, and inconsistent data types. Lou, a data scientist, is tasked with preparing this dataset for downstream analysis. Using a traditional workflow—such as importing the data into Python—Lou encounters several challenges: Sparse anomalies: Errors are scattered and infrequent, making them hard to detect. Interdependent groups: Fixing an anomaly in one group may unintentionally distort others. For instance, removing all zero-income rows from G1 could leave G2 with insufficient data. Iterative debugging: Writing and refining data cleaning scripts requires multiple trial-and-error cycles to validate correctness and completeness 13 . By contrast, if Lou uses Buckaroo (Figure 1 A ), the system automatically highlights anomalous groups for inspection. Lou is presented with wrangling suggestions specific to each error type—such as imputation, deletion, or conversion—and can apply these repairs interactively. Crucially, the visual interface reveals how each action affects related groups in real time, allowing Lou to iteratively explore, evaluate, and undo changes as needed. Once the data is in a satisfactory state, Buckaroo can export a Python script encoding all the wrangling steps for future reuse or automation. A prototype of Buckaroo was demonstrated at VLDB 2025 37 . The demo version operates entirely in client-side memory and is intended for smaller datasets. While suitable for showcasing interaction design, it lacks the scalability features required for real-world deployment. In this paper, we present our ongoing efforts to scale Buckaroo by introducing server-side storage, differential snapshot management, and efficient update propagation—making the system scalable and practical for large, real-world datasets. Throughout the paper, we use the terms "anomaly" and "error" interchangeably, as well as "wrangling" and "repair." Figure 2 . Buckaroo system architecture. 1 The user interface visualizes anomalies and supports interactive exploration, ranking errors, undo/redo, and script generation. 2 The data selection and aggregation layer provides single-layer and multi-layer navigation through error sampling, distance-based sampling, drill-down, and panning. 3 The backend implements built-in and custom error detectors. 4 Buckaroo offers built-in and user-defined wrangling functions. 5 The storage layer manages group generation, snapshot storage for undo/redo, error–tuple mappings, and indexes using PostgreSQL and AWS infrastructure. Contributions. Buckaroo introduces a new paradigm for data wrangling by tightly integrating anomaly detection, visual exploration, and repair within a single interactive interface. This paper makes the following contributions: • A group-based abstraction that organizes anomalies into interpretable visual summaries, enabling users to interact with data through an orchestrated set of interactive charts. • An extensible framework for