Democratizing Tabular Data Access with an Open‑Source Synthetic‑Data SDK
Ivona Krchova, Mariana Vargas Vieyra, Mario Scriminaci, Andrey Sidorenko · 2025
Read Democratizing Tabular Data Access with an Open‑Source Synthetic‑Data SDK by Ivona Krchova, Mariana Vargas Vieyra, Mario Scriminaci, Andrey Sidorenko (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00718.txt.
Introduction
Machine learning needs data, but privacy and ownership rules increasingly lock real data away. Synthetic data promises a safe substitute, and the four authors present an open-source software development kit from MOSTLY AI for making synthetic tabular data. The kit bakes in differential privacy guarantees, fairness-aware generation, and automated quality checks behind a Python interface.
It is built on an autoregressive framework and handles varied data types plus complex multi-table and sequential data sets. The authors report competitive quality with better speed and usability than rivals. The kit runs as a cloud service or local install and has seen rapid adoption. They frame it as practical infrastructure for democratizing access to usable data.
Catalog record
| CREATOR | Ivona Krchova, Mariana Vargas Vieyra, Mario Scriminaci, Andrey Sidorenko |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-00718
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Democratizing Tabular Data Access with an Open‑Source Synthetic‑Data SDK Ivona Krchova, Mariana Vargas Vieyra, Mario Scriminaci, Andrey Sidorenko Abstract Machine learning development critically depends on access to high-quality data. However, increasing restrictions due to privacy, proprietary interests, and ethical concerns have created significant barriers to data accessibility. Synthetic data offers a viable solution by enabling safe, broad data usage without compromising sensitive information. This paper presents the MOSTLY AI Synthetic Data Software Development Kit (SDK), an open-source toolkit designed specifically for synthesizing high-quality tabular data. The SDK integrates robust features such as differential privacy guarantees, fairness-aware data generation, and automated quality assurance into a flexible and accessible Python interface. Leveraging the TabularARGN autoregressive framework, the SDK supports diverse data types and complex multi-table and sequential datasets, delivering competitive performance with notable improvements in speed and usability. Currently deployed both as a cloud service and locally installable software, the SDK has seen rapid adoption, highlighting its practicality in addressing real-world data bottlenecks and promoting widespread data democratization. I Introduction The development of Machine Learning applications requires broad access to training data. This necessity has become more critical in recent years with the advent of Deep Learning, which requires large-scale datasets to effectively train models. At the same time, the volume of data produced has grown rapidly, as companies and institutions now routinely collect vast amounts of data from user interactions and deployed applications. However, this exponential growth has not translated into equivalent accessibility. Privacy regulations, proprietary restrictions, and ethical considerations increasingly restrict the availability and usage of real-world datasets for development. This phenomenon, referred to as the data bottleneck [ 1 ] , affects multiple domains and data modalities with tabular datasets being no exception. In this context, synthetic data arises as a promising solution to fill the data availability gap, offering means to securely access high-quality datasets, guaranteeing their utility and minimizing the privacy risks associated with data sharing [ 2 , 3 , 4 , 5 ] . Synthetic datasets emerge as a versatile tool, also providing solutions for numerous problems other than privacy. For instance, scaling data volume, addressing class imbalance, imputing missing data or enabling fairness-aware evaluations [ 6 ] . Tackling these problems as a whole dramatically increases the usability and practicality of synthetic data [ 7 ] . However, despite the growing body of literature leveraging Deep Learning for tabular data synthesis, many methods fall short of providing a holistic solution that addresses multiple aspects of data synthesis simultaneously, especially considering challenges like data heterogeneity, fidelity, and privacy protection [ 8 , 9 ] . To bridge the widening gap between data availability and accessibility, we introduce the MOSTLY AI Synthetic Data Software Development Kit (SDK), an open-source toolkit that integrates a comprehensive set of functionalities, simultaneously addressing multiple critical aspects of synthetic data generation. This library is specifically tailored to reach a broad audience of researchers and practitioners of multiple fields, with the aim of filling the current data availability gap and promoting data democratization. Designed for flexibility, the SDK can run locally or in ‘client mode’, by accessing our custom-developed cloud-based service via API calls. However, in this work we fully focus on the local deployment scenario, presenting its data ingestion, training, and generation capabilities in depth. I-A Contributions The SDK offers the following key contributions: • High data quality with a simple design: Based on TabularARGN [ 10 ] , the SDK delivers synthetic data quality on a par with state-of-the-art (SOTA) models without compromising simplicity. Additionally, it achieves substantial speed-ups in training and generation times over current benchmarks. • Privacy and fairness features: The framework considers privacy-preserving value ranges for sampling, has built-in regularization layers and early stopping for training, and provides training mechanisms with differencial privacy (DP) guarantees [ 11 ] . In generation, it supports the incorporation of fairness across sensitive attributes [ 12 ] . • Automated quality assurance: The SDK provides a built-in quality assurance module [ 13 ] , generating standardized, in-depth reports that quantitatively assess both privacy and data fidelity of synthetic datasets. • Open source package: Fully written in Python, the SDK can be locally installed via pip . The package is open-sourced under a fully permissive Apache Version 2.0 Open Source license 1 1 1 https://github.com/mostly-ai/mostlyai . • Community of users: With a growing community of users and contributors, the SDK not only provides high-quality data synthesis services but also benefits from real-world feedback, enabling a continuous improvement of the toolkit to better meet real-world needs. The remainder of the paper is organized as follows: Section II describes the SDK architecture; Section III presents data ingestion and processing capabilities; Section IV details training and generation capabilities; Section V reports empirical performance results; Section VI discusses community adoption; and Section VII concludes. II Architecture Overview and Workflow In this Section we present an overview of the SDK. Built to support diverse usage scenarios, the SDK enables users from diverse backgrounds, from academic researchers to data science practitioners, to programmatically generate, share, and manipulate high-quality synthetic datasets. The toolkit provides a clearly structured interface. It is freely available as an open-source package under the permissive Apache Version 2.0 license, and can be easily installed via pip install -U ’mostlyai[local]’ (requiring Python \geq 3.10 ). The SDK’s architecture is organized around three main components: connectors , generators and synthetic datasets , alongside a dedicated quality assurance component. Figure 1 illustrates this pipeline, highlighting the key functionalities associated with each component. Together, these artifacts form an intuitive workflow that guides users from data ingestion, through training and sharing generative models, to generating and evaluating synthetic datasets. While the SDK supports both local and client mode, in this work we focus on the local mode only, as both share the same functionalities and features. Fig. 1: Overview of the key features and capabilities of the MOSTLY AI Synthetic Data SDK. The SDK is organized around three main artifacts, connectors , generators and synthetic datasets . Connectors are responsible for the data support, including data ingestion and schema definition. Generators handle the training control and are mainly manipulated through the mostly.train() function. The generation is controlled by the synthetic dataset artifacts through the mostly.generate() function. Finally, the SDK integrates privacy mechanisms to ensure synthetic data safety, and a quality assurance toolkit to assess the quality of the resulting models and datasets. In the following, we first introduce the main components and quality assurance in detail. Then a concise workflow example is presented to illustrate the practical usage of the SDK. II-A Core Components of the SDK Connectors As the first step in the pipeline, the SDK provides interfaces for configuring data sources and destinations of various types. These are managed via connectors , which are containers that encapsulate all the information needed to access data sources for fetching training sets, or to specify destinations for storing the generated synthetic datasets. Connectors are artifacts that enable a straightforward integration with various popular databases and cloud providers. In Figure 1 we list the different types of connectors the SDK currently supports. At the simplest level, a connector might only specify a local data path to a file the user uploaded manually,