Privacy-Preserving Tabular Synthetic Data Generation Using TabularARGN

Andrey Sidorenko, Paul Tiwald · 2025

Read Privacy-Preserving Tabular Synthetic Data Generation Using TabularARGN by Andrey Sidorenko, Paul Tiwald (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06647.txt.

Introduction

Andrey Sidorenko and Paul Tiwald present a neural network that creates synthetic copies of sensitive tables. Their 2025 paper introduces TabularARGN, built to share the patterns in a data set without exposing the real rows. Older anonymization tricks often leak more than they hide, which pushed the field toward learned generators.

The network works step by step over discretized values, an auto-regressive design that keeps it fast while holding fidelity high. Tests against rival methods showed it matched them on statistical similarity, on usefulness for training models, and on resisting detection. The authors also attack their own system with membership-inference tests. Those probes, which try to tell whether a person was in the source data, show a sound balance of privacy and utility.

Catalog record

CREATORAndrey Sidorenko, Paul Tiwald
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06647

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Privacy-Preserving Tabular Synthetic Data Generation Using TabularARGN Andrey Sidorenko, Paul Tiwald Abstract . Synthetic data generation has become essential for securely sharing and analyzing sensitive data sets. Traditional anonymization techniques, however, often fail to adequately preserve privacy. We introduce the Tabular Auto-Regressive Generative Network (TabularARGN), a neural network architecture specifically designed for generating high-quality synthetic tabular data. Using a discretization-based auto-regressive approach, TabularARGN achieves high data fidelity while remaining computationally efficient. We evaluate TabularARGN against existing synthetic data generation methods, showing competitive results in statistical similarity, machine learning utility, and detection robustness. We further perform an in-depth privacy evaluation using systematic membership-inference attacks, highlighting the robustness and effective privacy-utility balance of our approach. 1. Introduction Equitable and broad access to data is essential for advancing research, driving innovation, and addressing pressing societal challenges ( Hradec et al. 2022 ) . However, privacy concerns and the well - documented shortcomings of traditional anonymisation techniques frequently result in valuable public- and private-sector data remaining inaccessible ( Gadotti et al. 2024 ) . Safely unlocking this data can yield substantial benefits for organisations and society. Consider, for instance, a healthcare dataset containing sensitive patient information such as medical diagnoses, treatments, and demographic details. Disclosing this data poses significant privacy risks, potentially leading to patient re-identification and breaches of confidentiality. Consequently, sensitive healthcare datasets often remain inaccessible, limiting research into disease patterns, treatment effectiveness, and healthcare optimisation. Synthetic data presents a promising solution, providing a secure means to share and analyse sensitive datasets by preserving their analytical utility while mitigating privacy risks ( Drechsler 2011 ; Jordon et al. 2022 ; UNECE 2023 ; Hu et al. 2023 ; Challagundla et al. 2025 ; Cormode et al. 2025 ) . Synthetic data tools fundamentally act as density estimators, learning the underlying joint probability distributions of the original data. By leveraging deep neural networks to approximate these patterns and relationships from original data sets, synthetic samples can be generated that are structurally consistent, statistically representative, and genuinely novel, thereby effectively minimizing disclosure risks. The benefits of synthetic data extend beyond privacy protection, enabling arbitrary data volume generation, rebalancing of underrepresented groups, imputation of missing values, and conditional, scenario-specific sampling ( van der Schaar et al. 2021 ; van Breugel and van der Schaar 2023 ) . In this paper, we introduce the Tabular Auto-Regressive Generative Network (TabularARGN), a neural network framework specifically designed for synthetic tabular data generation. TabularARGN addresses the density estimation challenge through an auto-regressive approach, approximating the joint distribution of tabular data as a sequence of conditional probabilities. Departing from approaches that treat tabular data rows as sequences of text ( Hegselmann et al. 2023 ; Smolyak et al. 2024 ; Miletic and Sariyar 2024 ) , TabularARGN explicitly exploits structured value ranges and discretization, achieving high-fidelity synthetic data generation while maintaining simplicity and computational efficiency. Beyond introducing TabularARGN, we conduct a rigorous analysis of privacy protection mechanisms within synthetic data generation methods, including an evaluation through Membership-Inference Attacks (MIAs) ( Hayes et al. 2018 ; Shokri et al. 2017 ; Pilgram et al. 2025 ; Hyeong et al. 2022 ; Wu et al. 2024 ; van Breugel et al. 2023 ) . While prior benchmarks often relied on metrics like Distance to Closest Record (DCR) ( Zhang et al. 2024b ; Mueller et al. 2025 ) , recent studies have highlighted limitations in these metrics ( Yao et al. 2025 ) . Our comprehensive privacy analysis addresses this gap, providing deeper insights into the privacy robustness of TabularARGN-generated data and emphasizing the necessity of adopting stronger privacy evaluation methodologies for synthetic data generation studies. We also provide open-source access to TabularARGN to facilitate reproducibility and encourage practical adoption in the privacy research community. 2. Related Work To the best of our knowledge, Uria et al. 2016 were the first to develop an auto-regressive neural network (NADE) for tackling the problem of unsupervised distribution and density estimation. This foundational idea and architecture serve as the backbone of the TabularARGN flat and sequential models. Uria et al. 2016 calculate the log-likelihood performance of NADE on binary tabular and binary image data sets, as well as purely real-valued data sets. However, they do not extend their work to generate synthetic data samples. Furthermore, the NADE architecture is not adapted in their work to handle multi-categorical data sets with variables of cardinality \geq 2 , nor mixed-type data sets that combine categorical and numeric variables, both of which are critical for real-world tabular data synthesis tasks. NADE shares similarities with Bayesian Networks (BNs), as both methods factorize the joint probability into conditional distributions. However, BNs represent dependencies between variables using a directed acyclic graph. Once the conditional probability distributions are learned, data can be sampled from the model, making BNs a natural choice for generating tabular data ( Ankan and Panda 2015 ; Qian et al. 2023 ) . Variational Autoencoders (VAEs), initially proposed by Kingma and Welling (2013) ( Kingma 2013 ) , and Generative Adversarial Networks (GANs), introduced by Goodfellow et al. (2014) ( Goodfellow et al. 2014 ) , represent two prominent classes of generative models extensively used for synthetic data generation. Both methodologies have undergone significant adaptations specifically targeting mixed-type tabular data. For example, VAE-based approaches have been successfully employed in various studies, demonstrating robustness and efficiency in handling mixed-type data ( Xu et al. 2019 ; Akrami et al. 2022 ; Liu et al. 2023 ) . Similarly, GAN-based frameworks have also been widely adapted and applied, showcasing their effectiveness across diverse domains, including healthcare data synthesis and electronic health record generation ( Park et al. 2018 ; Xu et al. 2019 ; Zhao et al. 2021 ; Qian et al. 2023 ; Li et al. 2023 ; Zhao et al. 2024 ) . These adaptations underscore the versatility and ongoing evolution of generative models, continually expanding their applicability and enhancing their performance in producing high-quality synthetic tabular data sets. With the rise in popularity of Large Language Models (LLMs), token-based transformers have also been applied to generate tabular synthetic data based on a specific target data set. Some methods fine-tune pre-trained LLMs directly, while others train LLM-like architectures from scratch ( Borisov et al. 2023 ; Solatorio and Dupriez 2023 ; Karami et al. 2024 ) . In addition to token-based transformers, auto-regressive transformer models specifically designed for tabular data have also been proposed ( Leduc and Grislain 2021 ; Castellon et al. 2023 ; Gulati and Roysdon 2023 ) . Unlike LLMs or token-based approaches, these models explicitly leverage the inherent structure of tabular data, such as limited value ranges, column-specific distributions, and inter-feature relationships, to enhance both the efficiency and quality of synthetic data generation. More recently, researchers have begun exploring hybrid approaches that combine transformers with diffusion to model discrete features ( Zhang et al. 2024a ) . Transformer-based foundation models specifically tailored for tabular data have recently gained traction, notably TabPFN ( Hollmann et al. 2023 ; Hollmann et al. 2025 ) , a prominent example of a transformer-based in-context learner. Although primarily developed for rapid prediction on tabular machine learning tasks, these models inherently capture complex distributions and can also be adapted for synthetic

Read the complete text