RelDiff : Relational Data Generative Modeling with Graph-Based Diffusion Models

Valter Hudovernik 1 ∗ {1*}, Minkai Xu 2 ∗ {2*}, Juntong Shi 2 {2}, Lovro Šubelj 1 {1}, Stefano Ermon 2 {2}, Erik Štrumbelj 1 {1}, Jure Leskovec 2 {2} · 2025

Read RelDiff : Relational Data Generative Modeling with Graph-Based Diffusion Models by Valter Hudovernik 1 ∗ {1*}, Minkai Xu 2 ∗ {2*}, Juntong Shi 2 {2}, Lovro Šubelj 1 {1}, Stefano Ermon 2 {2}, Erik Štrumbelj 1 {1}, Jure Leskovec 2 {2} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00710.txt.

Introduction

Valter Hudovernik and co-authors generate fake relational databases with diffusion models in a 2025 computing paper. Real databases link many tables through foreign keys, and that web is the hard part to fake well. Earlier generators flattened the web into single tables or assumed it away. Their model, RelDiff, treats the key graph as a first-class citizen: one diffusion process fills in values across all tables at once, guided by the graph.

A block-model generator separately creates realistic link structure, so made-up rows still point at rows that exist. Tests on eleven benchmarks checked fidelity against real data. Convincing synthetic databases let companies share data's shape without sharing the data.

Catalog record

CREATORValter Hudovernik 1 ∗ {1*}, Minkai Xu 2 ∗ {2*}, Juntong Shi 2 {2}, Lovro Šubelj 1 {1}, Stefano Ermon 2 {2}, Erik Štrumbelj 1 {1}, Jure Leskovec 2 {2}
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00710

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RelDiff : Relational Data Generative Modeling with Graph-Based Diffusion Models Valter Hudovernik 1 ∗ {1*}, Minkai Xu 2 ∗ {2*}, Juntong Shi 2 {2}, Lovro Šubelj 1 {1}, Stefano Ermon 2 {2}, Erik Štrumbelj 1 {1}, Jure Leskovec 2 {2} Abstract Real-world databases are predominantly relational, comprising multiple interlinked tables that contain complex structural and statistical dependencies. Learning generative models on relational data has shown great promise in generating synthetic data and imputing missing values. However, existing methods often struggle to capture this complexity, typically reducing relational data to conditionally generated flat tables and imposing limiting structural assumptions. To address these limitations, we introduce RelDiff , a novel diffusion generative model that synthesizes complete relational databases by explicitly modeling their foreign key graph structure. RelDiff combines a joint graph-conditioned diffusion process across all tables for attribute synthesis, and a 2 ​ K + 2K+ SBM graph generator based on the Stochastic Block Model for structure generation. The decomposition of graph structure and relational attributes ensures both high fidelity and referential integrity, both of which are crucial aspects of synthetic relational database generation. Experiments on 11 benchmark datasets demonstrate that RelDiff consistently outperforms prior methods in producing realistic and coherent synthetic relational databases. Code is available at https://github.com/ValterH/RelDiff . 1 Introduction Relational databases, which organize information into multiple interconnected tables governed by foreign key references, underpin over 70% of global data management systems ( DB-Engines 2024 ) and form the foundation for much of today’s digital infrastructure. However, unlocking access to high-quality real-world datasets is often limited by fairness and privacy concerns ( Ntoutsi et al. 2020 ; Hernandez et al. 2022 ; Breugel van, Schaar van der 2023 ) , particularly in sensitive domains like healthcare ( Appenzeller et al. 2022 ; Gonzales et al. 2023 ) and finance ( Assefa et al. 2020 ; Potluru et al. 2024 ) . Thus, synthetic data generation emerges as a promising solution, offering a way to preserve crucial statistical properties while effectively mitigating privacy risks ( Raghunathan 2021 ) . Moreover, synthetic data can unlock access to valuable enterprise and healthcare databases, facilitating the creation of powerful relational and tabular foundation models ( Breugel van, Schaar van der 2024 ) and has shown promise in missing value imputation ( You et al. 2020 ; Zhang et al. 2025 ) and data augmentation ( Fonseca, Bacao 2023 ) . Unlike image data, which comprises pure continuous pixel values with local spatial correlations, or text data, which comprises tokens that share the same vocabulary, tabular data includes complex and varied distributions ( Xu et al. 2019 ) , making it challenging to learn joint probabilities across multiple columns. Moreover, relational databases exhibit complex structural hierarchies and statistical dependencies across their interconnected tables, often stored at varying levels of normalization ( Codd 1970 ; Delobel 1978 ) , which further intensifies these inherent difficulties. A common simplification involves flattening relational schemas into single tables ( Ge et al. 2021 ; Ghazi et al. 2023 ) , but this approach quickly becomes impractical for large-scale and complex schemas characteristic of real-world databases ( Pang et al. 2024 ) . Current approaches have struggled with two key limitations: (1) the inability to generate arbitrary relational schemas and (2) the failure to effectively preserve inter-table correlations between attributes linked by foreign key relationships ( Hudovernik et al. 2024 ) . While recent progress in tabular diffusion models has demonstrated significant success in preserving within-table attribute correlations Shi et al. 2025 ; Zhang et al. 2024 , their direct application to relational contexts remains limited, with only a few existing methods. Furthermore, a critical limitation of the majority of current techniques lies in their approach of modeling relational databases as a sequence of conditionally generated tabular datasets. This necessitates pre-specified orderings of tables and often involves limiting assumptions, hindering the preservation of overall relational structure and statistical interdependencies inherent in real-world databases. In this paper, we propose RelDiff , a novel generative framework for relational databases. RelDiff enables the synthesis of arbitrary relational schemas by explicitly modeling the underlying database structure with graphs. RelDiff first utilizes a specifically designed 2K+ SBM graph generator to preserve the cardinality of foreign key relationships and the hierarchical dependencies inherent in the relational structure. Built upon this faithful structural representation, we further define a joint graph-based diffusion model for attribute synthesis across interconnected tables, powered by graph neural networks (GNNs) to explicitly capture both inter- and intra-table dependencies. The key innovations of our approach include: (1) A principled formulation for generating foreign key structures in relational databases, incorporating hard constraints to ensure referential integrity through a novel application of Bayesian stochastic blockmodels. (2) A joint diffusion model for synthesizing mixed-type attributes, conditioned on graph structure using GNNs, to better capture global dependencies. (3) We explicitly consider dimension tables, a fundamental component of real-world relational databases ( Garcia-Molina 2008 ) , as a distinct data type and define our diffusion model in data space. These innovations allow us to model relational databases with arbitrarily complex schemas and preserve both statistical and structural dependencies of the data. We conduct comprehensive experiments to justify the effectiveness of our proposed method. Empirical results across two benchmarks, covering 11 datasets and 8 metrics, demonstrate that RelDiff can consistently outperform previous methods, with up to 80\% improvement over the state-of-the-art in preserving column correlation between connected tables. The significant improvements highlight the superior generative capacity of our approach on relational data. 2 Related Work Relational Database Synthesis. Patki et al. 2016 were the first to propose a learning-based method for relational database synthesis - the Synthetic Data Vault (SDV). Recent methods broadly fall into neural network-based (prioritizing fidelity) and marginal-based (focusing on differential privacy) approaches. While marginal-based methods are established for single-table synthesis ( Zhang et al. 2017 ; McKenna et al. 2022 ) , their extension to relational data is more recent, with PrivLava ( Cai et al. 2023 ) and several newer methods emerging ( Alimohammadi et al. 2025 ; Kapenekakis et al. 2024 ; Cai et al. 2025 ) . We focus on neural network-based relational database synthesis, preserving fidelity and utility for arbitrary schemas. Graph variational autoencoder-based methods ( Mami et al. 2022 ) have been investigated but encounter scalability issues with real-world databases. Generative adversarial network (GAN)-based methods, such as RCTGAN ( Gueye et al. 2023 ) and IRG ( Li, Tay 2023 ) , extend the successful CTGAN ( Xu et al. 2019 ) architecture from single-table synthesis to relational data. However, recent advancements have demonstrated the superior performance of diffusion models over GANs in various generative tasks. Autoregressive approaches, leveraging language models ( Solatorio, Dupriez 2023 ) and any-order networks ( Tiwald et al. 2025 ) , have also been investigated, but their autoregressive nature makes them better suited for simpler relational structures, particularly those with single-parent schemas. In contrast, the work of Xu et al. 2023 proposes a method for generating many-to-many datasets using bipartite 2K random graphs. Similar to our approach, they decouple the generation of database structure and attribute synthesis. However, their graph generation method does not capture hierarchical relational structures and primarily focuses on many-to-many relationships, generating tables

Read the complete text