Hierarchical Synthetic Tabular Data Generation: A Hybrid Top-Down and Bottom-Up Framework
Junfeng Nie, Alvin Jin, Xiaohui Chen · 2026
Read Hierarchical Synthetic Tabular Data Generation: A Hybrid Top-Down and Bottom-Up Framework by Junfeng Nie, Alvin Jin, Xiaohui Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28198.txt.
Introduction
Junfeng Nie, Alvin Jin, and Xiaohui Chen build synthetic tabular data with both rules and statistics. Their hybrid framework draws logical structure top-down while learning local patterns bottom-up, merging both in one synthesis engine with feedback. On financial benchmarks mixing tables and sentiment text, it beat neural baselines on train-synthetic-test-real scores while preserving meaning.
Catalog record
| CREATOR | Junfeng Nie, Alvin Jin, Xiaohui Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24070 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28198
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hierarchical Synthetic Tabular Data Generation: A Hybrid Top-Down and Bottom-Up Framework Junfeng Nie, Alvin Jin, Xiaohui Chen Abstract Existing approaches for synthetic tabular data generation are based on either purely generative models or LLMs, both of which struggle with data heterogeneity, logical consistency, rare-event coverage, and robustness in low-data regimes. In this paper, we propose a hierarchical hybrid top-down and bottom-up (H-TDBU) framework that decouples semantic structures from stochastic texture. In the top-down path, structure-driven logical constraints and cross-modal alignment rules are constructed, while in the bottom-up path, lightweight tabular generators are used to learn local statistical patterns from real data. The two paths are consolidated in a unified synthesis engine with an iterative feedback loop. We evaluate the framework on weak multimodal financial benchmarks combining tabular and sentiment-text data. Experimental results show that our H-TDBU approach improves train-synthetic-test-real performance over neural baseline methods while preserving semantic consistency. Our results suggest that hierarchical rule-guided synthesis provides an effective mechanism for combining controllability, semantic coherence, and statistical fidelity in synthetic data generation. 1 Introduction Tabular data remains a dominant information structure for decision-making systems in domains such as finance, healthcare, and policy. However, its effective use in modern machine learning pipelines is bottlenecked by a combination of scattered data sources, structural heterogeneity, and privacy constraints ( 13 ; 10 ) . Synthetic data generation has emerged as a promising mechanism to mitigate these limitations by producing artificial datasets with new information and structural compliance ( 4 ; 18 ) . A large body of existing work has been focused on learning the distribution of real-world data, including CTGAN and TVAE ( 19 ; 21 ) , as well as more recent tabular diffusion models such as STaSy ( 7 ) , SOS ( 8 ) and TabDDPM ( 9 ) . These methods approximate the distribution of tabular data and sample new data points from the learned distribution. While effective in certain benchmarks, they require substantial amounts of training data and struggle with heterogeneous feature types, leading to potential mode collapse ( 14 ) . This means that unconditional generative models tend to miss important rare and tail events that are crucial in financial applications such as fraud detection. In low-data regimes, which are a key motivating scenario for using synthetic data, these methods tend to overfit and produce lower diversity samples. There is another line of recent work exploring the in-context learning capability of large language models (LLMs). Methods such as GReaT ( 2 ) , REaLTabFormer ( 15 ) , and TabuLa ( 20 ) re-structure table rows as strings and use text foundation models to generate synthetic data points. While such methods benefit from zero-shot synthesis and semantic priors embedded in foundation models, they face several limitations. Notably, autoregressive token generation does not enforce structural consistency, logical constraints, or functional dependencies among attributes, often leading to invalid or incoherent samples. Moreover, sequential row tokenization weakens the modeling of heterogeneous numerical-categorical interactions and long-range feature dependencies. Such methods also struggle to adequately capture tail behaviors and combinatorial edge cases, resulting in limited semantic coverage and controllability. A deeper challenge, largely overlooked in many prior works, is that synthetic data generation is often treated as a purely generative problem. In reality, enterprise-scale data are highly structured, heterogeneous, and distributed across multiple sources and modalities, creating substantial integration and consistency challenges ( 12 ) . Existing methods either ignore this multi-modality or attempt to unify it within a single umbrella model. One key issue of those approaches is that the sole reliance on model-generated data introduces the risk of mode/distribution collapse, where recursively training on synthetic outputs progressively wipes out the underlying data distribution, particularly in the tails ( 13 ) . To mitigate this issue, a recent line of work proposed a multi-stage controllable synthetic data generation approach based on the reasoning capability of LLMs ( 6 ; 17 ) . The central idea is a hierarchical semantic decomposition into a general structure that explicitly defines the “coverage space” of the data set. However, their approach heavily relies on LLM reasoning quality and is operationally expensive in terms of many LLM calls. In this work, we organically integrate the generative and hierarchical perspectives. In the top-down path, we define structure rules via either manual queries or LLM prompts. To complement the structure generation, we couple a lightweight (i.e., low-compute) tabular data generative model (e.g., ensemble methods) in a way that the latent space representation aligns with the generated structure rules in the top-down stage. The top-down and bottom-up paths are reconciled in a unified synthesis engine. Through a feedback loop validating cross-modal metrics, we can maintain logical consistency and high realism. Figure 1 shows a diagram that illustrates our proposed framework. We emphasize that LLMs are only used in the top-down path to generate the scheme representing the structure rules. The actual tabular synthetic data are generated in the bottom-up path by training much cheaper agent models, such as random forests ( 3 ) or XGBoost ( 5 ) . 2 Our Method We introduce a robust framework that combines hybrid top-down and bottom-up synthesis with a hierarchical top-down rule construction process. Top-Down: Structure. Based on human instructions or LLM prompts, we define a structural template \mathcal{S} that acts as the backbone of the synthetic data via learning factors f_{i} that define the structure of the data. This top-down approach yields domain expertise. Here, the rules of the dataset are established, but the dataset lacks realism. The key output of this step is the logical framework \mathcal{S} , which serves as a structured map of a concept space, breaking down abstract factors into concrete, sampleable attributes. Figure 1 : The unified Hybrid Top-Down/Bottom-Up (H-TDBU) framework. The Top-Down stream establishes logical constraints \mathcal{S} , while the Bottom-Up stream learns latent stochastic texture z . The two paths are reconciled in a unified synthesis engine, G(z\in\mathcal{Z}\mid\mathcal{S}) . The reconciliation loop validates the output against TSTR and cross-modal metrics (e.g., XModal) to provide feedback for refining either the Top-Down constraints or the Bottom-Up model, preventing model drift and ensuring logical integrity. Bottom-Up: Texture. To complement the top-down approach, we start with a sample of the real data \mathcal{D}_{\text{real}} . These data serve as the template from which ensemble methods and generative methods (e.g., CTGAN) learn. We denote these base generative methods as G . The output of this process yields a latent space \mathcal{Z} that captures detailed complex patterns that look like real data, but may not follow the logical rules. Synthesis and Reconciliation. Both the logic skeleton \mathcal{S} and the latent texture z are fed into the hybrid top-down/bottom-up generator X_{\text{Syn}}:=G(z\in\mathcal{Z}|\mathcal{S}) to generate data from the latent noise consistent with the logical constraints of \mathcal{S}. The conditional generator here reconciles the logic skeleton \mathcal{S} with the latent texture z derived from the base model. The output is \mathcal{D}_{\text{syn}} , which combines high realism with compliance by construction. We evaluate via training on synthetic data and testing on real data. If the synthetic data \mathcal{D}_{syn} falls below a threshold for XModal (cross-modal fidelity), the system triggers a Retrain Model signal; if it fails Constraint Validation, it triggers an Adjust Constraints signal to the