Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features
Markus Mueller, Kathrin Gruber, Dennis Fok · 2026
Read Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features by Markus Mueller, Kathrin Gruber, Dennis Fok (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22816.txt.
Introduction
Markus Mueller, Kathrin Gruber, and Dennis Fok improve how machines invent realistic table data. Tables mix whole-number and yes-or-no columns with smooth, continuous ones. The hardest case is a single column that mixes both kinds, with discrete states sitting inside a smooth spread.
Their cascaded flow method builds such data in stages, using ideas from diffusion models. Each stage handles one layer of the problem, so mixed columns come out cleaner. Good fake tables let firms test software and share data patterns without exposing real records. The cascaded design advances diffusion-style generation for tables, a data type that industry holds in enormous, sensitive quantities.
Catalog record
| CREATOR | Markus Mueller, Kathrin Gruber, Dennis Fok |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 136 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22816
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features Markus Mueller, Kathrin Gruber, Dennis Fok Abstract Advances in generative modeling have recently been adapted to tabular data containing discrete and continuous features. However, generating mixed-type features that combine discrete states with an otherwise continuous distribution in a single feature remains challenging. We advance the state-of-the-art in diffusion models for tabular data with a cascaded approach. We first generate a low-resolution version of a tabular data row, that is, the collection of the purely categorical features and a coarse categorical representation of numerical features. Next, this information is leveraged in the high-resolution flow matching model via a novel guided conditional probability path and data-dependent coupling. The low-resolution representation of numerical features explicitly accounts for discrete outcomes, such as missing or inflated values, and therewith enables a more faithful generation of mixed-type features. We formally prove that this cascade tightens the transport cost bound. The results indicate that our model generates significantly more realistic samples and captures distributional details more accurately, for example, the detection score increases by 40%. 1 Introduction Advancements in the field of generative modeling – rooted in seminal contributions on diffusion models ( 47 ; 16 ) , score-based modeling ( 48 ) and flow matching ( 3 ; 28 ; 30 ) – have yielded state-of-the-art results for high-dimensional modalities that admit a homogeneous underlying representation such as images, audio, and text. Diffusion-based models for heterogeneous tabular data generation, i.e., datasets with categorical, continuous or mixed categorical-continuous features in each sample, ( 22 ; 23 ; 56 ; 26 ; 33 ; 45 ) largely inherit this design choice of a shared generative objective across feature types. However, categorical and continuous feature types rest on different structural assumptions, such as discrete versus continuous support, probability mass versus density formulations, differing perturbation or noise models, and therefore require distinct representations and generative mechanisms. Combining distinct feature types under a unified training objective leads to implicit feature reweighting such that some features dominate learning. The intermediate case of mixed-type features, i.e., features whose marginal distributions combine discrete point masses with continuous densities, lacks a dedicated representational and generative treatment, which degrades the realism of the joint distribution. Figure 1 : Overview of TabCascade for the missing value generation task. We derive a categorical, low-resolution representation {\mathbf{z}} from {\mathbf{x}}_{\text{num}} , form {\mathbf{x}}_{\text{low}}=({\mathbf{x}}_{\text{cat}},{\mathbf{z}}) and then learn p_{\text{low}}({\mathbf{x}}_{\text{low}}) . We then learn the high-resolution distribution p_{\text{high}}({\mathbf{x}}_{\text{num}}|{\mathbf{x}}_{\text{low}}) conditional on {\mathbf{x}}_{\text{low}} . This reduces the transport cost bound and simplifies the learning task. The discrete state {\mathbf{z}} enables the model to naturally handle mixed-type feature distributions at generation time. This approach generalizes to arbitrary (and multiple) discrete states. In this paper, we propose TabCascade, a novel cascaded flow matching framework for heterogeneous tabular data. Within this cascaded structure, numerical details are generated conditional on a coarse-grained representation of the high-fidelity data. Accordingly, we conceptualize categorical and numerical features as low- and high-resolution representations of a tabular data row. We explore discretization methods such as distributional regression trees and Gaussian mixture models to construct a categorical, i.e., low-resolution, approximation of the numerical features. TabCascade first learns the low-resolution joint distribution of categorical and discretized numerical data. Subsequently, TabCascade generates numerical data, i.e., the high-resolution signal, conditionally on the low-resolution model’s output. In this second step, TabCascade focuses its capacity on where it is most needed: generating details, as opposed to coarse categorical data, which we show is relatively easy to learn. We design the high-resolution model from a conditional probability path guided by low-resolution information, thereby introducing a data-dependent coupling that reduces the transport costs between source and target distributions of high-resolution data. Further, we allow for the paths to be non-linear by utilizing learnable time schedules conditioned on low-resolution information. We choose the categorical part of the CDTD model ( 33 ) as our low-resolution component. The cascaded formulation also provides a natural mechanism to model mixed-type features ( 27 ) . Among others, such features arise in censored, zero- or one-inflated, and missing-value–augmented variables, where these different discrete outcomes can carry meaningful information ( 29 ) . Realistic synthesis therefore requires the model to generate discrete states (including missingness) as part of the data-generating process. By separating coarse discrete structure from continuous refinement, TabCascade directly accommodates these mixed-type features within a unified generative process. Our results show that this substantially benefits the realism of the generated samples and that TabCascade learns the details of the distributions much more accurately than the current state-of-the-art methods. In sum, our key contributions are: • To the best of our knowledge, we propose the first cascaded diffusion model for tabular data as well as the first diffusion model to address mixed-type feature generation. • We decompose the tabular data generation task into low- and high-resolution parts and propose a novel cascaded flow matching framework. We design a guided conditional probability path to model the high-resolution details of data. • The use of feature-type–tailored models sidesteps the challenge of balancing type-specific losses, thereby preventing the unintended weighting of features during training that is prevalent in previous work. 2 Related Work Diffusion models for tabular data. The main challenge for tabular data generation is the effective integration of heterogeneous (i.e., numerical and categorical) feature sets. TabDDPM ( 23 ) and CoDi ( 26 ) combine multinomial diffusion ( 18 ) with DDPM ( 47 ; 16 ) ; STaSY ( 22 ) treats one-hot encoded categorical data as numerical; and TabSyn ( 56 ) adopts latent diffusion to embed both feature types into a continuous space. Despite its popularity in other domains, latent diffusion has proven less effective for heterogeneous tabular data compared to models defined directly in data space ( 33 ) . More recent models, such as TabDiff ( 45 ) and CDTD ( 33 ) learn noise schedules alongside the diffusion model to accommodate the feature heterogeneity in tabular data. These models integrate score matching ( 48 ; 20 ) with either masked diffusion ( 40 ) or score interpolation ( 14 ) , respectively. While most of these models can be easily adapted to be trainable on data containing missing values, in their original state none of them can generate missing values in numerical features. Exploitation of low-resolution information. Outside the domain of tabular data generation, several approaches exist to leverage low-resolution information. Cascaded diffusion models ( 17 ) for super-resolution images define a sequence of diffusion models, where higher resolution models are conditioned on the lower resolution model’s outputs. This divide-and-conquer strategy has been successfully used in Google’s Imagen model ( 39 ) for the generation of high-fidelity images, and can be further refined with data-dependent couplings ( 2 ) . Similarly, 49 improve sample quality by encoding images into categorical and continuous tokens, which are modeled separately by an autoregressive model and a diffusion model, respectively. 41 introduce auxiliary latent variables to learn a latent lower resolution structure among images to learn pixel-wise conditional noise schedules. This allows the model to adjust the noise in the forward process dependent on low-resolution information of an image. Neural flow diffusion models ( 4 ) generalize this by learning the entire forward process. More generally,