MissHDD: Hybrid Deterministic Diffusion for Hetrogeneous Incomplete Data Imputation Journal: Nuclear Physics B
Youran Zhou, Mohamed Reda Bouadjenek, Sunil Aryal · 2025
Read MissHDD: Hybrid Deterministic Diffusion for Hetrogeneous Incomplete Data Imputation Journal: Nuclear Physics B by Youran Zhou, Mohamed Reda Bouadjenek, Sunil Aryal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14543.txt.
Introduction
Youran Zhou, Mohamed Reda Bouadjenek, and Sunil Aryal propose MissHDD for filling missing values in mixed type tables. Real tables mix numbers, categories, and discrete values in one data set. Most diffusion based imputers assume one uniform feature type. That leads to collapse for categories or unstable updates for numbers.
MissHDD splits features into two generative channels that work in parallel. A deterministic channel handles numeric values with stable denoising. A discrete latent path channel handles categories without leaving valid values. Together they preserve conditional structure across the whole row. The hybrid design aims for more reliable imputation on heterogeneous real world data.
Catalog record
| CREATOR | Youran Zhou, Mohamed Reda Bouadjenek, Sunil Aryal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14543
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MissHDD: Hybrid Deterministic Diffusion for Hetrogeneous Incomplete Data Imputation Journal: Nuclear Physics B Youran Zhou, Mohamed Reda Bouadjenek, Sunil Aryal Abstract Incomplete data are common in real-world tabular applications, where numerical, categorical, and discrete attributes coexist within a single dataset. This heterogeneous structure presents significant challenges for existing diffusion-based imputation models, which typically assume a homogeneous feature space and rely on stochastic denoising trajectories. Such assumptions make it difficult to maintain conditional consistency, and they often lead to information collapse for categorical variables or instability when numerical variables require deterministic updates. These limitations indicate that a single diffusion process is insufficient for mixed-type tabular imputation. We propose a hybrid deterministic diffusion framework that separates heterogeneous features into two complementary generative channels. A continuous DDIM-based channel provides efficient and stable deterministic denoising for numerical variables, while a discrete latent-path diffusion channel, inspired by loopholing-based discrete diffusion, models categorical and discrete features without leaving their valid sample manifolds. The two channels are trained under a unified conditional imputation objective, enabling coherent reconstruction of mixed-type incomplete data. Extensive experiments on multiple real-world datasets show that the proposed framework achieves higher imputation accuracy, more stable sampling trajectories, and improved robustness across MCAR, MAR, and MNAR settings compared with existing diffusion-based and classical methods. These results demonstrate the importance of structure-aware diffusion processes for advancing deep learning approaches to incomplete tabular data. † † graphicalabstract: † † highlights: Research highlight 1 Research highlight 2 1 Introduction Missing data are ubiquitous in real-world applications such as healthcare [ 14 ] , finance [ 2 ] , recommendation systems [ 5 ] , and sensor networks [ 6 ] . In tabular datasets, missing entries can degrade predictive performance and introduce bias or uncertainty in downstream analysis. As a result, imputation, i.e., estimating missing values from partially observed data, remains a crucial step in modern data-centric pipelines. Classical approaches, including mean or mode substitution [ 10 , 23 ] , k -nearest neighbors [ 32 ] , MICE [ 7 ] , and MissForest [ 24 ] , offer simple and computationally efficient solutions. However, they typically operate under restrictive assumptions, struggle to model complex feature dependencies, and adapt poorly to structured or mechanism-driven missingness. To overcome the limitations of classical imputers, recent research has increasingly explored deep generative models for missing-data reconstruction. GAN-based methods such as GAIN [ 29 ] and MisGAN [ 1 ] , and variational approaches such as MIWAE [ 15 ] , HI-VAE [ 17 ] , and their extensions [ 30 , 34 ] , learn expressive joint distributions over observed and missing variables and have demonstrated notable improvements in imputation fidelity. In parallel, diffusion models have emerged as a powerful class of generative models with stable likelihood-based training and strong sample quality across vision, audio, and time-series domains [ 27 , 8 , 4 ] . Several recent works have adapted diffusion to the tabular setting, including TabCSDI [ 33 ] , MissDiff [ 18 ] , TabDDPM [ 13 ] , and DiffPuter [ 31 ] . Denoising Diffusion Implicit Models (DDIMs) [ 22 ] further provide a deterministic non-Markovian alternative to DDPMs, replacing stochastic transitions with parameterized reverse trajectories that substantially reduce inference cost and sampling variance. These developments highlight the promise of diffusion-based methods for fine-grained tabular imputation through iterative denoising. Despite this progress, applying diffusion models to tabular imputation remains nontrivial [ 35 , 21 ] . Most existing methods build on DDPMs, whose stochastic sampling introduces high inference latency and produces different imputations across runs an undesirable property in applications requiring stability, determinism, or auditability. This is unsurprising: standard diffusion models were originally developed for generative tasks such as image or audio synthesis, where sampling diversity is essential to reflect the richness of the data distribution. However, the objectives of tabular imputation differ fundamentally. Practitioners typically seek accurate and semantically consistent completions, or a reliable surrogate dataset for downstream prediction or risk modeling. In this setting, excess sampling diversity provides little value and can instead harm reproducibility and downstream task performance. Moreover, many diffusion-based imputers assume fully observed training samples or employ weak conditioning mechanisms that degrade when the inputs themselves are incomplete which is an assumption violated by most real-world datasets. A deeper challenge arises from the heterogeneous nature of tabular data. Conventional diffusion formulations are tailored to homogeneous continuous domains and do not naturally accommodate the mixed statistical manifolds of tabular features. Numerical, categorical, and discrete variables exhibit fundamentally different geometric and probabilistic structures. Applying a single continuous Gaussian diffusion process across all feature types leads to severe mismatches: categorical variables suffer from semantic drift and information collapse, discrete states leave their valid support, and the model struggles to preserve conditional consistency across timesteps. These structural incompatibilities form a central barrier to extending diffusion models to robust, heterogeneous tabular imputation. In real-world settings, continuous features (e.g., laboratory measurements or financial indicators) commonly coexist with categorical or discrete attributes (e.g., diagnosis codes, product categories, user identifiers). Numerical columns benefit from smooth deterministic denoising trajectories, whereas categorical and discrete variables must evolve on probability simplexes to avoid invalid intermediate states. A single unified diffusion process is not suitable, as it must simultaneously satisfy incompatible geometric and probabilistic requirements across feature types. To address these challenges, we propose MissHDD , a hybrid deterministic diffusion framework for imputing heterogeneous incomplete tabular data. MissHDD decomposes the generative process into two complementary diffusion channels that respect the distinct statistical structure of numerical and categorical/discrete features. A continuous DDIM-based channel handles numerical variables through deterministic non-Markovian trajectories, enabling fast, stable, and low-variance reconstruction. In parallel, a discrete latent-path diffusion channel—motivated by recent loopholing-based discrete diffusion methods—operates on categorical and discrete variables directly within their proper sample spaces, avoiding one-hot collapse and preserving distributional structure across timesteps. These two channels are integrated under a unified conditional objective that explicitly models the conditional distribution p(x_{\mathrm{mis}}\mid x_{\mathrm{obs}}) , ensuring coherent conditioning throughout the denoising process. To support learning from realistically incomplete datasets, we further introduce a self-masking strategy that creates pseudo-missing entries from partially observed samples. This exposes the model to diverse missingness patterns and allows both diffusion channels to be trained without requiring fully observed data—a critical property for real-world tabular domains where complete samples are rare. Extensive experiments across multiple real-world datasets show that MissHDD delivers state-of-the-art imputation accuracy, significantly improved run-to-run stability, and substantially reduced inference latency compared with existing diffusion-based and classical generative baselines. Our main contributions are as follows: 1. We propose MissHDD , the first hybrid two-channel deterministic diffusion framework for heterogeneous incomplete tabular data, integrating a continuous DDIM channel for numerical features with a discrete latent-path diffusion channel for categorical and discrete features. 2. We introduce a two-channel generative formulation that assigns feature types to diffusion processes aligned with their underlying statistical manifolds, ensuring stable conditioning and preventing information loss or semantic drift in categorical and discrete dimensions. 3. We develop a unified self-masking training strategy that learns directly from incomplete data, eliminating the need for fully observed training samples and improving robustness to realistic MCAR, MAR, and MNAR missingness mechanisms. 4. Through comprehensive evaluations on diverse real-world datasets, we demonstrate that MissHDD achieves state-of-the-art imputation