Active Tabular Augmentation via Policy-Guided Diffusion Inpainting

Zheyu Zhang, Shuo Yang, Bardh Prenkaj, Gjergji Kasneci · 2026

Read Active Tabular Augmentation via Policy-Guided Diffusion Inpainting by Zheyu Zhang, Shuo Yang, Bardh Prenkaj, Gjergji Kasneci (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10315.txt.

Introduction

Zheyu Zhang and three colleagues close a gap between realistic synthetic data and useful synthetic data. Generative tabular data appeals in data-scarce domains, yet faithful copies do not reliably improve downstream models. The authors formalize a fidelity-utility gap: generators chase plausible records, while synthetic data wins only when new samples reduce the learner's held-out loss. Their 2026 paper proposes TAP, a Tabular Augmentation Policy.

TAP couples diffusion inpainting, a method for filling in missing table entries, with a light policy that steers generation toward high-utility regions. Explicit gating and careful windowed commitment control safe injection as training goes on. Under severe data scarcity, TAP consistently outdid strong generative baselines across seven real-world datasets, with classification accuracy up by as much as 15.6 percentage points and regression error down by up to 32 percent.

Catalog record

CREATORZheyu Zhang, Shuo Yang, Bardh Prenkaj, Gjergji Kasneci
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE126 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10315

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Active Tabular Augmentation via Policy-Guided Diffusion Inpainting Zheyu Zhang, Shuo Yang, Bardh Prenkaj, Gjergji Kasneci Abstract Generative tabular augmentation is appealing in data-scarce domains, yet the prevailing focus on distributional fidelity does not reliably translate into better downstream models. We formalize a fidelity-utility gap : common generative objectives prioritize distributional plausibility, whereas augmentation succeeds only when injected samples reduce the current learner’s held-out evaluation loss. This gap motivates learning not just how to generate, but what to generate and when to inject as training evolves. We propose TAP (Tabular Augmentation Policy) , which couples diffusion inpainting with a lightweight, learner-conditioned policy to steer generation toward high-utility regions and controls safe injection via explicit gating and conservative windowed commitment. Under severe data scarcity, TAP consistently outperforms strong generative baselines on seven real-world datasets, improving classification accuracy by up to 15.6 percentage points and reducing regression RMSE by up to 32%. 1 Introduction Tabular data drives decisions in healthcare, finance, science, and operations ( 23 ; 20 ; 49 ; 5 ) . In exactly these domains, labeled data is often scarce due to privacy constraints, annotation costs, and distribution shift across institutions ( 39 ; 6 ) . While data augmentation is widely adopted as a remedy for limited data, its application to tabular data is particularly fragile. The heterogeneity of tabular features and the presence of strong inter-column dependencies that encode domain-specific constraints imply that even minor perturbations may invalidate samples or introduce spurious relationships ( 18 ; 9 ) . A central challenge is therefore to generate valid records that respect domain constraints while achieving high utility for downstream tasks. Figure 1 : Fidelity-utility gap in tabular augmentation. Fidelity-oriented generators sample high-density regions of P(X,Y) , yielding plausible records that can be redundant and may offer limited downstream gain. Utility is state-dependent and tied to real-query loss. TAP learns what to generate and when to inject using conservative, feasibility-aware decisions under scarcity. Theoretically, valid records are not scattered uniformly across feature space. Instead, they concentrate on a structured manifold shaped by inter-column dependencies and domain constraints ( 34 ; 43 ) . To match its distribution, modern generative models, including GANs, VAEs, flows, and diffusion models, often model either the joint distribution P(X,Y) or a conditional variant, achieving strong statistical fidelity ( 35 ) . However, prior work shows that high-fidelity synthetic data do not necessarily improve downstream performance ( 44 ) . Utility depends on task-specific relevance rather than solely on statistical similarity to the observed distribution. In contrast, classic methods such as SMOTE ( 12 ) expand minority regions through simple neighbor interpolation, producing samples that are easily distinguishable from real data yet often effectively improve classifiers. These observations expose a fundamental tension that traditional generators are typically trained to maximize fidelity to the joint distribution P(X,Y) , whereas successful augmentation should make the learner approximate P(Y|X) better. Therefore, high fidelity is not a sufficient condition for high utility, and under scarcity, it can be misaligned with the learner’s needs. The fidelity-utility gap. This disconnect reflects a misalignment between how generators are trained, and how augmentation is evaluated. Distribution-matching objectives encourage sampling from high-density regions of P(X,Y) , where the learner is already confident. Augmentation, however, is judged in downstream usage ( 51 ; 44 ) . Under scarcity, the most impactful samples often lie where the model is uncertain, such as decision boundaries or under-covered subpopulations, although uncertainty alone is not sufficient ( 6 ; 2 ) . Because these regions correspond to low-density areas under P(X,Y) , generators trained for distribution-matching tend to under-explore them even when the generator achieves high fidelity. Our View. We view an effective generator as a controllable proposal mechanism for augmentation. Given a training set, it induces a family of feasible, anchor-conditioned proposal kernels over the tabular manifold. After that, we study how to control this proposal family to reduce the downstream error. Since the learner changes after each commitment, the utility of the same generation choice changes in training. This feedback makes augmentation an active process and motivates a state-conditioned policy that adapts generation conditions to the evolving learner. Our Method. We instantiate this view in TAP 1 1 1 We make our code publicly available at https://github.com/oooranz/TAP . (short for Tabular Augmentation Policy), as illustrated in Figure 1 . TAP uses diffusion inpainting to produce manifold-local proposals by fixing part of an anchor record and regenerating the remaining columns. A set of explicit quality gates enforces hard feasibility by filtering candidates that violate constraints. A lightweight policy then selects generation conditions based on a compact summary of the learner’s state, thereby improving expected downstream utility. To improve robustness under noisy utility estimates, TAP employs windowed commitment, accumulating admitted candidates in a pool and committing the pool only when its estimated joint benefit exceeds a threshold. Contributions. We turn a strong tabular diffusion generator into a controllable proposal mechanism for augmentation by learning both what to generate and when to inject. Concretely, we (1) formalize augmentation as a sequential control problem under an evolving learner, revealing the fidelity-utility gap and the necessity of state-dependent steering; (2) propose TAP , a state-conditioned policy that steers diffusion inpainting through target, template, and exploration controls, with safe injection enforced by hard gating and windowed commitment; (3) demonstrate consistent improvements across seven real-world datasets and five scarcity levels, with accuracy gains up to 15.6 percentage points and RMSE reductions up to 32% over strong generative baselines. Diagnostic analyses confirm that utility concentrates in informative yet learnable regions, validating our design principles. 2 Background & Motivation The central question on the fidelity-utility gap is what to inject to maximize downstream benefit rather than how to generate more realistic samples. 2.1 Formalizing the Fidelity-Utility Gap Let P denote the distribution over feature-label pairs (x,y) . Augmentation is evaluated on a labeled query set Q_{\mathrm{real}}\sim P , implemented as a validation split or cross-validation folds. An end-to-end augmentation pipeline induces an injection distribution Q over the proposed and injected synthetic samples. This distribution is determined jointly by the generator and the injection rule, and it may evolve as the training set changes. Let f_{\theta} denote a predictor parameterized by \theta , and let \theta(D) be the parameters obtained by training on D . Downstream performance is measured by loss on real queries, L(\theta(D)):=\frac{1}{|Q_{\mathrm{real}}|}\sum_{(x,y)\in Q_{\mathrm{real}}}\ell(f_{\theta(D)}(x),y), (1) where \ell is the task-appropriate loss. The value of injecting a candidate set S is the marginal utility, \Delta U(D,S):=L(\theta(D))-L(\theta(D\cup S)). (2) Fidelity judges plausibility under P , but it does not determine which samples an end-to-end pipeline injects. Utility depends on whether injected samples complement D and reduce loss on Q_{\mathrm{real}} . Under scarcity, high-density samples are often redundant, whereas gains tend to come from informative yet learnable regions that are under-covered by D . This mismatch motivates learning what to generate and when to inject . Directly optimizing Equation 2 is intractable because evaluating \Delta U would retrain the learner for each candidate set. We therefore treat a fixed generator as a proposal family and learn a policy that steers admission and commitment toward positive marginal utility as the learner evolves. A first-order diagnostic of utility. To motivate what

Read the complete text