LiBaGS: Lightweight Boundary Gap Synthesis for Targeted Synthetic Data Selection

Abhishek MoturuDepartment of Computer ScienceUniversity of TorontoThe Hospital for Sick ChildrenUHN KITE Research InstituteT-CAIREMVector Institute [email protected], Anna Goldenberg Department of Computer ScienceDepartment of Laboratory Medicine and PathobiologyUniversity of TorontoThe Hospital for Sick ChildrenT-CAIREMVector Institute [email protected] Babak Taati Department of Computer ScienceInstitute of Biomedical EngineeringUniversity of TorontoRehabilitation Sciences InstituteUHN KITE Research InstituteVector Institute [email protected] · 2026

Read LiBaGS: Lightweight Boundary Gap Synthesis for Targeted Synthetic Data Selection by Abhishek MoturuDepartment of Computer ScienceUniversity of TorontoThe Hospital for Sick ChildrenUHN KITE Research InstituteT-CAIREMVector Institute [email protected], Anna Goldenberg Department of Computer ScienceDepartment of Laboratory Medicine and PathobiologyUniversity of TorontoThe Hospital for Sick ChildrenT-CAIREMVector Institute [email protected] Babak Taati Department of Computer ScienceInstitute of Biomedical EngineeringUniversity of TorontoRehabilitation Sciences InstituteUHN KITE Research InstituteVector Institute [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11231.txt.

Introduction

Abhishek Moturu, Anna Goldenberg, and Babak Taati present LiBaGS, a light method for picking targeted synthetic data through boundary gap building. Such data helps only when new samples cover missing parts of the training spread that matter for the downstream task.

LiBaGS scores tried samples by mixing decision-edge nearness, guess uncertainty, real-data density, and soundness, so picked samples are both useful and likely to stay on the real data manifold. A gap sharing rule targets sparse but true-to-life edge zones rather than simply adding more data or picking only the most unsure picks. LiBaGS also learns when enough samples have been added through an extra-value stopping rule and assigns softer labels near unclear edges. Data teams get data chosen for gaps, not volume.

Catalog record

CREATORAbhishek MoturuDepartment of Computer ScienceUniversity of TorontoThe Hospital for Sick ChildrenUHN KITE Research InstituteT-CAIREMVector Institute [email protected], Anna Goldenberg Department of Computer ScienceDepartment of Laboratory Medicine and PathobiologyUniversity of TorontoThe Hospital for Sick ChildrenT-CAIREMVector Institute [email protected] Babak Taati Department of Computer ScienceInstitute of Biomedical EngineeringUniversity of TorontoRehabilitation Sciences InstituteUHN KITE Research InstituteVector Institute [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40501
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11231

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LiBaGS: Lightweight Boundary Gap Synthesis for Targeted Synthetic Data Selection Abhishek MoturuDepartment of Computer ScienceUniversity of TorontoThe Hospital for Sick ChildrenUHN KITE Research InstituteT-CAIREMVector Institute [email protected], Anna Goldenberg Department of Computer ScienceDepartment of Laboratory Medicine and PathobiologyUniversity of TorontoThe Hospital for Sick ChildrenT-CAIREMVector Institute [email protected] Babak Taati Department of Computer ScienceInstitute of Biomedical EngineeringUniversity of TorontoRehabilitation Sciences InstituteUHN KITE Research InstituteVector Institute [email protected] Abstract Synthetic data is useful only when the added samples fill missing parts of the training distribution that matter for the downstream task. We introduce LiBaGS , a lightweight, generator-agnostic method for targeted synthetic training data selection. LiBaGS scores candidate synthetic samples by combining decision-boundary proximity, predictive uncertainty, real-data density, and support validity, so that selected samples are both informative and likely to remain on the real data manifold. We then use a boundary-gap allocation rule that targets sparse but realistic decision-boundary neighborhoods, rather than simply adding more data or selecting only the most uncertain candidates. LiBaGS also learns when enough synthetic samples have been added through a marginal-value stopping rule, assigns softer labels near ambiguous boundaries, and uses a diversity objective to avoid redundant near-duplicate selections. Experiments show that LiBaGS improves accuracy over classical oversampling, hard augmentation, uncertainty-based selection, and targeted-generation selection criteria. 1 Introduction Synthetic data has become a common way to improve supervised learning when real data is scarce, expensive, imbalanced, private, or locally incomplete. Classical oversampling methods such as SMOTE, Borderline-SMOTE, ADASYN, Safe-Level-SMOTE, KMeans-SMOTE, MWMOTE, and Geometric SMOTE generate synthetic samples by interpolating minority examples, emphasizing boundary-adjacent points, or changing the local sampling geometry [ 7 , 14 , 16 , 6 , 30 , 4 , 10 ] . Representation-space methods such as manifold oversampling and DeepSMOTE move this idea into learned features, which is especially relevant for image-like data [ 5 , 9 ] . At the same time, augmentation methods such as mixup, Manifold Mixup, CutMix, Co-Mixup, CMO, and AugMax improve generalization by creating stronger or more diverse training examples [ 56 , 48 , 55 , 23 , 38 , 49 ] . These methods show that synthetic or augmented data can help, but they also highlight a recurring issue: not every synthetic sample is useful. This issue has become even more pronounced with modern generative models. GANs and diffusion models can produce large candidate pools, and recent work has shown that diffusion-generated data can improve image classification under the right conditions [ 12 , 19 , 3 ] . Targeted-generation methods go further by using uncertainty, classifier feedback, long-tail signals, hard-negative objectives, or curriculum schedules to generate more informative synthetic samples [ 37 , 18 , 26 , 31 , 2 , 52 , 32 , 15 , 24 ] . They show that useful synthetic data is often hard, uncertain, rare, or classifier-informative. But, many methods still treat usefulness primarily as a local score, a generation prompt, or a curriculum signal. LiBaGS instead asks a much more explicit allocation question: where should synthetic samples be placed, and how many should be kept, after accounting for real-data coverage? A candidate can be rare but irrelevant if it lies far from the decision boundary. A candidate can be uncertain but redundant if the training set already contains many nearby samples. A candidate can look boundary-like but harmful if it is off the real data support. Useful targeted synthetic data should satisfy three conditions at once: 1. it should lie near a decision-boundary neighborhood, 2. occupy a region where real data is locally sparse, and 3. remain on support, i.e. resemble realistic data from the true distribution. LiBaGS satisfies the above conditions. Let \mathcal{Z} denote the feature space, let z\in\mathcal{Z} denote the feature representation of an input sample, p(z) the real data density, q(z) the synthetic allocation density, n the number of real samples, and m the number of synthetic samples. Let r(z) be a local boundary-gap value that is high only when a candidate is boundary-relevant, uncertain, and support-valid. We view classification error near the decision boundary as depending on how much useful data exists in a region. This can be approximated by: J_{m}(q)=\int_{\mathcal{Z}}\frac{r(z)}{np(z)+mq(z)}dz. (1) Note that np(z)+mq(z) represents the amount of local evidence from real and synthetic samples. Regions that already contain many real samples (large p(z) ) benefit less from additional synthetic data. In contrast, regions with few real samples (small p(z) ) but high boundary gap (large r(z) ) is where synthetic samples can provide the greatest benefit. Minimizing 1 gives the following boundary-gap allocation rule: q^{*}(z)=\frac{1}{m}\left[\sqrt{\frac{r(z)}{\lambda}}-np(z)\right]_{+}, (2) where \lambda is a normalization constant automatically determined by the total synthetic allocation constraint. Intuitively, this rule places more synthetic samples in regions that are important for the decision boundary but poorly covered by real data, and places few or no synthetic samples in regions that already have enough real-data coverage. LiBaGS is deliberately generator-agnostic and does not require retraining a diffusion model or training a new generator. A generator, interpolator, simulator, or augmentation pipeline proposes candidates, which LiBaGS then scores, filters, and diversifies. This is useful because generator quality varies. If a strong generator proposes many valid candidates, LiBaGS selects the most useful ones. If a weak generator proposes many artifacts, the support validity term and adaptive stopping rule prevent the method from blindly adding them. Thus, LiBaGS is a lightweight allocation rule that can be incorporated into existing synthetic data generating pipelines. We make four contributions. First, we formulate targeted synthetic training data as a boundary-gap allocation problem . Second, we derive a boundary-gap allocation rule that uses boundary proximity, uncertainty, support validity, and real-density coverage. Third, we provide a practical finite-candidate algorithm with adaptive stopping and diversity-aware selection. Fourth, we empirically compare LiBaGS against classical oversampling, hard augmentation, uncertainty-based selection, and targeted-generation selection criteria. Full proofs are in Appendix A . 2 Related Work Oversampling and interpolation. SMOTE and its variants are classical baselines for synthetic training data [ 7 , 14 , 16 , 6 , 30 , 10 , 4 ] . These methods are often framed around class imbalance, local minority neighborhoods, or interpolation geometry. LiBaGS is motivated by a related intuition that samples near the decision boundary are often especially useful. However, it differs in two important ways: it does not target boundary proximity alone but also discounts regions that are already well covered by real data and it is generator-agnostic and can select from any proposed synthetic candidate pool, rather than being limited to interpolation among minority-class examples. Augmentation and mixing. Mixup, Manifold Mixup, CutMix, Co-Mixup, CMO, and AugMax improve generalization by creating similar, patch-level, context-rich, or hard augmented examples [ 56 , 48 , 55 , 23 , 38 , 49 ] . These methods provide strong augmentation baselines, however, LiBaGS is complementary to them since it can select from augmented candidates by asking whether a candidate fills an under-covered decision-boundary neighborhood. Targeted synthetic generation. TSynD optimizes latent representations toward high epistemic uncertainty for medical image classification [ 37 ] . Feedback-guided synthesis uses classifier feedback while emphasizing support and diversity [ 18 ] . GenDataAgent augments data on the fly using signals related to difficult training samples and gradient-update variance [ 31 ] . Deliberate Practice improves synthetic-data

Read the complete text