SeBA: Semi-supervised few-shot learning via Separated-at-Birth Alignment for tabular data

Kacper Jurek, Wojciech Batko, Marek Śmieja, Marcin Przewięźlikowski · 2026

Read SeBA: Semi-supervised few-shot learning via Separated-at-Birth Alignment for tabular data by Kacper Jurek, Wojciech Batko, Marek Śmieja, Marcin Przewięźlikowski (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08519.txt.

Introduction

Kacper Jurek, Wojciech Batko, Marek Śmieja, and Marcin Przewięźlikowski address learning from tables when only a few rows carry labels. Medicine, finance, and science often face this shortage, and image style tricks do not transfer well to tables. Their method, called SeBA, splits each table into two matching views and aligns what the model learns from each view.

No artificial changes to the data are needed, which keeps table meaning intact. Theory supports the approach, and tests across several benchmark tables place SeBA at or near the top in most cases. Table based learning with scarce labels gains a fresh route that respects the data as it is.

Catalog record

CREATORKacper Jurek, Wojciech Batko, Marek Śmieja, Marcin Przewięźlikowski
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08519

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SeBA: Semi-supervised few-shot learning via Separated-at-Birth Alignment for tabular data Kacper Jurek, Wojciech Batko, Marek Śmieja, Marcin Przewięźlikowski Abstract Learning from scarce labeled data with a larger pool of unlabeled samples, known as semi-supervised few-shot learning (SS-FSL), remains critical for applications involving tabular data in domains like medicine, finance, and science. The existing SS-FSL methods often rely on self-supervised learning (SSL) frameworks developed for vision or language, which assume the availability of a natural form of data augmentations. For tabular data, defining meaningful augmentations is non-trivial and can easily distort semantics, limiting the effectiveness of conventional SSL. In this work, we rethink SSL for tabular data and propose Separated-at-Birth Alignment (SeBA), a joint-embedding framework for SS-FSL that eliminates the dependence on augmentations. Our core idea is to separate the data into two independent, but complementary views and align the representations of one view to mirror the nearest-neighbor correspondence of the data in the second view. Our experimental evaluation supported by a theoretical analysis justifies that SeBA generates an output space, which improves the feature-label relationship. An experimental study conducted in various benchmark datasets demonstrates that SeBA achieves the state-of-the-art performance in the majority of cases, opening a new avenue for SS-FSL paradigm in the domain of tabular data. 1 Introduction Learning with a limited amount of labeled data remains a fundamental challenge in machine learning and data analysis. Although collecting additional annotations is costly, access to raw unlabeled data is often inexpensive. This imbalance motivates the practical setting of semi-supervised few-shot learning (SS-FSL), where classification must be performed with scarce labeled data and a large pool of unlabeled samples (see Figure 1.1(a) ). Applications in disease diagnosis [ 27 ] , credit risk prediction [ 9 ] , and cognitive sciences [ 12 ] highlight the need for approaches tailored to tabular data. Despite its importance, tabular SS-FSL has been underexplored compared to FSL methods for computer vision (CV) and natural language processing (NLP) [ 10 , 29 , 26 , 24 , 6 , 18 ] . The tabular modality poses unique challenges for typical SS-FSL methods, which rely on pretraining with unlabeled data followed by fine-tuning on a few labeled examples (see Figure 1.1 ). State-of-the-art pretraining approaches often use self-supervised learning (SSL), which encourages models to produce similar representations for semantically related positive pairs while avoiding collapse to trivial solutions [ 35 ] . Such pairs are usually created by sampling multiple augmentations of the same data point. In CV, augmentations are straightforward: image transformations such as cropping, rotation, or color jittering yield valid semantically consistent samples. However, for tabular data, there is no general way to define proper augmentations. Poorly chosen transformations, such as zero masking, Gaussian noise, or sampling features from marginal distribution, can distort semantics or even generate out-of-distribution samples (see Figure 1.1(b) ), ultimately undermining the effectiveness of SSL. Consequently, recent work has turned to alternative pretraining strategies for tabular representation learning – such as cluster detection with prototypical networks [ 19 ] , or diffusion-based methods [ 17 ] – largely sidelining SSL. (a) Semi-supervised Few-shot Learning (SS-FSL) setup. The model is pretrained on a large pool of unlabeled data and next fine-tuned on a few labeled examples. (b) While semantic-preserving augmentations are straightforward to define for modalities such as images, they must be designed much more carefully for tabular data. Improperly designed augmentations can generate samples from outside the data manifold (decreasing car age, but increasing mileage), obfuscate the categorical values (neither option marked as true), or assign incorrect values (number of car seats must be an integer). Figure 1.1 : Typical Semi-supervised Few-shot Learning (SS-FSL) approaches (a) pretrain their representations on large pools of unlabeled data, usually via Self-supervised Learning (SSL). In the case of tabular data, the state-of-the-art augmentation-based SSL approaches cannot be directly applied, due to challenges with defining proper augmentations (b) . In this work, we introduce Separated-at-Birth Alignment, which removes the need for augmentations and improves the tabular representations for SS-FSL (see Figure 3.1 ). In this paper, we rethink SSL for tabular data and show that, with carefully designed positive pairs, it yields significantly stronger tabular representations than previously assumed. Instead of aligning the representations of positive pairs created via augmentations, we introduce Separated-at-Birth Alignment (SeBA), illustrated in Figure 3.1 . SeBA projects data into two complementary subspaces: feature and target views. The model is then pretrained by identifying nearest-neighbor correspondences in the target view, using only the information encoded in the feature view. This replaces the problematic reliance on augmentations with a nearest-neighbor graph. To properly handle mixed data types, we employ a type-aware separation scheme that accounts for both categorical and numerical features, ensuring that the resulting projections remain semantically meaningful. SeBA requires far less dataset-specific knowledge than hand-crafting augmentations, making it practical and easy to apply. Moreover, the model pretrained by SeBA is lightweight and thus less prone to overfitting for small datasets. The experimental results clearly show that SeBA generalizes effectively in a wide variety of tabular datasets, achieving impressive results in few-shot classification, especially on the challenging, high-dimensional benchmarks. Our contributions can be summarized as follows: • We introduce Separated-at-Birth Alignment (SeBA), a novel self-supervised pretraining approach for tabular Few-shot Learning that replaces augmentation-based positive pair construction with a nearest-neighbor graph, removing the need for hand-crafted augmentations. • We provide an in-depth empirical evaluation that confirms that our pretraining generates an output space, which improves the feature-label relationship, see Figure 4.2(b) . This is supported by a theoretical analysis for Gaussian data, which justifies that SeBA produces meaningful positive pairs. • We experimentally verify that SeBA generalizes across a wide variety of tabular datasets, achieving strong performance in few-shot classification, see Section 4.2 . 2 Related work Self-supervised learning for tabular data One of the first approaches to self-supervised learning for tabular data, VIME [ 40 ] , creates a novel pretext task of estimating mask vectors from corrupted tabular data in addition to the reconstruction pretext task for self-supervised learning. [ 2 ] propose SCARF, a contrastive learning method in which different views of a sample are obtained by corrupting a random subset of features. In both methods, data corruption is implemented as sampling from empirical distribution on masked features. [ 34 ] propose SubTab that divides the input features into multiple subsets to perform a pretext task close to mask reconstruction and contrastive learning simultaneously. [ 31 ] propose an augmentation-free method that simultaneously reconstructs multiple randomly generated data projection functions to generate a data representation. T-JEPA [ 33 ] is also an augmentation-free method that is trained by predicting the latent representation of a subset of features from the latent representation of a different subset within the same sample. PTaRL has investigated prototype-based representation learning for tabular data [ 38 ] , which first constructs a prototype-based projection space (P-Space) and then learns the disentangled representation around the global data prototypes. Most of these methods are applied as pretraining techniques, where several deep classifiers are trained on the obtained representation, which is not well suited to SS-FSL problem considered here. Few-shot learning for tabular data Some recent research claims that SSL methods cannot create representations for tabular

Read the complete text