DeepIFSAC: Deep Imputation of Missing Values Using Feature and Sample Attention within Contrastive Framework
Ibna Kowsar, Shourav B. Rabbani, Yina Hou, Manar D. Samad · 2025
Read DeepIFSAC: Deep Imputation of Missing Values Using Feature and Sample Attention within Contrastive Framework by Ibna Kowsar, Shourav B. Rabbani, Yina Hou, Manar D. Samad (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10910.txt.
Introduction
Ibna Kowsar and co-authors present a 2025 paper on filling gaps in data tables. Real tables often miss values at random or in patterns, and poor guesses can poison later models. Common fixes break down when the missing share is high or the gaps are not random.
Their method, DeepIFSAC, pays attention along both rows and columns of a table. One attention path links features to each other, and another links similar samples. Training uses a contrastive setup with a data-mixing trick to steady the guesses. Against eleven rival methods on twelve varied data sets, their approach ranked best on average. The edge was clearest when missing rates ran from 10 to 90 percent and gaps followed patterns.
Catalog record
| CREATOR | Ibna Kowsar, Shourav B. Rabbani, Yina Hou, Manar D. Samad |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10910
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DeepIFSAC: Deep Imputation of Missing Values Using Feature and Sample Attention within Contrastive Framework Ibna Kowsar, Shourav B. Rabbani, Yina Hou, Manar D. Samad Abstract Missing values of varying patterns and rates in real-world tabular data pose a significant challenge in developing reliable data-driven models. The most commonly used statistical and machine learning methods for missing value imputation may be ineffective when the missing rate is high and not random. This paper explores row and column attention in tabular data as between-feature and between-sample attention in a novel framework to reconstruct missing values. The proposed method uses CutMix data augmentation within a contrastive learning framework to improve the uncertainty of missing value estimation. The performance and generalizability of trained imputation models are evaluated in set-aside test data folds with missing values. The proposed framework is compared with 11 state-of-the-art statistical, machine learning, and deep imputation methods using 12 diverse tabular data sets. The average performance rank of our proposed method demonstrates its superiority over the state-of-the-art methods for missing rates between 10% and 90% and three missing value types, especially when the missing values are not random. The quality of the imputed data using our proposed method is compared in a downstream patient classification task using real-world electronic health records. This paper highlights the heterogeneity of tabular data sets to recommend imputation methods based on missing value types and data characteristics. August 24, 2026 K eywords attention, missing values, imputation, tabular data, contrastive learning, CutMix. 1 Introduction In the era of big data-driven intelligence, meaningful insights from large data sets are crucial in advancing science, the economy, and industries. The quality and utility of data are often challenged due to the presence of missing values at varying rates and patterns in many domains, including electronic health records (EHR), banking, biology, and cybersecurity [ 1 , 2 , 3 , 4 ] . Missing values in the row-column structure of tabular data are mainly studied in statistics. Moreover, traditional machine learning (ML) remains the preferred approach for tabular data, despite the revolutionary feat of deep learning (DL) in artificial intelligence (AI) for image and text data [ 4 , 2 , 5 ] . DL/ML methods are often benchmarked using clean and curated data, whereas real-world data are rarely ready for DL/ML due to missing values. For example, EHR data inevitably contain missing values because physicians never recommend all tests for every patient or the same test in all medical follow-ups. However, imputation of missing values to enable DL / ML can alter data quality and impact data-driven results. Therefore, missing value imputation (MVI) methods aim to prepare high-quality and unbiased data sets for downstream predictive modeling. The recent literature has presented statistical, machine learning, and deep learning methods for MVI. A common approach is to estimate missing values using feature regression models [ 6 , 7 ] , feature correlation [ 8 , 9 ] , feature attention [ 10 , 11 ] , and generative models [ 12 , 13 ] . We argue that a missing value at the intersection of a row and a column should be estimated by jointly learning column-attention and row-attention to fully leverage the row-column structure of tabular data. Existing column attention methods, namely self-attention, learn from feature dependencies, ignoring row attention to learn missing values from similar samples. Our proposed Deep Imputation using Feature and Sample Attention within the Contrastive (DeepIFSAC) framework adds complementary values to self-attention from between-sample dependencies using row attention. When feature dependencies are weak, missing value estimation may benefit from attending to similar samples via row attention. The proposed missing value estimation is further enhanced by jointly learning column attention and row attention in a contrastive learning framework. Contrastive learning yields a deep representation by keeping similar samples together and dissimilar samples farther away, which aids row attention in minimizing the contribution of outliers or dissimilar samples in MVI. The source code for the implementation of the proposed algorithm has been publicly shared 1 1 1 github link would be shared in the final version for anonymity during the peer-review process . To the best of our knowledge, this paper is the first to propose a joint row-column attention augmented by contrastive learning for missing value estimation in tabular data. The contributions of this paper are as follows. • The proposed MVI method combines between-feature and between-sample attention to learn between-column and between-row dependencies of the row-column structure of tabular data. • The robustness of MVI is enhanced by the CutMix data augmentation method [ 14 ] during model training instead of filling missing values with zero or median values [ 15 , 11 ] . • Contrastive learning attracts similar samples closer and dissimilar ones farther apart in deep representation and facilitates MVI attending to similar samples, minimizing the contributions of outliers. • Unlike other studies, we perform a thorough benchmarking using 12 tabular data sets with varying characteristics, three missing value types, and missing rates between 10% and 90%. The quality of the imputed data is evaluated using real electronic health records to classify patients with heart failure. The structure of the paper is organized in the following order. Section 2 reviews the state-of-the-art traditional and deep learning methods for MVI. The steps of the proposed joint attention learning framework are presented in Section 3. Section 4 discusses the data sets, the experimental setup and scenarios, and the evaluation method. Section 5 presents the imputation performance of our method and compares it with other leading baseline MVI methods. Section 6 summarizes the main findings, provides insight into the results, and outlines limitations with possible avenues for future investigation. The paper concludes in Section 7. 2 Literature review Multiple imputations (MI) are one of the pioneering statistical approaches to MVI, which is the foundation of multiple imputations using chained equations (MICE) [ 6 ] , missForest [ 7 ] , and deep MICE [ 16 ] . MICE iteratively updates missing value estimates for individual variables using linear regression models. Nonlinear machine learning regressions, such as random forests and gradient-boosting trees, have replaced linear regression and demonstrated notable improvements in imputation accuracy [ 7 , 17 , 16 ] . However, regression models can produce values out of range. Nonlinear models are known to overfit data with limited samples and high dimensionality of features [ 18 ] . Mera et al. [ 19 ] argue that MICE is computationally expensive in complex data scenarios. The number and complexity of the regression equations increase with the feature dimension. On the other hand, deep learning methods have rapidly evolved and revolutionized artificial intelligence (AI), primarily for image and text data. However, deep learning solutions [ 4 , 3 , 5 , 20 ] proposed for tabular data have not yet replaced their competitive counterparts in machine learning. Kadra et al. [ 4 ] refer to tabular data as the “last unconquered castle” for deep learning. The limited success of deep learning on tabular data has inspired recent research on deep imputation methods. In [ 16 ] , deep regression within the MICE framework has shown promising performance in imputing up to 80% missing values. The study shows that deep