Early Prediction of Type 2 Diabetes Using Multimodal data and Tabular Transformers

Sulaiman Khan, Md. Rafiul Biswas, Zubair Shah * · 2026

Read Early Prediction of Type 2 Diabetes Using Multimodal data and Tabular Transformers by Sulaiman Khan, Md. Rafiul Biswas, Zubair Shah * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12981.txt.

Introduction

Sulaiman Khan, Md. Rafiul Biswas, and Zubair Shah predict type 2 diabetes early with a tabular transformer. Their model analyzes longitudinal patient data over time. It processes health records together with bone related tabular data. Long range dependencies in disease progression are the signal they chase.

Conventional methods often overlook those slow, complex patterns. A transformer built for tables can weigh distant records against each other. Early prediction of diabetes opens a window for prevention and lifestyle change. The study was funded for publication by Qatar National Library. Multimodal records, joined well, may flag risk years before symptoms. The work serves preventive medicine and health data science.

Catalog record

CREATORSulaiman Khan, Md. Rafiul Biswas, Zubair Shah *
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12981

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Early Prediction of Type 2 Diabetes Using Multimodal data and Tabular Transformers Thanks: The publication of this article was funded by Qatar National Library. Sulaiman Khan, Md. Rafiul Biswas, Zubair Shah * Abstract This study introduces a novel approach for early Type 2 Diabetes Mellitus (T2DM) risk prediction using a tabular transformer (TabTrans) architecture to analyze longitudinal patient data. By processing patients longitudinal health records and bone-related tabular data, our model captures complex, long-range dependencies in disease progression that conventional methods often overlook. We validated our TabTrans model on a retrospective Qatar BioBank (QBB) cohort of 1,382 subjects, comprising 725 men (146 diabetic, 579 healthy) and 657 women (133 diabetic, 524 healthy). The study integrated electronic health records (EHR) with dual-energy X-ray absorptiometry (DXA) data. To address class imbalance, we employed SMOTE and SMOTE-ENN resampling techniques. The proposed model’s performance is evaluated against conventional machine learning (ML) and generative AI models, including Claude 3.5 Sonnet (Anthropic’s constitutional AI), GPT-4 (OpenAI’s generative pre-trained transformer), and Gemini Pro (Google’s multimodal language model). Our TabTrans model demonstrated superior predictive performance, achieving ROC AUC ≥ \geq 79.7% for T2DM prediction compared to both generative AI models and conventional ML approaches. Feature interpretation analysis identified key risk indicators, with visceral adipose tissue (VAT) mass and volume, ward bone mineral density (BMD) and bone mineral content (BMC), T and Z-scores, and L1-L4 scores emerging as the most important predictors associated with diabetes development in Qatari adults. These findings demonstrate the significant potential of TabTrans for analyzing complex tabular healthcare data, providing a powerful tool for proactive T2DM management and personalized clinical interventions in the Qatari population. I Introduction Longitudinal analysis of bone-related measurements has recently emerged as an important tool in exploring the risk factors associated with type 2 diabetes mellitus (T2DM). Several studies have shown that bone mineral density (BMD) and bone mineral content (BMC), measured through dual-energy X-ray absorptiometry (DXA), are not only indicators of skeletal health but are also associated with metabolic disorders including diabetes [ 7 , 15 ] . Moreover, longitudinal DXA data from biobank cohorts have revealed significant associations between bone composition changes and the future development of T2DM, highlighting the potential of skeletal imaging as a predictive biomarker [ 13 ] . Globally, T2DM is followed as a major health concern that directly affect nearly half a billion people worldwide, accurate and early prediction remains critical for reducing disease burden [ 21 , 6 ] . With the availability of large-scale biobank datasets, such as the Qatar Biobank (QBB), it is now possible to study diabetes risk factors using rich longitudinal imaging and clinical data. However, traditional statistical models and conventional machine learning methods often struggle to capture the complex temporal and spatial patterns inherent in biomedical imaging data. This necessitates the adoption of advanced deep learning architectures that can efficiently model these high-dimensional relationships. Recent work has moved beyond tabular features to exploit multimodal data—combining electronic health records (EHRs), imaging, metabolomics, and demographic information—to improve prediction accuracy. For example, metabolomics integrated with machine learning models has enhanced early T2DM prediction [ 19 , 10 ] , while multimodal frameworks using chest X-ray images and EHR data have shown promise for automated diabetes screening [ 4 ] . At the same time, the emergence of transformer architectures has reshaped predictive modeling. Originally introduced in natural language processing, transformers have been adapted for tabular data, demonstrating strong performance in capturing feature interactions and handling missing or noisy data [ 9 , 8 ] . Moreover, multimodal transformer frameworks have been successfully applied in healthcare to integrate heterogeneous data sources, suggesting their potential in chronic disease prediction [ 14 ] . Similarly, vision transformers (ViTs) have gained prominence in medical imaging tasks by leveraging self-attention mechanisms to capture global dependencies across image regions [ 11 , 12 ] . Unlike convolution neural networks (CNNs), which rely primarily on local receptive fields, ViTs can model long-range spatial interactions, making them particularly well-suited for multimodal and longitudinal biomedical data. Applications of ViTs in healthcare, such as diabetic retinopathy classification from retinal fundus images, have demonstrated superior performance compared to traditional CNN-based approaches [ 17 , 16 ] . Similarly, Sumon et al., [ 20 ] proposed a transformer-based model named CardioTabNet for cardiovascular disease prediction using tabular clinical data including cholesterol levels information, fasting blood sugar, and others. Despite these advances, limited research has been conducted on applying tabular transformer (TabTrans) to longitudinal imaging data (bone data) for T2DM prediction. Moreover, the longitudinal investigations of bones parametric data versus diabetes development with time in this context remains underexplored. This motivates the present study, where we propose a tabular transformer-based framework that utilizes longitudinal bone measurements from QBB to predict diabetes risk. Specifically, our main contributions are: (i) to generate features from DXA data and use use TabTrans for annotating and interpreting longitudinal bone data, (ii) to perform feature interpretation for identifying risk factors associated with diabetes development in Qatari adults, and (iii) to perform a comparative analysis of TabTrans against typical machine learning models and generative AI models including Claude 3.5 Sonnet (Anthropic’s constitutional AI model), GPT-4 (OpenAI’s generative pre-trained transformer), and Gemini Pro (Google’s multimodal language model). Our analysis revealed that TabTrans demonstrated superior performance compared to generative AI models but showed lower performance than conventional statistical machine learning (ML) approaches. These findings suggest that for tabular datasets with limited sample sizes, traditional ML algorithms such as XGBoost, LightGBM, and random forest represent more effective alternatives. The conventional ML methods achieved higher precision scores and AUC values compared to both TabTrans and generative AI models evaluated in this study. II Methodology A systematic methodology was implemented to conduct this longitudinal diabetes investigation utilizing RDS information, as illustrated in Fig. 1 . Sequential phases were executed to complete this research endeavor, encompassing data preparation and labeling, feature derivation and model development, predictive analysis and result interpretation. Each of these sequential components is detailed in the following sections. It is worth noting that for this simulation we used a simple PC with 8GB RAM and Intel Processor Core-i7 with no GPU installed. Fig. 1: Systematic methodology followed to perform this research work. II-A Ethics Committee Authorization This investigation operated under supervision from Qatar’s Ministry of Public Health (MOPH) and obtained ethics approval from the institutional review committees of both QBB and Hamad Bin Khalifa University. The study utilized de-identified information supplied by QBB while maintaining compliance with established protocols and regulatory standards. QBB confirmed that appropriate informed consent documentation had been obtained from all research participants and/or their authorized representatives. II-B Data Collection and Preprocessing This study utilizes multimodal data from the Qatar Biobank (QBB), collected through standardized acquisition protocols [ 2 , 3 ] . The dataset comprises diverse modalities, including genetic, DXA, clinical, and retinal fundoscopic data, among others. In this work, we focus on integrating clinical and DXA data through feature engineering to predict diabetes onset using the TabTrans model. The QBB dataset includes two longitudinal components: baseline and follow-up. The baseline dataset captures participants’ initial clinical assessments, whereas the follow-up dataset contains longitudinal records from subsequent visits over time. Following criteria is used to classify participants as healthy or diabetic,

Read the complete text