A Unified Three-Stage Machine Learning Framework for Diabetes Detection, Subtype Discrimination, and Cognitive-Metabolic Hypothesis Testing

Vishal Pandey, Ruzina Haque Laskar, Rishav Tewari · 2026

Read A Unified Three-Stage Machine Learning Framework for Diabetes Detection, Subtype Discrimination, and Cognitive-Metabolic Hypothesis Testing by Vishal Pandey, Ruzina Haque Laskar, Rishav Tewari (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13464.txt.

Introduction

Vishal Pandey, Ruzina Haque Laskar and Rishav Tewari present a three-stage framework for diabetes detection, subtype analysis and metabolic-cognitive link testing. Diabetes affects over 537 million adults, yet most work treats prediction as a simple yes-or-no problem. In stage one, five classifiers and a stacking ensemble are tested on the NCSU Dataset, with support vector machines and logistic regression on top. Stage two uses clustering to recover plausible groups, without labels. Stage three finds a positive link between glycaemic control and cognition in 373 people.

Catalog record

CREATORVishal Pandey, Ruzina Haque Laskar, Rishav Tewari
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26371
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13464

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Unified Three-Stage Machine Learning Framework for Diabetes Detection, Subtype Discrimination, and Cognitive-Metabolic Hypothesis Testing Vishal Pandey, Ruzina Haque Laskar, Rishav Tewari Abstract Diabetes mellitus affects over 537 million adults worldwide and remains a major challenge in preventive healthcare. Existing machine-learning studies primarily formulate diabetes prediction as a binary classification problem, while subtype-oriented analysis and glycaemic-cognitive associations remain comparatively underexplored. We present a reproducible three-stage machine learning framework for diabetes detection, subtype-oriented clustering, and metabolic-cognitive association analysis. In Stage 1, five supervised classifiers together with a stacking ensemble are benchmarked on the NCSU Diabetes Dataset using stratified five-fold cross-validation and evaluation metrics including ROC-AUC, balanced accuracy, recall, and F1-score. SVM-RBF and Logistic Regression achieve the highest ROC-AUC ( 0.825 ± 0.026 0.825\pm 0.026 ), while Random Forest achieves the highest accuracy ( 0.762 ± 0.030 0.762\pm 0.030 ). SHAP explainability identifies Glucose, BMI, and Age as the dominant predictive biomarkers. In Stage 2, silhouette-validated K-Means clustering ( k = 2 k=2 , silhouette ≈ 0.116 \approx 0.116 ) is applied to confirmed diabetic cases using Glucose, Insulin, and Age, recovering clinically plausible subtype-oriented partitions without requiring ground-truth subtype labels. In Stage 3, statistical analysis of the Ohio Longitudinal Cognitive Dataset ( n = 373 n=373 ) reveals a significant positive association between glycaemic control and cognitive function ( ρ s = 0.208 \rho_{s}=0.208 , p = 5.29 × 10 − 5 p=5.29\times 10^{-5} ), which survives Holm correction. The findings support the utility of statistically grounded and interpretable ML pipelines for reproducible diabetes analytics and subtype-aware exploratory analysis. K eywords diabetes mellitus prediction \cdot SHAP explainability \cdot unsupervised subtype discrimination \cdot Type 1 diabetes \cdot Type 2 diabetes \cdot Type 3 diabetes \cdot cognitive decline \cdot clinical decision support \cdot stacking ensemble 1 Introduction Diabetes mellitus is a chronic metabolic disorder characterised by sustained hyperglycaemia arising from defects in insulin secretion, insulin action, or both ( ADA 2021 ) . According to the International Diabetes Federation, an estimated 537 million adults (20-79 years) were living with diabetes in 2021, with projections reaching 783 million by 2045 , a 46% increase driven by ageing populations, urbanisation, and the global obesity epidemic ( IDF 2021 ) . Beyond its primary metabolic burden, diabetes is a leading risk factor for cardiovascular disease, chronic kidney disease, retinopathy, and lower-limb amputation ( Kahn and Cooper 2019 ) , underscoring the urgent need for early, accurate detection and subtype-aware clinical management. The gap in existing ML approaches: A substantial body of machine-learning research has targeted diabetes prediction using tabular clinical datasets , most prominently the Pima Indians Diabetes Database ( Smith et al. 1988 ) , achieving binary classification accuracies in the range of 72-80% ( Sisodia and Sisodia 2018 ; Kavakiotis et al. 2017 ) . However, three clinically important challenges remain largely unresolved in the literature: (i) Metric incompleteness: Most published studies report only accuracy, overlooking recall (sensitivity) and ROC-AUC, the metrics of greatest clinical relevance in a setting where false negatives (missed diabetic cases) carry disproportionate harm. (ii) Absence of subtype discrimination: Virtually all ML studies conflate Type 1 (T1DM) and Type 2 (T2DM) diabetes into a single positive class, despite their fundamentally different aetiologies, management strategies, and long-term complication profiles ( Atkinson et al. 2014 ) . A patient correctly identified as “diabetic” may still receive inappropriate treatment without subtype information. (iii) The Type 3 diabetes hypothesis remains computationally unexplored: An emerging literature proposes that insulin resistance within the central nervous system underlies a neurodegenerative pathway distinct from peripheral diabetes, termed Type 3 diabetes (T3DM) ( Janson et al. 2004 ; Strachan et al. 2018 ; Feinkohl et al. 2015 ) . To our knowledge, no study has applied statistical hypothesis testing to a publicly available longitudinal cognitive dataset specifically to quantify this glycaemic-cognitive association. Our contributions: We address all three gaps with a unified, reproducible three-stage framework: C1. Comprehensive benchmark with explainability: We train and cross-validate five classifiers plus a Stacking Ensemble on the NCSU Diabetes Dataset using stratified five-fold CV, reporting six evaluation metrics per model. SHAP values provide post-hoc, model-agnostic feature attribution that directly maps to clinical biomarker importance. C2. Silhouette-validated unsupervised subtype clustering: We introduce a K-Means clustering stage over the diabetic sub-cohort, validated by the Silhouette Coefficient, Davies-Bouldin Index, and Calinsk-Harabasz Score, to provide an unsupervised proxy for T1DM/T2DM discrimination without reliance on unavailable ground-truth type labels. C3. First statistical test of T3DM markers in public longitudinal data: Using Spearman rank correlation with Holm correction and Kruskal-Wallis group comparison, we test whether glycaemic control is significantly associated with cognitive decline across demented, non-demented, and converted groups in the Ohio Longitudinal Dataset. C4. Full reproducibility: All preprocessing, modelling, and statistical code is released as an annotated Jupyter notebook with pinned dependencies, ensuring that every number in this paper can be independently verified. Significance: Together, these contributions advance the state of ML-based diabetes research along three orthogonal axes: detection performance, clinical interpretability, and multi-type scope. The resulting framework is directly applicable to clinical decision support systems, where a patient query might simultaneously require a binary risk assessment, a probable subtype indicator, and a cognitive risk flag. Paper organisation: Section 2 situates our work within the existing literature. Section 3 describes the three datasets used. Section 4 details the three-stage methodological pipeline. Section 5 presents experimental results with statistical analysis. Section 6 interprets findings in clinical context and acknowledges limitations. Section 7 concludes and outlines future work. 2 Related Work ML for diabetes detection: Sisodia and Sisodia ( Sisodia and Sisodia 2018 ) benchmarked Naïve Bayes, Decision Tree, and SVM on the Pima Indians dataset, reporting a peak accuracy of 76.3% for Naïve Bayes. Kavakiotis et al. ( Kavakiotis et al. 2017 ) surveyed 85 ML studies in diabetes, identifying SVM and ANN as the most frequently applied methods, and noting a persistent gap in multi-class type-level prediction. Shimpi and Shakkeera ( Shimpi and Shakkeera 2021 ) applied five classifiers to the same Pima dataset and reported SVM accuracy of 77.19%, which our SVM-RBF cross-validated result ( 0.750\pm 0.018 ) is directly comparable to given dataset and split differences. Tasin et al. ( Tasin et al. 2023 ) (Frontiers in Computer Science) achieved 75% XGBoost accuracy on a Bengali clinical dataset, a setting not directly comparable to ours but confirming the 73-78% plateau common to tabular diabetes benchmarks. Subtype prediction: Subtype-level ML is substantially less explored. Existing work either relies on ICD code supervision unavailable in open datasets ( Klann et al. 2019 ) or employs clinically unjustified feature thresholds. Our unsupervised clustering approach is the first to validate T1DM/T2DM separation rigorously using three internal cluster validity indices simultaneously. Type 3 diabetes and cognitive ML: The T3DM construct was formalised by de la Monte and Wands ( de la Monte and Wands 2008 ) and has since received corroborating epidemiological evidence ( Janson et al. 2004 ; Feinkohl et al. 2015 ; Vagelatos and Eslick 2013 ) . However, computational studies applying statistical ML methods to quantify this association in publicly available longitudinal data remain absent, a gap this paper directly addresses. Explainability: SHAP ( Lundberg and Lee 2017 ) has become the de-facto standard for post-hoc explanation of tree-ensemble

Read the complete text