A Reproducible Log-Driven AutoML Framework for Interpretable Pipeline Optimization in Healthcare Risk Prediction
Rui Huang, Lican Huang · 2026
Read A Reproducible Log-Driven AutoML Framework for Interpretable Pipeline Optimization in Healthcare Risk Prediction by Rui Huang, Lican Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21528.txt.
Introduction
Rui Huang and Lican Huang present a reproducible log-driven AutoML framework for healthcare risk prediction. Disease risk prediction is hard with heterogeneous features, limited data, and class imbalance. Their deterministic framework models pipeline optimization as a configuration-level system with full reproducibility and traceable logs. Experiments on Pima Diabetes and Stroke datasets across over eighteen thousand configurations reveal a partly redundant search space. Ensemble models reach weighted-F1 of zero point eight nine on Pima and zero point nine four on Stroke.
Catalog record
| CREATOR | Rui Huang, Lican Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 110093 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.21528
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Reproducible Log-Driven AutoML Framework for Interpretable Pipeline Optimization in Healthcare Risk Prediction Rui Huang, Lican Huang Abstract Accurate and reproducible disease risk prediction remains challenging due to heterogeneous features, limited samples, and severe class imbalance. This study introduces yvsoucom-iterkit, a deterministic and log-driven automated machine learning framework that formulates pipeline optimization as a fully reproducible, configuration-level system. Each pipeline is encoded as a traceable log entity, enabling analysis of component attribution, interactions, similarity, and cross-seed robustness. Experiments on the Pima Indians Diabetes and Stroke datasets across more than 18,000 pipeline configurations reveal a structured and partially redundant search space, where performance is governed by a small subset of interacting components. Random Forest importance analysis identifies augmentation (0.454), model choice (0.198), and imbalance handling (0.101) as key drivers on Pima, while imbalance handling dominates Stroke (0.406). Component similarity analysis shows strong redundancy, with feature selection variants (biMax–biMean) exhibiting low RMS distance (0.0252), mixup closely matching no augmentation (0.0279), and TomekLinks aligning with no imbalance handling (0.0325), whereas Gaussian noise shows greater divergence from no augmentation (0.10). The framework achieves strong and stable performance using ensemble models (Weighted-F1 0.89, Macro-F1 0.88 on Pima; Weighted-F1 0.94 on Stroke), while Macro-F1 remains lower on Stroke (0.67) due to class imbalance. Cross-seed analysis reveals a performance–robustness trade-off, with ensembles showing lower variability (0.023–0.026) than SVM. These results indicate that effective AutoML optimization can focus on a reduced set of high-impact components. [orcid=0000-0000-0000-0000] [orcid=0000-0002-9893-6135] † † highlights: A deterministic, log-driven AutoML framework enables fully reproducible and traceable pipeline optimization Large-scale evaluation (18,000+ pipelines) reveals a structured and partially redundant AutoML search space Performance is governed by a small subset of interacting components Ensemble models achieve strong and stable performance (Macro-F1 \approx 0.88 on Pima; Weighted-F1 \approx 0.94 on Stroke), while Stroke shows reduced Macro-F1 ( \approx 0.67 ) under severe class imbalance Cross-seed analysis reveals a performance–robustness trade-off, with ensembles more stable ( \sigma\approx 0.023 –0.026) than SVM keywords Automated machine learning ,Log-driven systems ,Reproducible machine learning ,Pipeline optimization ,Class imbalance ,Healthcare risk prediction ,Model interpretability † † corresponding: Corresponding author 1 Introduction Chronic diseases such as diabetes mellitus and cerebrovascular disorders represent major global health challenges, affecting hundreds of millions of individuals worldwide. Early identification of high-risk individuals is critical for enabling timely intervention and reducing severe complications, including cardiovascular and neurological conditions. With the increasing availability of structured clinical data, machine learning (ML) techniques have become essential tools for healthcare risk prediction, enabling the discovery of complex patterns from heterogeneous clinical attributes [ 12 ] . Despite significant progress, developing reliable ML-based healthcare prediction models remains challenging. Clinical datasets are often small, imbalanced, and heterogeneous, and model performance is highly sensitive to preprocessing decisions, including feature selection, normalization, and data augmentation. Many existing studies rely on manually designed or weakly optimized pipelines, limiting reproducibility and generalizability across datasets and clinical settings. Automated machine learning (AutoML) has emerged as a promising solution by enabling data-driven exploration of model architectures and hyperparameters. However, most existing AutoML frameworks, such as Auto-sklearn, TPOT, and AutoGluon, primarily focus on model selection and hyperparameter optimization, while treating preprocessing and data transformation steps as fixed or only loosely optimized components. As a result, complex interactions between preprocessing strategies and learning algorithms remain underexplored, particularly in small and imbalanced healthcare datasets where such interactions are critical. To address these limitations, we propose yvsoucom-iterkit , a pipeline-centric AutoML framework that jointly optimizes preprocessing and modeling within a unified search space. The framework treats feature selection, normalization, data augmentation, class-imbalance handling, and classification models as first-class components, enabling systematic exploration of their combinations. It operates as a fully automated and reproducible experimentation engine, capable of generating, executing, and evaluating thousands of pipeline configurations without human intervention. Compared with our previous work [ 15 ] , this study significantly extends the scope and rigor of the proposed system by incorporating additional datasets, expanding the pipeline search space, and introducing comprehensive cross-seed evaluation to assess robustness. Furthermore, the framework integrates automated logging and statistical analysis modules, enabling transparent and reproducible benchmarking across large-scale experiments. To evaluate the effectiveness and generality of the proposed system, we conduct extensive experiments on two representative healthcare prediction tasks: diabetes risk prediction using the Pima Indians Diabetes dataset and stroke risk prediction using the Healthcare Stroke Dataset. These datasets differ substantially in feature composition, class distribution, and clinical context, providing a rigorous testbed for assessing robustness and transferability. Experimental results demonstrate that the proposed framework consistently identifies high-performing and stable pipeline configurations, highlighting the importance of joint optimization across preprocessing and modeling stages. Although this study focuses on two representative healthcare tasks, the proposed framework is designed as a general-purpose AutoML system for structured data. It supports flexible combinations of preprocessing and modeling strategies and can be readily applied to other domains involving categorical prediction tasks. The main contributions and findings of this work are summarized as follows: • We propose a pipeline-centric AutoML framework that jointly optimizes preprocessing, data augmentation, imbalance handling, and classification models within a unified and fully reproducible configuration space for healthcare data analysis. • We introduce a log-driven (LogDir) execution paradigm that enables transparent and traceable large-scale experimentation by linking each pipeline configuration to its performance outcomes. • We conduct a large-scale evaluation over 18,000+ pipeline configurations on the Pima and Stroke datasets, enabling multi-level analysis from raw metric distributions to pipeline-level behavior, component-level attribution, cross-component interactions, and cross-seed robustness. • We find that the AutoML search space is highly structured and partially redundant, where many configurations yield near-equivalent performance and only a small subset of components drives performance variation. • We find that ensemble models consistently achieve the best balance between accuracy and robustness, while high-capacity models such as SVM exhibit higher sensitivity to stochastic variation across seeds. • We identify strong dataset-dependent behavior, where Pima exhibits a relatively stable performance landscape, while Stroke shows pronounced sensitivity due to severe class imbalance. The remainder of this paper is organized as follows. Section 2 reviews related work on healthcare prediction and AutoML. Section 3 presents the proposed methodology and framework. Section 4 reports experimental results, followed by discussion and conclusions in Sections 5 and 6 . 2 Related Work 2.1 Automated Machine Learning Automated Machine Learning (AutoML) has evolved into a central paradigm for reducing manual effort in model development by automating algorithm selection, hyperparameter tuning, and, to a limited extent, pipeline construction [ 16 , 14 ] . Early systems such as Auto-WEKA [ 28 ] formulated the Combined Algorithm Selection and Hyperparameter (CASH) problem and addressed it using Bayesian optimization. Subsequent approaches, including TPOT [ 20 ] , introduced evolutionary strategies to explore pipeline configurations, while Auto-sklearn [ 9 , 8 ] incorporated meta-learning and ensemble construction to improve efficiency and robustness. More recent frameworks such as AutoGluon [ 7 ] and H2O AutoML [ 17 ] further emphasize scalability and ensemble learning in large-scale applications. Despite these advances, existing AutoML systems largely retain a model-centric optimization paradigm . Preprocessing operations—such as feature selection, normalization, and data augmentation—are typically treated as auxiliary or weakly parameterized components rather than first-class elements of the search space [ 31 ] . Even when pipeline structures are