Cross-Model Consistency of Feature Importance in Electrospinning: Separating Robust from Model-Dependent Features

1 st Mehrab Mahdian, 2 nd Ferenc Ender, 3 rd Tamas Pardy · 2026

Read Cross-Model Consistency of Feature Importance in Electrospinning: Separating Robust from Model-Dependent Features by 1 st Mehrab Mahdian, 2 nd Ferenc Ender, 3 rd Tamas Pardy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04905.txt.

Introduction

Mehrab Mahdian, Ferenc Ender, and Tamas Pardy ask whether machine learning models agree on which settings matter most in electrospinning, a sensitive way to make fine fibres. Small changes in operating conditions can alter fibre shape and performance, and many studies trust a single model's ranking of those conditions. That trust may be misplaced, the authors argue.

They trained twenty-one models of many types on ninety-six experiments with polyvinyl alcohol and compared rankings using SHAP values. Models with similar accuracy often ranked features quite differently, showing prediction and explanation are separate qualities. Solution concentration stood out as the most consistent influence across model families.

Catalog record

CREATOR1 st Mehrab Mahdian, 2 nd Ferenc Ender, 3 rd Tamas Pardy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04905

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cross-Model Consistency of Feature Importance in Electrospinning: Separating Robust from Model-Dependent Features 1 st Mehrab Mahdian, 2 nd Ferenc Ender, 3 rd Tamas Pardy Abstract Electrospinning is a highly sensitive process in which small variations in operating parameters can significantly affect fiber morphology. Machine learning (ML) models are increasingly used to capture these process–structure relationships and to infer feature importance. However, most studies rely on a single model, implicitly assuming that the resulting feature importance is reliable. This work evaluates the consistency of feature importance across multiple ML model families using a curated dataset of 96 polyvinyl alcohol (PVA) electrospinning experiments. Twenty-one models spanning linear, tree-based, kernel-based, neural network, and instance-based approaches were trained, and SHAP values were used to compute feature importance consistently across models. A rank-based analysis was then performed to quantify inter-model agreement. The results show that predictive performance and interpretive reliability are distinct properties. While several models achieve comparable accuracy, their feature importance rankings differ substantially. Solution concentration is identified as a fully robust parameter ( σ r = 0 \sigma_{r}=0 ), whereas flow rate and applied voltage exhibit high variability ( σ r > 0.9 \sigma_{r}>0.9 ), indicating strong model dependence. These findings demonstrate that feature importance derived from a single model may be unreliable in small datasets and highlight the need for cross-model validation in ML-based interpretation. I Introduction Electrospinning is a widely adopted nanofabrication technique for producing continuous micro- and nanofibrous materials [ 1 , 2 ] . Its applications span biomedical engineering [ 3 ] , filtration [ 4 ] , energy storage [ 5 ] , and protective textiles [ 6 ] . Across these domains, application performance is governed by the functional and mechanical properties of the nanofiber mat, which are in turn strongly linked to structural features—including fiber diameter, diameter distribution, morphology, and the presence of defects. These structural features are highly sensitive to processing conditions, creating a coupled process–structure–property chain in which small variations in parameters such as solution concentration, applied voltage, flow rate, and tip-to-collector distance can propagate through fiber structure and ultimately determine material performance [ 7 , 8 ] . Navigating this high-dimensional, interdependent parameter space represents a central challenge in electrospinning research [ 9 , 10 ] . Historically, optimizing electrospinning conditions has relied on iterative trial-and-error experimentation—a slow, resource-intensive process in which researchers adjust one or more parameters and observe the resulting fiber morphology. This approach is compounded by the high sensitivity of the process: small changes in conditions can produce disproportionate changes in fiber structure, making systematic manual exploration of the parameter space impractical. Data-driven approaches offer a natural response to this challenge, promising to model the nonlinear relationships between process inputs and structural outputs and thereby reduce reliance on exhaustive physical experimentation. However, the effectiveness of data-driven approaches depends critically on the quality and structure of the available data. Electrospinning datasets are typically small, heterogeneous, and subject to substantial variability across studies [ 11 , 12 , 13 ] —a consequence of differing experimental setups, ambient conditions, and measurement conventions. These characteristics define a small-data regime in which different model families may fit the same dataset equally well while learning fundamentally different internal representations of the process–structure relationship [ 14 , 15 ] . This raises a challenge not just for predictive accuracy, but for the interpretive conclusions that researchers draw from fitted models—conclusions that are increasingly used to guide experimental design. Despite these data limitations, machine learning (ML) has emerged as a powerful tool for modeling electrospinning process–structure relationships. Recent efforts have demonstrated high predictive performance in estimating nanofiber characteristics from experimental inputs [ 16 , 17 , 18 ] , and emerging inverse design frameworks have begun to identify process parameter combinations that yield defined target fiber properties [ 19 , 20 , 21 ] , further reducing reliance on trial-and-error experimentation. The availability of structured, machine-learning-ready datasets has enabled more systematic exploration of these relationships [ 22 , 23 , 12 ] . Within inverse design pipelines in particular, the surrogate model’s recommendations are only as trustworthy as its internal representation of the process–structure relationship: a surrogate that misattributes which parameters govern fiber structure will propagate that misattribution directly into the parameter sets it recommends. This places a premium not only on predictive accuracy but on interpretability—on whether the feature importance a model reports reflects the true process–structure relationship or merely the model’s own inductive biases. Beyond inverse design, there is increasing interest in using ML to extract interpretable insights about the relative importance of process parameters—insights that researchers routinely treat as physical evidence about which variables govern fiber structure and, ultimately, material performance. However, this interpretive step—critical both for scientific understanding and for the reliability of inverse design surrogates—carries an assumption that is rarely examined: that the feature importance derived from a chosen model faithfully reflects the underlying process–structure–property relationships rather than the model’s own inductive biases. To the best of our knowledge, no prior work has systematically evaluated whether feature importance conclusions are consistent across different model families in electrospinning. In practice, different model families may assign substantially different importance to the same parameters, and in small experimental datasets this risk is amplified. If a researcher concludes from a single model that, say, flow rate is a dominant driver of fiber diameter and redesigns experiments accordingly, the consequence of an unreliable interpretation is not merely academic—it is wasted experimental effort in a process that is already costly and time-consuming. This raises a critical but underexplored question: can we trust the feature importance conclusions drawn from ML models in small electrospinning datasets? To address this, the present work investigates the consistency of feature importance across multiple ML model families using a curated dataset of 96 polyvinyl alcohol (PVA) electrospinning experiments. We train diverse models spanning linear, tree-based, kernel-based, and neural network approaches, compute SHAP (SHapley Additive exPlanations) values consistently across all models, and quantify the agreement and variability of the resulting feature rankings. This cross-model analysis provides a principled basis for distinguishing between robust features—those consistently identified as important regardless of model choice—and model-dependent features whose apparent importance reflects the choice of model rather than the underlying process–structure–property relationships. This study advances ML-based interpretation in electrospinning by shifting the focus from predictive performance to the reliability of model-derived feature importance. It provides empirical evidence distinguishing truly influential process parameters from those whose importance is model-dependent, particularly in small experimental datasets. These findings have direct implications for how ML models should be interpreted in electrospinning and underscore the need for cross-model validation when identifying parameters that govern fiber structure. The proposed approach is broadly applicable to other domains where ML is used to infer feature importance from limited data, offering a framework for assessing the reliability of interpretive conclusions under model uncertainty. II Methods II-A Dataset The dataset consists of 96 polyvinyl alcohol (PVA) electrospinning experiments originally reported by Ziabari et al. [ 24 ] and available through Cogni-e-SpinDB 1.0 [ 23 , 25 ] . It was constructed using a Response Surface Methodology (RSM) framework with four factors each sampled at four levels (Table I ), providing structured coverage of the process parameter space. The four input

Read the complete text