AICO: Feature Significance Tests for Supervised Learning
Kay Giesecke, Enguerrand Horel, Chartsiri Jirachotkulthorn · 2025
Read AICO: Feature Significance Tests for Supervised Learning by Kay Giesecke, Enguerrand Horel, Chartsiri Jirachotkulthorn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23396.txt.
Introduction
Kay Giesecke, Enguerrand Horel, and Chartsiri Jirachotkulthorn present a 2025 paper on testing which inputs truly drive a machine learning model. Models guide loans, policy, and science, yet users rarely know which features matter. Older tools lack statistical guarantees or demand costly retraining, so they fail on large modern models.
Their framework, AICO, masks one feature at a time and measures how much predictions worsen. The procedure yields exact p-values and confidence intervals for each feature's importance. It needs no retraining, no stand-in model, and no assumptions about data shape. Tests ranged from credit scoring to mortgage behavior. The method turns interpretability into a quick statistical routine that scales to big models.
Catalog record
| CREATOR | Kay Giesecke, Enguerrand Horel, Chartsiri Jirachotkulthorn |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-23396
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AICO: Feature Significance Tests for Supervised Learning Kay Giesecke, Enguerrand Horel, Chartsiri Jirachotkulthorn Abstract The opacity of many supervised learning algorithms remains a key challenge, hindering scientific discovery and limiting broader deployment—particularly in high-stakes domains. This paper develops model- and distribution-agnostic significance tests to assess the influence of input features in any regression or classification algorithm. Our method evaluates a feature’s incremental contribution to model performance by masking its values across samples. Under the null hypothesis, the distribution of performance differences across a test set has a non-positive median. We construct a uniformly most powerful, randomized sign test for this median, yielding exact p p -values for assessing feature significance and confidence intervals with exact coverage for estimating population-level feature importance. The approach requires minimal assumptions, avoids model retraining or auxiliary models, and remains computationally efficient even for large-scale, high-dimensional settings. Experiments on synthetic tasks validate its statistical and computational advantages, and applications to real-world data illustrate its practical utility. 1 Introduction Supervised learning algorithms have become foundational tools across scientific and industrial domains, enabling breakthroughs and transforming key sectors. However, their opacity poses a major challenge, hindering scientific discovery and limiting adoption in high-stakes domains like finance, public policy and health care, where transparency is crucial. This paper proposes novel testing methods for addressing the opacity of learning algorithms, focusing on the role of an algorithms’s input variables (features). Specifically, we develop a family of hypothesis tests to assess the significance of features in any supervised learning model, whether for regression or classification. The tests are model- and distribution-agnostic: they only require the ability to query the trained model—no assumptions about the model class, data distribution or model target (e.g. conditional mean, quantile) are needed. The computational efficiency of our tests is unprecedented. The procedure does not require retraining or surrogate models, making it well-suited for analyzing complex, high-dimensional algorithms that are costly to train. The tests are based on a new approach for evaluating the impact of a feature. We quantify a feature’s incremental contribution to a user-defined score function, which measures a model’s predictive or decision-making performance on a test sample. Specifically, we compute the feature effect as the change in score when the model is given the actual value of the feature versus when the feature is masked with a baseline value. This masking approach, which we call Add-In Covariates (AICO), avoids the variance inflation (excess randomness) introduced by permutation methods and the high cost of retraining-based and surrogate-model-based strategies. The score function and masking baseline can be user-specified to align with specific interpretability goals and downstream model use cases; we discuss a number of choices and the associated tradeoffs. The feature effect measures the impact of a feature’s variability on model score; it represents the importance of a feature at the level of an individual sample. A null-feature’s effect has a distribution across a collection of test samples whose median is non-positive. We construct a uniformly most powerful, randomized sign test for this median. Randomization at the boundary of the critical region ensures the test’s exactness, i.e., its size (type I error probability) matching the user-specified nominal level (e.g. 5\% ). The test delivers exact, randomized feature p -values that have, conditionally on the data, a uniform distribution on an interval which can be reported in practice. It is simple, robust and permits an efficient implementation. It requires minimal assumptions, ensuring its broad validity in practice. These properties allow users to make valid inferences regarding a model’s features without relying on large-sample approximations or parametric assumptions. The median feature effect being tested is a natural measure of feature importance at the population level. We develop randomized, exact-coverage confidence intervals for the median that, together with the p -values, enable principled inference regarding feature influence. The availability of confidence intervals distinguishes the median from widely-used algorithmic measures of feature importance (see Section 1.1 below). Moreover, depending on the selection of the masking baseline, the median can have several useful properties. These include robustness to correlation between features, which is common in practice. Furthermore, for linear regression, the median is proportional to the square of the feature’s regression coefficient, which is the canonical measure of importance in the linear context. Finally, we provide conditions guaranteeing that a feature’s median being 0 is equivalent to it being conditionally independent of the response given the remaining features. Extensive experiments on synthetic “known truth” tasks demonstrate the statistical and computational performance of our approach in nonlinear regression and classification settings. We compare our tests with the recently developed, model-agnostic and non-asymptotic tests of ? , ? and ? . We also compare with the model-X knockoff procedures of ? and ? for variable selection with false discovery control. Our test is found to be as statistically powerful as the alternatives, with minimal false discovery, while reducing computational costs by several orders of magnitude. Moreover, we show that our feature importance measure is robust to noise in the data, delivering stable feature importance rankings. This contrasts sharply with widely-used algorithmic feature importance measures including SHAP [ lundberg2017unified ] which are found to be highly sensitive to noise in the data, leading to unstable feature rankings that make it difficult to draw reliable inferences regarding variable importance. Our findings complement the discussion of the theoretical caveats of algorithmic importance measures in ? , ? and others. Several comprehensive empirical analyses illustrate our testing and feature importance approach in real-world data settings. In the context of a credit scoring task using large ensembles of gradient boosting machines, our approach identifies and ranks several significant features describing past payment behavior and social factors. Interestingly, we find that gender, marital status, and age of card holders (all of which are protected characteristics under US lending laws) are significant predictors of credit card default, after controlling for past payment behavior. In the context of a mortgage state transition prediction task using a recently proposed set-sequence model based on long-convolution architectures [ elliot ] and trained on extensive panel data, our test identifies time-varying macro-economic variables such as mortgage rates, as well as features summarizing past state transitions as significant predictors of borrower behavior. The rest of this introduction discusses the related literature. Section 2 introduces the notion of feature effects while Section 3 develops the testing procedure. Section 4 analyzes the median feature effect as an importance measure dual to the test. Section 5 studies the performance of the test and importance measure in synthetic regression and classification settings. Section 6 deploys the test on two real-world data sets. The proofs of technical results are given in an appendix. A Python package implementing our testing and importance procedures is available at https://github.com/ji-chartsiri/AICO . 1.1 Related literature There is a large body of work developing algorithmic feature importance measures; see ? for an overview. Popular examples include measures based on Shapley values (e.g. SHAP, see ? and many others), measures based on local approximations (e.g. LIME, see ? ), and measures obtained by permutation methods (e.g. ? , ? ). These measures provide valuable insight into the role of features but unlike the feature importance measures delivered by our hypothesis testing approach, they typically do not offer