Hypothesis-free discovery from epidemiological data by automatic detection and local inference for tree-based nonlinearities and interactions

Giorgio Spadaccini (Vrije Universiteit Amsterdam, Leiden University) Marjolein Fokkema (Leiden University) Mark van de Wiel (Vrije Universiteit Amsterdam) · 2025

Read Hypothesis-free discovery from epidemiological data by automatic detection and local inference for tree-based nonlinearities and interactions by Giorgio Spadaccini (Vrije Universiteit Amsterdam, Leiden University) Marjolein Fokkema (Leiden University) Mark van de Wiel (Vrije Universiteit Amsterdam) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00571.txt.

Introduction

Giorgio Spadaccini, Marjolein Fokkema, and Mark van de Wiel hunt for hidden risk patterns in health data, with honest uncertainty attached to each find. Their work came out in 2025. Machine learning finds nonlinear effects and interactions with no hypotheses set in advance. Epidemiology loves that reach, but it needs valid inference to trust the finds. Shapley values show what shaped one case, yet they come with no error bars. Their RuleSHAP plan closes that gap.

RuleSHAP joins a sparse Bayesian regression model with a tree-based rule generator. Shapley scores then carry uncertainty at the individual level, case by case. A short formula computes marginal Shapley values inside the scheme. Finding effects and judging them with sound inference now travel as one act. Health researchers can search with no fixed guess first and still keep rigor. Hypothesis-free discovery earns sound statistical manners.

Catalog record

CREATORGiorgio Spadaccini (Vrije Universiteit Amsterdam, Leiden University) Marjolein Fokkema (Leiden University) Mark van de Wiel (Vrije Universiteit Amsterdam)
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE133 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00571

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hypothesis-free discovery from epidemiological data by automatic detection and local inference for tree-based nonlinearities and interactions Giorgio Spadaccini (Vrije Universiteit Amsterdam, Leiden University) Marjolein Fokkema (Leiden University) Mark van de Wiel (Vrije Universiteit Amsterdam) Abstract Abstract In epidemiological settings, Machine Learning (ML) is gaining popularity for hypothesis-free discovery of risk (or protective) factors. Although ML is strong at discovering non-linearities and interactions, this power is currently compromised by a lack of reliable inference. Although local measures of feature effect can be combined with tree ensembles, uncertainty quantifications for these measures remain only partially available and oftentimes unsatisfactory. We propose RuleSHAP, a framework for using rule-based, hypothesis-free discovery that combines sparse Bayesian regression, tree ensembles and Shapley values in a one-step procedure that both detects and tests complex patterns at the individual level. To ease computation, we derive a formula that computes marginal Shapley values more efficiently for our setting. We demonstrate the validity of our framework on simulated data. To illustrate, we apply our machinery to data from an epidemiological cohort to detect and infer several effects for high cholesterol and blood pressure, such as nonlinear interaction effects between features like age, sex, ethnicity, BMI and glucose level. KEYWORDS: Bayesian uncertainty quantification, Tree ensembles, Shapley values, Interactions, Nonlinearity 1 Introduction Risk and protective factors are at the center of many studies in epidemiology. These studies aim to understand how policies, behaviors and treatments are associated to negative and positive health outcomes. In most cases, (generalized) linear regression is employed, for which inference is readily available. This approach, however, is very rigid: unless prior knowledge enables explicit specification of interaction terms, the association between a feature and the outcome is either statistically relevant for all or none of the observations, depending on whether the coefficient of the linear term is significantly non-zero. In practice, the strict assumptions of a linear model can be far from the truth: the shapes of effects are often nonlinear and (treatment) effects, for example, may be heterogeneous across different population groups. For contexts in which linearity is too restrictive, the expression “hypothesis-free discovery” is often used to refer to scientific investigation made through least restrictive Machine Learning (ML) models [ 1 ] [ 2 ] . Unlike parametric models such as linear regression, ML models typically capture more complex patterns in the data, as they do not require any prior specification of the shape of the association between the features and the outcome. This gives researchers an edge over the standard approach, as methods such as a tree ensemble can, for instance, automatically capture trends like saturations, exponential growths and interactions, which a linear model would miss. To obtain both the flexibility of ML and the inferential power of traditional methods, many researchers rely on a two-step procedure [ 2 ] [ 3 ] [ 4 ] : first, an ML model (typically a tree ensemble such as XGBoost) is fitted on the data and feature importance measures are computed. Second, the most influential features according to this importance ranking are used for inference through means of a simpler generalized linear regression model. However, this approach is suboptimal: type I error is inflated when using the same data for both screening of features and inference. This is due to the fact that the noise features that pass the filtering stage are precisely the ones that, by chance, fit the current sample best, and the regression stage does not take this into account (see Example 3 in the Supplementary material). The obvious solution of using separate portions of the dataset for screening and testing is unfortunately often not an option for settings where the sample size is not extremely large or high power is needed. Either way, the inferential results are not truly hypothesis-free, since the inferential step remains a simple regression. For example, while the ML model could select a feature due to its interacting or nonlinear effects, the regression model would ignore these effects due to its excessive simplicity. Careful semi-parametric modeling, e.g. through Generalized Additive Models (GAMs [ 5 ] [ 6 ] ) may capture some of the nonlinearities, but may not suffice for discovering general interaction terms. Bayesian Additive Regression Trees (BART) provide the full flexibility of tree ensembles, while aiming to naturally account for the uncertainty in the model fit. They have also been used in combination with local feature importance measures to produce local inference of feature effects [ 7 ] . However, this approach may present suboptimal coverage [ 8 ] [ 9 ] , and consequentially high false discovery rates, as we later show with simulations. We aim to obtain both flexibility and inference. We employ a strategy inspired by RuleFit [ 10 ] and Horserule [ 11 ] , directly incorporating the knowledge of the first ML-based step into the second regression-based step. More specifically, the trees in the ensemble are disaggregated into 0-1 encoded dummy variables and included alongside the original predictor variables in the linear fit. The complex patterns in the data detected by the tree ensemble are thereby “transferred” to the linear model, so that they can also be used for inference. The aim is to build a regression model that is augmented with ML, where the extra rule terms offer a supportive role to an otherwise linear model. With the incorporation of such patterns into the model, the prediction mechanism goes beyond simple additivity and the effect of one feature can now depend on unique combinations of all other features. For these reasons, an observation-specific interpretation of the effect of features on the outcome becomes more and more relevant, and testing feature effects on a local level becomes much more informative and desirable. With this in mind, local feature importance measures have already been introduced for these two models [ 10 ] but we will show them to be misleading. Further, while HorseRule allows for uncertainty quantifications of the model, we will show that these cannot be used for statistical testing on the importance measures. More generally, the problem is that RuleFit and HorseRule optimize predictive performance, rather than scientific discovery, and we show them to be unsuitable for detecting and testing complex relationships between the features and the outcome. We propose RuleSHAP, a framework for using rule-based, hypothesis-free discovery that combines Bayesian regression, tree ensembles and Shapley values and carries out a one-step procedure that both detects and tests complex patterns. While it builds on the principles of RuleFit and HorseRule, it is designed to rely on a linear model as much as possible, while also incorporating rules to specifically model the nonlinearities and interactions. Moreover, it is designed to more accurately account for uncertainty in the estimation so that type I error is not inflated. First, it generates rules in a manner that prevents them from overfitting or overpowering the linear terms. Second, it relies on the good coverage properties of Bayesian horseshoe regression [ 12 ] to produce credible intervals which can asymptotically be interpreted in the frequentist sense. A final contribution of RuleSHAP is the use of the widely used marginal Shapley values [ 13 ] [ 14 ] as a more accurate decomposition of prediction into its feature-specific

Read the complete text