Conditional Feature Importance with Generative Modeling Using Adversarial Random Forests

Kristin Blesch, Niklas Koenen, Jan Kapar, Pegah Golchian, Lukas Burk, Markus Loecher, Marvin N. Wright · 2025

Read Conditional Feature Importance with Generative Modeling Using Adversarial Random Forests by Kristin Blesch, Niklas Koenen, Jan Kapar, Pegah Golchian, Lukas Burk, Markus Loecher, Marvin N. Wright (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11178.txt.

Description

Kristin Blesch and co-authors propose a method called cARFi for measuring how much one feature matters for a model's predictions once other features are already known. Such conditional checks need fresh feature values that respect the joint pattern of the data, which is hard to make by hand. Adversarial random forests can generate such on-manifold values for mixed table data with little tuning.

The method samples replacement values from those learned conditional distributions and watches how model performance moves. It needs little tuning for steady scores, can switch between conditional and marginal views, and can condition on sets of features. Statistical tests for the scores are also built in.

Catalog record

CREATORKristin Blesch, Niklas Koenen, Jan Kapar, Pegah Golchian, Lukas Burk, Markus Loecher, Marvin N. Wright
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11178

Browse the full library · About the Tower of Babel