From Pixels to Perception: Interpretable Predictions via Instance-wise Grouped Feature Selection

Moritz Vandenhirtz, Julia E. Vogt · 2025

Read From Pixels to Perception: Interpretable Predictions via Instance-wise Grouped Feature Selection by Moritz Vandenhirtz, Julia E. Vogt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06003.txt.

Description

Moritz Vandenhirtz and Julia Vogt build image classifiers that explain themselves by showing only the pixels they used. Their 2025 paper pursues inherent interpretability: instead of explaining a black box afterward, the model must mask each image down to a small set of regions before deciding. The mask works on meaningful parts, not single pixels, so the kept evidence reads the way humans see.

A dynamic rule decides how much of each image may stay visible, tightening the mask for easy cases and loosening it for hard ones. On semi-synthetic and natural image data, the classifier's choices proved more understandable than those of leading post-hoc explanation methods. The authors argue such self-explaining models ease failure analysis in high-stakes image tasks.

Catalog record

CREATORMoritz Vandenhirtz, Julia E. Vogt
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06003

Browse the full library · About the Tower of Babel