From Pixels to Perception: Interpretable Predictions via Instance-wise Grouped Feature Selection
Moritz Vandenhirtz, Julia E. Vogt · 2025
Read From Pixels to Perception: Interpretable Predictions via Instance-wise Grouped Feature Selection by Moritz Vandenhirtz, Julia E. Vogt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06003.txt.
Description
Moritz Vandenhirtz and Julia Vogt build image classifiers that explain themselves by showing only the pixels they used. Their 2025 paper pursues inherent interpretability: instead of explaining a black box afterward, the model must mask each image down to a small set of regions before deciding. The mask works on meaningful parts, not single pixels, so the kept evidence reads the way humans see.
A dynamic rule decides how much of each image may stay visible, tightening the mask for easy cases and loosening it for hard ones. On semi-synthetic and natural image data, the classifier's choices proved more understandable than those of leading post-hoc explanation methods. The authors argue such self-explaining models ease failure analysis in high-stakes image tasks.
Catalog record
| CREATOR | Moritz Vandenhirtz, Julia E. Vogt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-06003