Hierarchical Concept-based Interpretable Models

Oscar Hill, Mateo Espinosa Zarlenga, Mateja Jamnik · 2026

Read Hierarchical Concept-based Interpretable Models by Oscar Hill, Mateo Espinosa Zarlenga, Mateja Jamnik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23947.txt.

Description

Oscar Hill and two co-authors introduce hierarchical concept embedding models, a family of interpretable neural models that organize concepts in layers. The 2026 paper notes that concept embedding models map inputs to human-readable concepts before predicting, yet they ignore relations between concepts and demand annotations at every granularity during training.

The new models, HiCEMs, explicitly represent concept hierarchies, so explanations can move between coarse and fine levels. A method called Concept Splitting discovers finer sub-concepts automatically from a pretrained model's embedding space, without new annotations, letting HiCEMs give detailed explanations from limited labels. Tests across datasets, including a user study and a new kitchen-render dataset, show that split sub-concepts are human-interpretable and train accurate models. They support test-time interventions at several granularities, aiding debugging and debiasing.

Catalog record

CREATOROscar Hill, Mateo Espinosa Zarlenga, Mateja Jamnik
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23947

Browse the full library · About the Tower of Babel