Diverse Concept Proposals for Concept Bottleneck Models

Katrina Brown, Marton Havasi, Finale Doshi-Velez · 2024

Read Diverse Concept Proposals for Concept Bottleneck Models by Katrina Brown, Marton Havasi, Finale Doshi-Velez (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-18059.txt.

Description

Katrina Brown and co-authors fix a trust problem in interpretable machine learning by refusing to offer experts only one explanation. Their 2024 paper works with concept bottleneck models, which predict through a small set of human-readable concepts. If the learned concepts clash with expert intuition, the model's interpretability promise collapses with no fallback.

Their method proposes multiple diverse concept sets that each explain the data well. The expert then picks the explanation that matches their understanding, restoring a human veto without abandoning accuracy. On synthetic data the method recovered every possible concept representation. On electronic health records it found four of five predefined concepts with no supervision. The shift is philosophical as much as technical: instead of the model dictating its reasoning, it presents a menu of honest reasonings. In high-trust domains like medicine, that choice may decide whether interpretable models get used at all.

Catalog record

CREATORKatrina Brown, Marton Havasi, Finale Doshi-Velez
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-18059

Browse the full library · About the Tower of Babel