Multi-Head Explainer: A General Scalable Framework to Improve Explainability in CNNs and Transformers

Bohang Sun, Pietro Liò · 2025

Read Multi-Head Explainer: A General Scalable Framework to Improve Explainability in CNNs and Transformers by Bohang Sun, Pietro Liò (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01311.txt.

Description

Bohang Sun and Pietro Liò add a plug-in explainer that makes image and text networks show their reasoning. Their 2025 paper introduces the Multi-Head Explainer, a three-part add-on for convolutional networks and transformers alike. An attention gate spotlights the features that matter for the task at hand.

Deep supervision nudges the early layers to catch fine details tied to the target class. An equivalent matrix then merges the sharpened local and global views into one rich saliency map. The framework slips into standard designs like ResNet and BERT with little surgery. On medical imaging and text sorting benchmarks, it raised accuracy while producing clearer, more detailed explanations of each decision.

Catalog record

CREATORBohang Sun, Pietro Liò
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-01311

Browse the full library · About the Tower of Babel