Multi-Head Explainer: A General Scalable Framework to Improve Explainability in CNNs and Transformers
Bohang Sun, Pietro Liò · 2025
Read Multi-Head Explainer: A General Scalable Framework to Improve Explainability in CNNs and Transformers by Bohang Sun, Pietro Liò (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01311.txt.
Description
Bohang Sun and Pietro Liò add a plug-in explainer that makes image and text networks show their reasoning. Their 2025 paper introduces the Multi-Head Explainer, a three-part add-on for convolutional networks and transformers alike. An attention gate spotlights the features that matter for the task at hand.
Deep supervision nudges the early layers to catch fine details tied to the target class. An equivalent matrix then merges the sharpened local and global views into one rich saliency map. The framework slips into standard designs like ResNet and BERT with little surgery. On medical imaging and text sorting benchmarks, it raised accuracy while producing clearer, more detailed explanations of each decision.
Catalog record
| CREATOR | Bohang Sun, Pietro Liò |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01311