A Positive Case for Faithfulness: LLM Self-Explanations Help Predict Model Behavior

Harry Mayne, Justin Singh Kang, Dewi Gould, Kannan Ramchandran, Adam Mahdi, Noah Y. Siegel · 2026

Read A Positive Case for Faithfulness: LLM Self-Explanations Help Predict Model Behavior by Harry Mayne, Justin Singh Kang, Dewi Gould, Kannan Ramchandran, Adam Mahdi, Noah Y. Siegel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02639.txt.

Description

Harry Mayne's 2026 paper, written with 5 co-authors, makes a positive case for trusting what language models say about their own reasoning. Self-explanations are often promoted for AI oversight, yet whether they truly reflect the model's process was poorly understood. Earlier metrics mostly hunted for unfaithfulness through adversarial prompts or reasoning errors.

The team introduces normalized simulatability gain, a metric built on a simple test. A faithful account should teach an observer the model's choice criteria well enough to predict its behavior on related inputs. Eighteen frontier models, proprietary and open, were tested on seven thousand counterfactual cases spanning health, business, and ethics. Self-explanations improved behavior prediction a great deal. They also beat explanations from external models, even stronger ones, implying a self-knowledge edge. A sobering minority proved highly misleading.

Catalog record

CREATORHarry Mayne, Justin Singh Kang, Dewi Gould, Kannan Ramchandran, Adam Mahdi, Noah Y. Siegel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE123 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02639

Browse the full library · About the Tower of Babel