Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations
Katie Matton, Robert Osazuwa Ness, John Guttag, Emre Kıcıman · 2025
Read Walk the Talk? Measuring the Faithfulness of Large Language Model Explanations by Katie Matton, Robert Osazuwa Ness, John Guttag, Emre Kıcıman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14150.txt.
Introduction
Katie Matton and three co-authors test whether AI explanations tell the truth in a 2025 paper. Large language models often explain how they reached an answer. Those stories can sound right while hiding what truly drove the reply. Users may then trust the model more than they should.
The team first gives a strict definition of a faithful explanation. They then build a test that edits key concepts in a question. An assistant model makes those edits realistic. A statistical model measures which concepts truly move the answer. On a bias task, explanations hid the pull of social bias. On medical questions, some explanations named the wrong evidence. The method can audit chatbots before people rely on them.
Catalog record
| CREATOR | Katie Matton, Robert Osazuwa Ness, John Guttag, Emre Kıcıman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 211 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-14150