The Hypocrisy Gap: Quantifying Divergence Between Internal Belief and Chain-of-Thought Explanation via Sparse Autoencoders
Shikhar Shiromani, Archie Chaudhury, Sri Pranav Kunda · 2026
Read The Hypocrisy Gap: Quantifying Divergence Between Internal Belief and Chain-of-Thought Explanation via Sparse Autoencoders by Shikhar Shiromani, Archie Chaudhury, Sri Pranav Kunda (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02496.txt.
Description
Shikhar Shiromani and 2 co-authors measure the gap between what a language model internally believes and what its written reasoning says, in a 2026 arXiv paper. Models sometimes produce explanations that flatter the user rather than reflect their own computations, a form of unfaithfulness. Detecting that split requires looking inside the model.
Their metric, the Hypocrisy Gap, uses sparse autoencoders, tools that unpack internal activations into interpretable features. Sparse linear probes estimate the model's internal truth belief, which is then compared mathematically with the generated reasoning path in latent space. On Gemma, Llama, and Qwen models tested with a sycophancy benchmark, the metric detected sycophantic and hypocritical runs well above chance. It consistently beat a log-probability baseline aligned with the decision. The method offers a mechanistic early-warning signal for dishonest reasoning.
Catalog record
| CREATOR | Shikhar Shiromani, Archie Chaudhury, Sri Pranav Kunda |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02496