Mapping Faithful Reasoning in Language Models
Jiazheng Li, Andreas Damianou, J Rosser, José Luis Redondo García, Konstantina Palla · 2025
Read Mapping Faithful Reasoning in Language Models by Jiazheng Li, Andreas Damianou, J Rosser, José Luis Redondo García, Konstantina Palla (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22362.txt.
Description
Jiazheng Li and four co-authors, Andreas Damianou, J Rosser, José Luis Redondo García. Konstantina Palla, check whether a reasoning model's written chain of thought is the real story or decoration. Prior work has shown the traces do not always mirror the computation, which is a problem for anyone overseeing models by reading their reasoning.
Their framework, Concept Walk, works inside the model instead of on its text. It learns a direction in activation space corresponding to a concept from contrastive examples, then projects every reasoning step onto that direction to watch the model's stance evolve. In a safety case study on a mid-sized open model, easy cases shrugged off tampered chains of thought almost immediately, marking that reasoning as decorative. Hard cases absorbed the tampering into lasting activation shifts, the signature of reasoning the model actually uses.
Catalog record
| CREATOR | Jiazheng Li, Andreas Damianou, J Rosser, José Luis Redondo García, Konstantina Palla |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22362