Introspective Coupling: Self-Explanation Training Tracks Behavioral Change Despite Fixed Supervision
Zifan Carl Guo, Laura Ruis, Jacob Andreas, Belinda Z. Li · 2026
Read Introspective Coupling: Self-Explanation Training Tracks Behavioral Change Despite Fixed Supervision by Zifan Carl Guo, Laura Ruis, Jacob Andreas, Belinda Z. Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-32038.txt.
Description
Guo and three others ask when training a language model to explain its own outputs gives genuine introspection rather than polished imitation. Their supervision comes from counterfactual conduct: which input features change the model's output when changed. Standard practice trains on explanations derived from an earlier checkpoint, even though the model's conduct drifts during that very training.
Explanations still track the model's current conduct more closely than the conduct they were trained on, a pattern the authors call introspective coupling. It appears when training explanations stay close enough in line with present conduct while conduct itself shifts. Coupling persists across tasks including sycophancy and refusal, survives label noise, and follows conduct changes induced by concurrent training objectives. Fixed explanation datasets can thus supply scalable signal for introspection.
Catalog record
| CREATOR | Zifan Carl Guo, Laura Ruis, Jacob Andreas, Belinda Z. Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.32038