Decoding the Critique Mechanism in Large Reasoning Models
Hoang Phan, Quang H. Nguyen, Hung T. Q. Le, Xiusi Chen, Heng Ji, Khoa D. Doan · 2026
Read Decoding the Critique Mechanism in Large Reasoning Models by Hoang Phan, Quang H. Nguyen, Hung T. Q. Le, Xiusi Chen, Heng Ji, Khoa D. Doan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16331.txt.
Description
Phan and co-authors study how large reasoning models recover from their own mistakes. The team plants arithmetic errors inside a model's reasoning steps. Oddly, the model often still lands on the right answer. No spoken correction appears in the chain of thought. The authors trace this to a hidden critique ability. They isolate a critique vector in the model's feature space. Steering with that vector sharpened error detection and test-time scaling.
Catalog record
| CREATOR | Hoang Phan, Quang H. Nguyen, Hung T. Q. Le, Xiusi Chen, Heng Ji, Khoa D. Doan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62413 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16331