Decoding the Critique Mechanism in Large Reasoning Models

Hoang Phan, Quang H. Nguyen, Hung T. Q. Le, Xiusi Chen, Heng Ji, Khoa D. Doan · 2026

Read Decoding the Critique Mechanism in Large Reasoning Models by Hoang Phan, Quang H. Nguyen, Hung T. Q. Le, Xiusi Chen, Heng Ji, Khoa D. Doan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16331.txt.

Description

Phan and co-authors study how large reasoning models recover from their own mistakes. The team plants arithmetic errors inside a model's reasoning steps. Oddly, the model often still lands on the right answer. No spoken correction appears in the chain of thought. The authors trace this to a hidden critique ability. They isolate a critique vector in the model's feature space. Steering with that vector sharpened error detection and test-time scaling.

Catalog record

CREATORHoang Phan, Quang H. Nguyen, Hung T. Q. Le, Xiusi Chen, Heng Ji, Khoa D. Doan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62413
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16331

Browse the full library · About the Tower of Babel