Structure Enables Effective Self-Localization of Errors in LLMs

Ankur Samanta, Akshayaa Magesh, Ayush Jain, Kavosh Asadi, Youliang Yu, Daniel Jiang, Boris Vidolov, Kaveh Hassani, Paul Sajda, Jalaj Bhandari, Yonathan Efroni · 2026

Read Structure Enables Effective Self-Localization of Errors in LLMs by Ankur Samanta, Akshayaa Magesh, Ayush Jain, Kavosh Asadi, Youliang Yu, Daniel Jiang, Boris Vidolov, Kaveh Hassani, Paul Sajda, Jalaj Bhandari, Yonathan Efroni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02416.txt.

Description

Ankur Samanta and 10 co-authors show that giving language model reasoning a clear structure helps the model find its own mistakes, in a 2026 arXiv paper. Self-correction has stayed elusive: models asked to fix free-form chains of thought rarely locate the exact step that went wrong.

Their prompting method breaks reasoning into discrete, complete thoughts, each treated as one deliberate decision. When a checker flags the answer as wrong, the model identifies the first faulty thought and backtracks to the last correct point. New reasoning then branches from there. This iterative sampling raised self-correction by twenty to forty percent when an oracle supplied the verdict. Even fully autonomously, with no external checker, it beat contemporary self-correction baselines. Structure, the authors argue, turns vague doubt into a precise location.

Catalog record

CREATORAnkur Samanta, Akshayaa Magesh, Ayush Jain, Kavosh Asadi, Youliang Yu, Daniel Jiang, Boris Vidolov, Kaveh Hassani, Paul Sajda, Jalaj Bhandari, Yonathan Efroni
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02416

Browse the full library · About the Tower of Babel