A Stitch in Time Saves Nine: Proactive Self-Refinement for Language Models

Jinyi Han, Xinyi Wang, Haiquan Zhao, Tingyun li, Zishang Jiang, Sihang Jiang, Jiaqing Liang, Xin Lin, Weikang Zhou, Zeye Sun, Fei Yu, Yanghua Xiao · 2025

Read A Stitch in Time Saves Nine: Proactive Self-Refinement for Language Models by Jinyi Han, Xinyi Wang, Haiquan Zhao, Tingyun li, Zishang Jiang, Sihang Jiang, Jiaqing Liang, Xin Lin, Weikang Zhou, Zeye Sun, Fei Yu, Yanghua Xiao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12903.txt.

Description

Jinyi Han and co-authors teach language models to fix their own answers mid-stream, instead of writing the whole reply and patching it after. Their 2025 paper starts from the limits of standard self-refinement: a set number of reactive rounds, with no sense of when a fix is due or what it should touch. People, by contrast, revise as they go.

Their method lets the model decide whether, when, and how to refine, reading its own internal state and the growing context. Ten tasks tested the idea. On one mid-size model it cut token use by about 42 percent against plain generation while lifting accuracy by about eight points. The authors publish code and baselines, and frame early small fixes as the cheaper path.

Catalog record

CREATORJinyi Han, Xinyi Wang, Haiquan Zhao, Tingyun li, Zishang Jiang, Sihang Jiang, Jiaqing Liang, Xin Lin, Weikang Zhou, Zeye Sun, Fei Yu, Yanghua Xiao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12903

Browse the full library · About the Tower of Babel