Search and Refine During Think: Autonomous Retrieval - Augmented Reasoning of LLMs

Yaorui Shi, Sihang Li, Chang Wu, Zhiyuan Liu, Junfeng Fang, Hengxing Cai, An Zhang, Xiang Wang, [3mm] University of Science, Technology of China · 2025

Read Search and Refine During Think: Autonomous Retrieval - Augmented Reasoning of LLMs by Yaorui Shi, Sihang Li, Chang Wu, Zhiyuan Liu, Junfeng Fang, Hengxing Cai, An Zhang, Xiang Wang, [3mm] University of Science, Technology of China (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11277.txt.

Description

Language models that refine what they retrieve reason better, Yaorui Shi and co-authors show in a 2025 paper. The head title names their paradigm search and refine during think. Models are limited by their built-in knowledge, and retrieval can help, but retrieved text is often irrelevant or noisy, which hinders accurate reasoning on hard questions.

Their framework, AutoRefine, is a reinforcement learning post-training method. It adds explicit knowledge refinement steps between successive search calls. The model iteratively filters, distills, and organizes evidence before it answers. Rewards cover both retrieval quality and answer correctness, trained with group relative policy optimization. Experiments on single-hop and multi-hop question answering show gains. Catalog and head author lists agree in substance, with team framing used here.

Catalog record

CREATORYaorui Shi, Sihang Li, Chang Wu, Zhiyuan Liu, Junfeng Fang, Hengxing Cai, An Zhang, Xiang Wang, [3mm] University of Science, Technology of China
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-11277

Browse the full library · About the Tower of Babel