Search and Refine During Think: Autonomous Retrieval - Augmented Reasoning of LLMs
Yaorui Shi, Sihang Li, Chang Wu, Zhiyuan Liu, Junfeng Fang, Hengxing Cai, An Zhang, Xiang Wang, [3mm] University of Science, Technology of China · 2025
Read Search and Refine During Think: Autonomous Retrieval - Augmented Reasoning of LLMs by Yaorui Shi, Sihang Li, Chang Wu, Zhiyuan Liu, Junfeng Fang, Hengxing Cai, An Zhang, Xiang Wang, [3mm] University of Science, Technology of China (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11277.txt.
Description
Language models that refine what they retrieve reason better, Yaorui Shi and co-authors show in a 2025 paper. The head title names their paradigm search and refine during think. Models are limited by their built-in knowledge, and retrieval can help, but retrieved text is often irrelevant or noisy, which hinders accurate reasoning on hard questions.
Their framework, AutoRefine, is a reinforcement learning post-training method. It adds explicit knowledge refinement steps between successive search calls. The model iteratively filters, distills, and organizes evidence before it answers. Rewards cover both retrieval quality and answer correctness, trained with group relative policy optimization. Experiments on single-hop and multi-hop question answering show gains. Catalog and head author lists agree in substance, with team framing used here.
Catalog record
| CREATOR | Yaorui Shi, Sihang Li, Chang Wu, Zhiyuan Liu, Junfeng Fang, Hengxing Cai, An Zhang, Xiang Wang, [3mm] University of Science, Technology of China |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11277