DeepRAG: Thinking to Retrieve Step by Step for Large Language Models
Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou · 2025
Read DeepRAG: Thinking to Retrieve Step by Step for Large Language Models by Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01142.txt.
Description
Xinyan Guan and co-authors present a 2025 paper on making language models fetch facts step by step. Models hallucinate when their built-in knowledge is stale or thin. Retrieval helps, but bolting it onto reasoning often decomposes questions badly and fetches noise.
Their framework, DeepRAG, treats the process as a Markov decision process. The model breaks the question into sub-queries one at a time. At each step it decides whether to search or to reason from what it already holds. That adaptivity trims redundant retrieval and the noise it brings. Experiments showed improved retrieval efficiency and a 26.4 percent boost in answer accuracy. The authors offer the method as a cleaner pattern for grounded reasoning.
Catalog record
| CREATOR | Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-01142