DeepRAG: Thinking to Retrieve Step by Step for Large Language Models

Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou · 2025

Read DeepRAG: Thinking to Retrieve Step by Step for Large Language Models by Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01142.txt.

Description

Xinyan Guan and co-authors present a 2025 paper on making language models fetch facts step by step. Models hallucinate when their built-in knowledge is stale or thin. Retrieval helps, but bolting it onto reasoning often decomposes questions badly and fetches noise.

Their framework, DeepRAG, treats the process as a Markov decision process. The model breaks the question into sub-queries one at a time. At each step it decides whether to search or to reason from what it already holds. That adaptivity trims redundant retrieval and the noise it brings. Experiments showed improved retrieval efficiency and a 26.4 percent boost in answer accuracy. The authors offer the method as a cleaner pattern for grounded reasoning.

Catalog record

CREATORXinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-01142

Browse the full library · About the Tower of Babel