FrugalRAG: Learning to retrieve and reason for multi-hop QA
Abhinav Java, Srivathsan Koundinyan, Nagarajan Natarajan, Amit Sharma · 2025
Read FrugalRAG: Learning to retrieve and reason for multi-hop QA by Abhinav Java, Srivathsan Koundinyan, Nagarajan Natarajan, Amit Sharma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07634.txt.
Description
Abhinav Java and co-authors teach small language models to answer hard questions with fewer web searches. Multi-hop questions need several rounds of retrieval, and standard reinforcement learning had gained little there. Their system, FrugalRAG, treats thrift as a skill: search wide at first, then learn when to stop.
Stage one trains the model on a full-exploration style that fires broad sub-queries. Stage two uses reinforcement learning to prune the search depth by question difficulty, paying for right answers reached cheaply. With only about a thousand training examples, the method matched far hungrier rivals. On HotPotQA it cut retrieval cost nearly in half. It also transferred, untrained, to a tough browsing benchmark and beat the other small models.
Catalog record
| CREATOR | Abhinav Java, Srivathsan Koundinyan, Nagarajan Natarajan, Amit Sharma |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-07634