FrugalRAG: Learning to retrieve and reason for multi-hop QA

Abhinav Java, Srivathsan Koundinyan, Nagarajan Natarajan, Amit Sharma · 2025

Read FrugalRAG: Learning to retrieve and reason for multi-hop QA by Abhinav Java, Srivathsan Koundinyan, Nagarajan Natarajan, Amit Sharma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07634.txt.

Description

Abhinav Java and co-authors teach small language models to answer hard questions with fewer web searches. Multi-hop questions need several rounds of retrieval, and standard reinforcement learning had gained little there. Their system, FrugalRAG, treats thrift as a skill: search wide at first, then learn when to stop.

Stage one trains the model on a full-exploration style that fires broad sub-queries. Stage two uses reinforcement learning to prune the search depth by question difficulty, paying for right answers reached cheaply. With only about a thousand training examples, the method matched far hungrier rivals. On HotPotQA it cut retrieval cost nearly in half. It also transferred, untrained, to a tough browsing benchmark and beat the other small models.

Catalog record

CREATORAbhinav Java, Srivathsan Koundinyan, Nagarajan Natarajan, Amit Sharma
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-07634

Browse the full library · About the Tower of Babel