Test-time Corpus Feedback: From Retrieval to RAG

Mandeep Rathee, Venktesh V, Sean MacAvaney, Avishek Anand · 2025

Read Test-time Corpus Feedback: From Retrieval to RAG by Mandeep Rathee, Venktesh V, Sean MacAvaney, Avishek Anand (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15437.txt.

Introduction

Mandeep Rathee and co-authors survey feedback methods for retrieval-augmented generation in a 2025 paper. Such systems pair a language model with document search to answer knowledge-heavy questions. Most pipelines search once and then write, with no loop back, which limits hard or precise tasks.

New methods let the search step react to feedback and refine the query, the context, or the document pool. The survey sorts these signals by source and role, joining views from search research and language research. Seeing retrieval as a dynamic partner, not a fixed first step, is the core shift. The map should help builders design stronger systems.

Catalog record

CREATORMandeep Rathee, Venktesh V, Sean MacAvaney, Avishek Anand
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15437

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Test-time Corpus Feedback: From Retrieval to RAG Mandeep Rathee, Venktesh V, Sean MacAvaney, Avishek Anand Abstract Retrieval-Augmented Generation (RAG) has emerged as a standard framework for knowledge-intensive NLP tasks, combining large language models (LLMs) with document retrieval from external corpora. Despite its widespread use, most RAG pipelines continue to treat retrieval and reasoning as isolated components—retrieving documents once and then generating answers without further interaction. This static design often limits performance on complex tasks that require iterative evidence gathering or high-precision retrieval. Recent work in both the information retrieval (IR) and NLP communities has begun to close this gap by introducing adaptive retrieval and ranking methods that incorporate feedback. In this survey, we present a structured overview of advanced retrieval and ranking mechanisms that integrate such feedback. We categorize feedback signals based on their source and role in improving the query, retrieved context, or document pool. By consolidating these developments, we aim to bridge IR and NLP perspectives and highlight retrieval as a dynamic, learnable component of end-to-end RAG systems. 1 Introduction Large language models (LLMs) augmented with retrieval have become a dominant paradigm for knowledge-intensive NLP tasks. In a typical retrieval-augmented generation (RAG) setup, an LLM retrieves documents from an external corpus and conditions generation on the retrieved evidence Lewis et al. 2020b ; Izacard and Grave 2021 . This setup mitigates a key weakness of LLMs—hallucination—by grounding generation in externally sourced knowledge. RAG systems now power open-domain QA Karpukhin et al. 2020 , fact verification V et al. 2024 ; Schlichtkrull et al. 2023 , knowledge-grounded dialogue, and explanatory QA. Despite their widespread use, many RAG systems rely on static, off-the-shelf retrieval modules—e.g., BM25 Robertson et al. 1995 or dense dual encoders Karpukhin et al. 2020 —that are minimally adapted to the downstream task or domain. While re-rankers Nogueira et al. 2020 ; Pradeep et al. 2023b can improve ranking precision, the underlying retrieval often remains brittle in scenarios that demand complex reasoning: multi-hop QA, claim verification, procedural queries, or dialogue-based question answering. These tasks frequently require iterative lookups, query decomposition, or high-precision evidence—capabilities that static retrieval pipelines lack. In contrast to the prevailing view of retrieval as a fixed first step, a growing body of work in the IR community treats retrieval as a feedback-driven, adaptive process —where signals from the output stage is used to guide when to retrieve, how to reformulate queries, and which evidence to include. Definition In this survey, we define feedback in RAGs as any signal—derived from the corpus at different levels – retrieval, ranking, or generation components. This feedback is used to improve the query, the context used for generation, or the set of retrieved documents. We note that such feedback may be applied in one or multiple rounds and can originate from internal model signals (e.g., uncertainty or confidence), external modules (e.g., rankers or verifiers), or user behavior (e.g., clicks or clarifications). Our notion of corpus feedback or simply feedback arises at three key stages: 1. Query-level feedback , where the input query is rewritten, expanded, or decomposed using model introspection or relevance signals (refer Section 3 ); 2. Retrieval-level feedback , where rankers or corpus structure are used to revise or expand the document pool across rounds (refer Section 4 ); 3. Generation-time feedback , where confidence, or verifier critiques trigger new retrievals or corrections (refer Section 5 ). Figure 1 shows an overview of these feedback stages. This survey synthesizes recent work that operationalizes these feedback signals across RAG pipelines. We organize methods by where and how feedback is applied – not by architecture or dataset –emphasizing how feedback improves retrieval adaptively rather than statically. Our scope is deliberately focused on retrieval-centric innovations in RAG. We do not cover standalone prompting or answer-generation strategies unless they directly influence the retrieval component. Our goal is to help NLP researchers treat retrieval as a dynamic, learnable component—just as vital as the generator—especially in tasks that require reasoning over incomplete, multi-part, or contextual knowledge. We also review the experimental landscape for retrieval-centric RAG in Section 6 : common benchmarks, evaluation metrics, and emerging standards for assessing retriever quality in knowledge-intensive tasks. By consolidating these developments, this survey attempts to bridge the gap between information retrieval and NLP communities, highlighting how feedback can drive the next generation of retrieval-aware, reasoning-capable RAG systems. Figure 1: Illustration of feedback signals across the RAG pipeline. Feedback can modify the query (e.g., rewriting), the retrieved pool (e.g., ranker-based expansion), or the generation loop (e.g., retrieval triggers based on uncertainty). 2 Preliminaries 2.1 Retrieval System The core objective of a retrieval system is to identify and rank a subset of documents (d_{1},d_{2},...,d_{k}) from a large corpus \mathcal{C} based on their estimated relevance to a query q . Classical retrieval approaches, such as BM25 Robertson et al. 1995 , rely on exact term matching and produce sparse relevance scores. In contrast, dense retrieval methods employ neural encoders to project queries and documents into a shared embedding space, enabling semantic similarity matching Karpukhin et al. 2020 . Since first-stage retrievers often produce noisy candidates, modern pipelines incorporate a second-stage re-ranking step using more expressive models. This includes LLM-based rankers Pradeep et al. 2023b ; Ma et al. 2024 ; Sun et al. 2023 and reasoning-augmented models such as ReasonIR Shao et al. 2025 , Rank-1 Weller et al. 2025 , and Rank-R1 Zhuang et al. 2025 , which refine the initial rankings by modeling deeper interactions between the query and candidate documents. 2.2 Retrieval-Augmented Generation Retrieval-Augmented Generation (RAG) Lewis et al. 2020b is a hybrid paradigm that enhances the generative capabilities of large language models (LLMs) by incorporating non-parametric external knowledge during inference. This design mitigates well-documented limitations of standalone LLMs, including hallucinations, confident but incorrect outputs, and inability to reflect up-to-date or domain-specific information due to static pretraining Hurst et al. 2024 ; Grattafiori et al. 2024 ; Yang et al. 2025a . RAG introduces an explicit retrieval step: for a query q , a retriever selects a set of top- k documents \{d_{1},\dots,d_{k}\} from an external corpus. A generator G then conditions on both q and the retrieved context to produce the output a=G(q,d_{1},\dots,d_{k}) where G is typically an encoder-decoder or decoder-only LLM fine-tuned to integrate retrieved evidence into its generation process. 2.3 Challenges in RAG A central challenge in RAG is that generation quality is tightly coupled with retrieval quality. If relevant (i.e., answer-containing) documents are not retrieved, or if irrelevant context is included, the generator is prone to producing incorrect or misleading outputs Cuconasu et al. 2024 ; Cuconasu et al. 2025 ; Liu et al. 2024 . Consequently, improving the top- k retrieval results is crucial. This can be viewed both as a selection problem (how to retrieve the most relevant documents) and a filtering problem (how to suppress distracting or noisy context). To this end, several methods have been proposed that incorporate various forms of feedback , ranging from simple lexical overlap to more sophisticated agentic or reasoning-based signals, to guide and refine the retrieval process. In this survey, we systematically categorize these feedback mechanisms and analyze their effectiveness across different components of the RAG pipeline. We focus on how feedback is acquired,

Read the complete text