LLM-Independent Adaptive RAG: Let the Question Speak for Itself

Maria Marina, Nikolay Ivanov, Sergey Pletenev, Mikhail Salnikov, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii · 2025

Read LLM-Independent Adaptive RAG: Let the Question Speak for Itself by Maria Marina, Nikolay Ivanov, Sergey Pletenev, Mikhail Salnikov, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-04253.txt.

Introduction

Maria Marina and co-authors propose in 2025 a cheap way to decide when a language model should bother fetching outside facts before answering. Fetching documents curbs made up answers but costs heavy compute and can import falsehoods, so fetching only when needed is the prize. Past need detectors ask the model itself how unsure it is, which is slow and awkward in practice.

Their methods skip the model entirely and read the question alone. They tested dozens of outside features, grouped in families, covering matters like the question's wording and topic signals, plus blends of them. Across six question answering data sets, the light methods matched the heavy model based ones on answer quality while running far cheaper. The result hints that a question's own surface carries enough signal to route it well.

Catalog record

CREATORMaria Marina, Nikolay Ivanov, Sergey Pletenev, Mikhail Salnikov, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-04253

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLM-Independent Adaptive RAG: Let the Question Speak for Itself Maria Marina, Nikolay Ivanov, Sergey Pletenev, Mikhail Salnikov, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii Abstract Large Language Models (LLMs) are prone to hallucinations, and Retrieval-Augmented Generation (RAG) helps mitigate this, but at a high computational cost while risking misinformation. Adaptive retrieval aims to retrieve only when necessary, but existing approaches rely on LLM-based uncertainty estimation, which remain inefficient and impractical. In this study, we introduce lightweight LLM-independent adaptive retrieval methods based on external information. We investigated 27 features, organized into 7 groups, and their hybrid combinations. We evaluated these methods on 6 QA datasets, assessing the QA performance and efficiency. The results show that our approach matches the performance of complex LLM-based methods while achieving significant efficiency gains, demonstrating the potential of external information for adaptive retrieval. \Exlabelwidth 1 Introduction Large Language Models (LLMs) excel in tasks like question answering (QA) Yang et al. 2018 ; Kwiatkowski et al. 2019 , but remain vulnerable to hallucinations Yin et al. 2024 ; Ding et al. 2024 . Retrieval-Augmented Generation (RAG) Lewis et al. 2020 mitigates this by incorporating external information, although it introduces risks such as error accumulation Shi et al. 2023 and external hallucinations Ding et al. 2024 . Adaptive retrieval techniques Moskvoretskii et al. 2025 ; Ding et al. 2024 ; Jeong et al. 2024 aim to balance LLM knowledge with external resources by estimating uncertainty to decide whether retrieval is needed. However, existing methods primarily frame this task as uncertainty estimation based on LLM internal states or outputs, leading to significant computational overhead. This can offset the efficiency gains from reduced retrieval calls and limit practicality, especially with larger models. In this study, we address this issue by introducing LLM-independent adaptive retrieval methods that leverage external information, such as entity popularity and question type. Our methods achieve comparable quality while being significantly more efficient, eliminating the need for LLMs entirely. Our evaluation, shown in Figure 1 , shows that our proposed features are much more efficient in terms of PFLOPs and LLM calls, with downstream performance comparable to other adaptive retrieval methods. Figure 1: PFLOPs-Inaccuracy trade-off for proposed features vs the most efficient alternative adaptive retrieval methods for the NQ dataset. Radius of the points is proportional to the number of LLM calls. Green dotted line indicate Always RAG approach. Our contributions and findings are as follows: 1. We introduce 7 groups of lightweight external information features, encompassing 27 features, for LLM-independent adaptive retrieval. 2. Our approach significantly improves efficiency by eliminating the need for LLM-based uncertainty estimation while maintaining QA performance. 3. We show that our methods outperform uncertainty-based adaptive retrieval methods for complex questions. We make data and all models publicly available. 1 1 1 https://github.com/marialysyuk/External_Adaptive_Retrieval 2 Related Work Adaptive Retrieval-Augmented Generation reduces unnecessary retrievals by determining whether external knowledge is needed. This decision can be based on LLM output Trivedi et al. 2023 , consistency checks Ding et al. 2024 , internal uncertainty signals Jiang et al. 2023 ; Su et al. 2024 ; Yao et al. 2024 , or trained classifiers Jeong et al. 2024 . External Information methods can enhance retrieval, such as integrating knowledge graphs and the popularity of the entity. KG structures have been incorporated into LLM decoding to enable reasoning on graphs for more reliable answers Luo et al. 2024 . Popularity and graph frequency improve retrieval efficiency, as shown in LightRAG and MiniRAG, which prioritize frequently accessed entities and relationships Guo et al. 2024 ; Fan et al. 2025 . Graph-based features, including entity properties Lysyuk et al. 2024 , popularity Mallen et al. 2023a , and structural attributes Salnikov et al. 2023 , have also been shown to be effective in QA systems. 3 Methods Our baselines include the following adaptive retrieval methods: Adaptive RAG uses a T5-large-based classifier to determine whether retrieval is needed Jeong et al. 2024 . FLARE triggers retrieval when token probability falls below a threshold Jiang et al. 2023 . DRAGIN estimates uncertainty based on token probabilities and attention weights, excluding stopwords Su et al. 2024 . Rowen relies on consistency checks across languages and models to trigger retrieval Ding et al. 2024 . SeaKR monitors internal state consistency to trigger retrieval, re-ranking snippets to reduce uncertainty Yao et al. 2024 . EigValLaplacian assesses uncertainty using graph features based on pairwise consistency scores Lin et al. 2023 . Max Token Entropy measures uncertainty by aggregating the maximum entropy of token distributions Fomicheva et al. 2020 . Hybrid UE includes 5 uncertainty features relevant to the task Moskvoretskii et al. 2025 : Mean Token Entropy, Max Token Entropy, SAR, EigValLaplacian, Lex-Similarity. 3.1 External Information Methods In this section, we describe the proposed external information methods for adaptive retrieval. Each group may contain multiple features used to train a classifier to predict retrieval needs, following Moskvoretskii et al. 2025 ; Jeong et al. 2024 . Graph features capture information about the entities in question from a knowledge graph, including the minimum, maximum, and mean number of triples per subject and object, where the subject or object corresponds to an entity from the question. Popularity features include the minimum, maximum, and mean number of Wikipedia page views per entity in the question. Frequency features include the minimum, maximum and mean frequencies of entities in a reference text collection 2 2 2 https://www.inf.uni-hamburg.de/en/inst/ab/lt/resources/data/depcc.html , along with the frequency of the least common n-gram in the question. Method NQ SQuAD TQA 2Wiki HotPot Musique InAcc \uparrow LMC \downarrow RC \downarrow InAcc \uparrow LMC \downarrow RC \downarrow InAcc \uparrow LMC \downarrow RC \downarrow InAcc \uparrow LMC \downarrow RC \downarrow InAcc \uparrow LMC \downarrow RC \downarrow InAcc \uparrow LMC \downarrow RC \downarrow Never RAG 44.6 1.0 0.00 17.6 1.0 0.00 63.6 1.0 0.00 31.8 1.0 0.00 28.6 1.0 0.00 10.6 1.0 0.00 Always RAG 49.6 1.0 1.00 31.2 1.0 1.00 61.0 1.0 1.00 37.4 1.0 1.00 41.0 1.0 1.00 10.0 1.0 1.00 Multi-Step Adaptive Retrieval AdaptiveRAG 49.6 2.0 0.98 28.6 2.0 0.97 62.8 1.5 0.54 45.4 5.2 2.64 41.4 4.6 2.34 14.0 3.6 3.63 DRAGIN 48.0 4.5 2.24 29.8 4.3 2.14 66.6 4.1 2.06 45.6 5.8 2.92 43.0 5.1 2.56 13.4 6.3 3.15 FLARE 45.0 3.1 2.07 23.8 3.1 2.08 64.8 2.1 1.39 42.4 3.9 2.85 37.2 5.1 4.07 9.0 4.1 3.10 Rowen CM 49.4 29.5 7.27 19.6 29.2 7.20 65.6 28.7 7.12 44.4 32.9 7.87 35.6 31.9 7.70 10.4 42.1 9.52 Seakr 40.6 14.6 1.00 26.8 14.6 1.00 65.6 14.6 1.00 39.8 12.3 2.44 42.4 9.9 1.76 11.8 12.3 2.40 Uncertainty Estimation EigValLaplacian 51.2 1.8 0.81 31.4 2.0 0.10 64.0 1.3 0.26 38.4 2.0 0.98 41.0 1.9 0.91 10.2 2.0 1.00 MaxTokenEntropy 50.6 1.7 0.58 31.2 2.0 0.10 65.0 1.2 0.22 37.6 2.0 0.95 41.4 2.0 0.99 10.6 2.0 0.87 Hybrid UE 50.2 1.7 0.77 31.4 2.0 0.98 63.8 1.3 0.27 37.4 2.0 0.98 41.2 1.9 0.94 10.6 1.8 0.75 External Features Graph 49.0 1.0 0.87 30.4 1.0 0.95 63.6 1.0 0.32 35.8 1.0 0.67 40.8 1.0 0.97 10.0 1.0 1.00 Popularity 49.8 1.0 0.92 31.2 1.0 1.00 63.2 1.0 0.15 35.6 1.0 0.84 41.0 1.0 0.94 10.0 1.0 0.96 Frequency 49.8 1.0 0.96 31.0 1.0

Read the complete text