Memory-Aware and Uncertainty-Guided Retrieval for Multi-Hop Question Answering
Yuelyu Ji, Rui Meng, Zhuochun Li, Daqing He · 2025
Read Memory-Aware and Uncertainty-Guided Retrieval for Multi-Hop Question Answering by Yuelyu Ji, Rui Meng, Zhuochun Li, Daqing He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23095.txt.
Introduction
Yuelyu Ji and three co-authors built a question answerer that fetches facts only when it needs them, in a paper published in 2025. Multi-hop questions need chains of evidence from many texts. Standard fetch-and-write pipelines fetch too often and waste what they fetched. Their framework, MIND, pulls key names from the question first.
A doubt gauge, read from the model's own word probabilities and attention, triggers a fetch when the chain runs thin. A memory keeps high-confidence facts across steps, so later steps build on firm ground. Weak facts get screened out by that memory. The authors say the framework answers with fewer, better fetches. It aims at questions whose evidence lies spread across sources.
Catalog record
| CREATOR | Yuelyu Ji, Rui Meng, Zhuochun Li, Daqing He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-23095
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Memory-Aware and Uncertainty-Guided Retrieval for Multi-Hop Question Answering Yuelyu Ji, Rui Meng, Zhuochun Li, Daqing He Abstract . Multi-hop question answering (QA) requires models to retrieve and reason over multiple pieces of evidence. While Retrieval-Augmented Generation (RAG) has made progress in this area, existing methods often suffer from two key limitations: (1) fixed or overly frequent retrieval steps, and (2) ineffective use of previously retrieved knowledge. We propose MIND (Memory-Informed and INteractive Dynamic RAG), a framework that addresses these challenges through: (i) prompt-based entity extraction to identify reasoning-relevant elements, (ii) dynamic retrieval triggering based on token-level entropy and attention signals, and (iii) memory-aware filtering, which stores high-confidence facts across reasoning steps to enable consistent multi-hop generation. https://github.com/JoyDajunSpaceCraft/MIND.git . DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 1. Introduction Figure 1. Overview of MIND. Given a multi-hop query (e.g., “Who is Charles Bretagne Marie De La Trémoille’s paternal grandfather?”), Step 1 (§ 3.1 ) uses an LLM prompt to extract candidate entities/facts. Step 2 (§ 3.2 ) monitors partial generation with RIND and triggers retrieval when uncertainty rises. Step 3 (§ 3.3 ) stores high-confidence items in a memory module while discarding low-confidence ones (using either No Filter, CoT, Conf, or CoT+Conf). Step 4 (§ 3.4 ) repeats sub-query refinement (e.g., “Who is Jean Bretagne Charles’s father?”) until no further retrieval is needed, yielding the final answer. Recent advances in large language models (LLMs) have significantly improved the performance of open-domain question answering (QA) systems, particularly when augmented with external knowledge retrieval ( Lewis et al., 2020 ; Zhong et al., 2024 ; Edge et al., 2024 ; Hu et al., 2024 ; Li et al., 2024b ; Zeng et al., 2025 ; Lin et al., [n. d.] ) . However, many real-world questions require multi-hop reasoning—a process of sequentially combining information from multiple sources before arriving at the final answer ( Yang et al., 2018 ; Ho et al., 2020 ) . Traditional retrieval-augmented generation ( RAG ) methods often struggle with such tasks due to their inability to adaptively retrieve information at the right moments , sometimes retrieving too frequently or insufficiently ( Su et al., 2024 ; Yao et al., 2024 ) . Moreover, these models lack mechanisms to robustly carry forward partially retrieved facts, leading to incomplete reasoning chains or redundant retrievals ( Qian et al., 2024 ; Li et al., 2024b ; Yang et al., 2025 ; Jin et al., 2025 ; Yang et al., 2024a ) . To address these challenges, recent studies have explored dynamic retrieval , where retrieval decisions are made adaptively during inference rather than following a fixed schedule. Notable approaches include DRAGIN ( Su et al., 2024 ) and SEAKER ( Yao et al., 2024 ) , which trigger retrieval based on real-time uncertainty signals. Meanwhile, memory-based approaches, such as MemorAG ( Qian et al., 2024 ) , aim to track reliable facts to enhance reasoning consistency. Despite these efforts, models still struggle with (1) Determining what to retrieve : as chain-of-thought prompting ( Wei et al., 2022 ) can introduce hallucinated entities, and purely confidence-based filtering may discard valuable but uncertain information; and (2) Efficiently storing and reusing relevant facts : without a structured memory mechanism, models risk inconsistencies in multi-step reasoning. To address these limitations, we propose MIND ( M emory- I nformed & IN teractive D ynamic RAG), a unified framework designed for multi-hop QA. As shown in Figure 1 , MIND employs dynamic thresholding to monitor token-level entropy and attention patterns, determining when additional retrieval is required. This process is guided by RIND (Retrieval-Integrated Neural Decision-making) , which adaptively triggers retrieval based on real-time uncertainty signals. When retrieval is triggered, MIND generates a sub-query —a refined query derived from intermediate reasoning—to retrieve missing information while maintaining contextual relevance. Additionally, a memory store ensures retrieved entities remain accessible across reasoning steps, while a flexible filtering strategy balances recall and precision by integrating chain-of-thought reasoning with confidence-based ranking. We evaluate MIND on four widely used multi-hop QA datasets: HotpotQA ( Yang et al., 2018 ) , 2WikiMultihopQA ( Ho et al., 2020 ) , StrategyQA ( Geva et al., 2021 ) , and IIRC ( Ferguson et al., 2020 ) . Our experiments demonstrate that MIND significantly reduces unnecessary retrieval calls while improving answer quality, as measured by F1 score and Exact Match (EM). Furthermore, detailed analyses reveal how different filtering modes (e.g., chain-of-thought vs. confidence ranking) impact retrieval efficiency and correctness, offering insights into balancing efficiency with thorough multi-hop reasoning. Our main contributions are as follows: • Memory-aware dynamic retrieval : We introduce a retrieval pipeline that adaptively triggers retrieval based on real-time uncertainty signals. • Entity-filtering strategies : We propose multiple techniques to balance recall and precision, enhancing retrieval efficiency. • Extensive empirical validation : We provide comprehensive experiments and ablation studies on four datasets, demonstrating the effectiveness of MIND for multi-step reasoning. 2. Related Work 2.1. Multi-Hop Retrieval-Augmented Generation Retrieval-Augmented Generation (RAG) has significantly improved open-domain QA by integrating external retrieval with language models ( Lewis et al., 2020 ; Liu et al., 2024 ; Xu et al., 2024 ; Wang et al., 2024 ; Zhu et al., 2024 ; Zheng et al., 2024 ; Jiang et al., 2024 ; Li et al., 2024a ; Li et al., 2025 ; Chen et al., 2024 ; Yang et al., 2024b ) . Early approaches, such as RETRO ( Borgeaud et al., 2022 ) and ICRALM ( Ram et al., 2023 ) , adopt static retrieval schedules, triggering lookups at fixed intervals (e.g., every few tokens or sentences). More recent dynamic retrieval strategies, including DRAGIN ( Su et al., 2024 ) , FLARE ( Jiang et al., 2023 ) , and SEAKER ( Yao et al., 2024 ) , adaptively determine when additional retrieval is necessary, improving multi-hop reasoning efficiency. Some of these dynamic retrieval approaches incorporate entity-based retrieval mechanisms to enhance sub-query generation. For instance, GraphRAG ( Han et al., 2024 ) structures knowledge into relational graphs, while KEPS ( Lu et al., 2020 ) ranks extracted entities to improve retrieval precision. However, these methods often rely on static extraction thresholds and lack adaptive mechanisms to dynamically refine retrieval strategies. Our approach builds on these ideas by integrating a dynamic thresholding mechanism that refines entity selection based on real-time retrieval signals, ensuring sub-queries remain contextually relevant across reasoning hops. 2.2. Memory-Augmented Systems Memory-augmented retrieval methods aim to enhance long-term context awareness by retaining high-confidence facts across multiple retrieval steps. Early memory networks ( Sukhbaatar et al., 2015 ) introduced end-to-end storage mechanisms, while more recent models like MemoRAG ( Qian et al., 2024 ) refine retrieval by persistently storing extracted entities. However, these methods often lack adaptive filtering, leading to redundant retrieval steps . and inefficient memory utilization. Our approach builds upon these foundations by integrating a dynamic memory mechanism that selectively retains and refines stored information based on real-time uncertainty signals. This enhances retrieval efficiency and ensures consistent reasoning across multi-hop QA tasks. 3. Methodology We propose an integrated pipeline, MIND (Memory-Informed & Interactive Dynamic RAG), for multi-hop question answering. As