Entropic Claim Resolution: Uncertainty-Driven Evidence Selection for RAG
Davide Di Gioia · 2026
Read Entropic Claim Resolution: Uncertainty-Driven Evidence Selection for RAG by Davide Di Gioia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28444.txt.
Introduction
Di Gioia reframes retrieval for question answering as a hunt for the claim that cuts uncertainty most. Relevance ranking fails when sources conflict or the question itself is murky. His Entropic Claim Resolution scores each candidate claim by expected entropy drop across rival answers. The search stops once a set sufficiency line is crossed. Built into a production retrieval pipeline, the method offers a principled shift from most similar to most decisive evidence.
Catalog record
| CREATOR | Davide Di Gioia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61569 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.28444
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Entropic Claim Resolution: Uncertainty-Driven Evidence Selection for RAG Davide Di Gioia Abstract Current Retrieval-Augmented Generation (RAG) systems predominantly rely on relevance-based dense retrieval, sequentially fetching documents to maximize semantic similarity with the query. However, in knowledge-intensive and real-world scenarios characterized by conflicting evidence or fundamental query ambiguity, relevance alone is insufficient for resolving epistemic uncertainty. We introduce Entropic Claim Resolution (ECR), a novel inference-time algorithm that reframes RAG reasoning as entropy minimization over competing semantic answer hypotheses. Unlike action-driven agentic frameworks (e.g., ReAct) or fixed-pipeline RAG architectures, ECR sequentially selects atomic evidence claims by maximizing Expected Entropy Reduction (EER), a decision-theoretic criterion for the value of information. The process dynamically terminates when the system reaches a mathematically defined state of epistemic sufficiency ( H ≤ ϵ H\leq\epsilon , subject to epistemic coherence). We integrate ECR into a production-grade multi-strategy retrieval pipeline (CSGR++) and demonstrate its theoretical properties. Our framework provides a rigorous foundation for uncertainty-aware evidence selection, shifting the paradigm from retrieving what is most relevant to retrieving what is most discriminative. 1 Introduction The integration of Large Language Models (LLMs) with external knowledge bases through Retrieval-Augmented Generation (RAG) has become the de facto standard for mitigating hallucinations and enabling knowledge-intensive Question Answering (QA). Conventional RAG systems operate on a rigid retrieve-then-read paradigm, predominantly leveraging maximum inner product search (MIPS) in dense continuous spaces [ 2 ] to fetch the top- k most semantically relevant text chunks. While highly effective for simple, factoid-based QA where a single ground-truth answer exists, this relevance-driven approach exhibits severe degradation in real-world, knowledge-intensive scenarios. Such scenarios are frequently characterized by inherent query ambiguity, conflicting evidence across multiple sources, and complex multi-hop dependencies. In these challenging settings, standard dense retrieval suffers from what we term epistemic collapse : the tendency to retrieve highly redundant information that is semantically similar to the query, rather than fetching the discriminative evidence needed to resolve the underlying uncertainty. Consequently, the LLM is forced to synthesize an answer from a biased or incomplete evidence distribution, often leading to unhedged, overconfident, or factually inaccurate generation. Recent architectural advancements attempt to transcend simple MIPS. Graph-based paradigms, such as Context-Seeded Graph Retrieval (CSGR) and GraphRAG, expand retrieval scope via structured knowledge relation traversal. Concurrently, agentic and iterative verification workflows (e.g., ReAct [ 5 ] , Tree-of-Thoughts [ 6 ] , Self-RAG [ 7 ] ) allow LLMs to dynamically interact with search tools, reflecting on retrieved context to guide subsequent actions. However, these state-of-the-art approaches still critically lack a principled, decision-theoretic stopping criterion and evidence selection mechanism. Graph techniques rely on static pipeline configurations (e.g., fixed graph-hop depth), while agentic systems depend on heuristic thresholding or prompt-driven self-reflection, which frequently suffer from infinite looping, premature termination, or unprincipled evidence weighting. Critically, modern RAG systems lack a mathematically rigorous definition of what constitutes sufficient evidence and an explicit objective function for selecting which specific piece of evidence to retrieve next at inference time. To bridge this fundamental gap, we propose Entropic Claim Resolution (ECR), an inference-time algorithm that reframes the retrieval and synthesis process as entropy minimization over a latent space of semantic answer hypotheses . Drawing inspiration from Information Theory [ 8 ] and Bayesian Experimental Design [ 9 ] , ECR models the QA task probabilistically. It initializes a probability distribution over a set of mutually exclusive potential answer hypotheses and iteratively selects atomic factual claims from a retrieved candidate pool to evaluate. Crucially, in ECR, evidence selection is decoupled from semantic relevance to the query. Instead, claims are selected by maximizing Expected Entropy Reduction (EER) ; that is, choosing the specific piece of evidence most likely to collapse the probability distribution toward a single, correct hypothesis (or cleanly bifurcate it in the case of irreconcilable conflict). The algorithm adaptively navigates the evidence graph under a principled stopping rule, terminating only when the entropy of the hypothesis space falls below a predefined threshold of epistemic sufficiency . In summary, our main contributions are: 1. We introduce Entropic Claim Resolution (ECR), a decision-theoretic evidence selection algorithm for RAG, shifting the paradigm from retrieving what is most relevant to what is most discriminative in resolving hypothesis ambiguity. 2. We formally define a principled, mathematically rigorous stopping criterion for iterative RAG pipelines based on epistemic sufficiency ( H(A|X)\leq\epsilon ). 3. We identify a behavioral phase transition under structured contradiction: by integrating a lightweight coherence signal ( \lambda>0 ), we show that ECR transitions from forced epistemic collapse to principled ambiguity exposure, prioritizing explicit contradictions when present and safely refusing to reduce uncertainty when evidence is inherently inconsistent. 4. We demonstrate the practical scalability of ECR by implementing it as a fast, inference-time algorithm integrated into a production-grade multi-strategy retrieval architecture (CSGR++), requiring no bespoke fine-tuning or specialized model weights. Significance. A central implication of this work is that improving retrieval-augmented reasoning does not necessarily require larger models, longer context windows, or additional data, but rather principled control over how existing evidence is selected and evaluated during inference. By explicitly modeling epistemic uncertainty and optimizing evidence selection for information gain, Entropic Claim Resolution provides a lightweight, computationally efficient mechanism for improving robustness and interpretability. This makes the framework particularly valuable for high-stakes enterprise deployments (e.g., medical, legal, or financial QA) where mitigating unhedged hallucinations and controlling inference costs are critical. Ultimately, this perspective highlights an alternative path for scaling knowledge-intensive systems: a path grounded in decision-theoretic inference rather than indiscriminate context expansion, particularly in settings characterized by noisy, conflicting, or heterogeneous evidence. 2 Related Work 2.1 Dense, Graph-Augmented, and Agentic Retrieval Standard dense retrieval selects a set of documents D by prioritizing their conditional probability given the query, P(D\mid Q) , commonly approximated via cosine similarity embeddings [ 1 ] . To overcome the short-sightedness of relevance search, advanced graph-based architectures, notably GraphRAG [ 3 ] and Context-Seeded Graph Retrieval (CSGR), implicitly construct or traverse knowledge graphs over chunks or entities to expand the evidence space. In enterprise environments, hybrid systems such as CSR-RAG [ 4 ] further integrate structural and relational signals to support large-scale schemas. Concurrently, the convergence of dynamic retrieval policies with autonomous planning has crystallized into the paradigm of Agentic RAG . Frameworks such as ReAct [ 5 ] , Tree-of-Thoughts [ 6 ] , and Self-RAG [ 7 ] allow language models to interleave intermediate reasoning steps with retrieval actions in order to refine subsequent queries. Recent Systematization of Knowledge (SoK) studies emphasize this shift from static pipelines toward modular control strategies. However, despite their flexibility, agentic retrieval systems intrinsically rely on heuristic prompt designs or static thresholds to determine when to halt retrieval or which information to prioritize. As a result, they lack a rigorous mathematical definition of epistemic sufficiency and an explicit objective for selecting the next most informative piece of evidence as uncertainty unfolds during inference. 2.2 Uncertainty Quantification (UQ) in RAG A critical prerequisite for adaptive retrieval is accurately characterizing what a model does not know. Recent benchmarks such as URAG [ 11 ] demonstrate that while RAG can improve factual grounding, it also introduces new sources of epistemic uncertainty, including relevance mismatch and selective attention to partial evidence, which can paradoxically amplify overconfident hallucinations under noisy