ERA: Evidence-based Reliability Alignment for Honest Retrieval-Augmented Generation Conference: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining; XX XX– XX XX, 2026; XXX, XXX. Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 26), August 9– August 13, 2026, Jeju, Korea Price: 15.00 DOI: xx.xxxx/xxxxxxx.xxxxxxx ISBN: xxx-x-xxxx-xxxx-x/xx/xx CCS: Computing methodologies Natural language generation CCS: Information systems Question answering

Sunguk Shin, Meeyoung Cha, Byung-Jun Lee, Sungwon Park · 2026

Read ERA: Evidence-based Reliability Alignment for Honest Retrieval-Augmented Generation Conference: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining; XX XX– XX XX, 2026; XXX, XXX. Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 26), August 9– August 13, 2026, Jeju, Korea Price: 15.00 DOI: xx.xxxx/xxxxxxx.xxxxxxx ISBN: xxx-x-xxxx-xxxx-x/xx/xx CCS: Computing methodologies Natural language generation CCS: Information systems Question answering by Sunguk Shin, Meeyoung Cha, Byung-Jun Lee, Sungwon Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20854.txt.

Introduction

Shin, Cha, Lee, and Park propose ERA, a way to improve abstention in retrieval-augmented generation by shifting confidence scores from single numbers to explicit evidence distributions. ERA has two main parts. Contextual Evidence Quantification treats inner and outer knowledge as their own belief piles under the Dirichlet distribution. Quantifying Knowledge Conflict uses Dempster-Shafer Theory to gauge how far apart sources are. These parts split epistemic uncertainty from aleatoric uncertainty and tune the training goal by conflicts found.

Catalog record

CREATORSunguk Shin, Meeyoung Cha, Byung-Jun Lee, Sungwon Park
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52805
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.20854

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ERA: Evidence-based Reliability Alignment for Honest Retrieval-Augmented Generation Conference: Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining; XX XX– XX XX, 2026; XXX, XXX. Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 26), August 9– August 13, 2026, Jeju, Korea Price: 15.00 DOI: xx.xxxx/xxxxxxx.xxxxxxx ISBN: xxx-x-xxxx-xxxx-x/xx/xx CCS: Computing methodologies Natural language generation CCS: Information systems Question answering Sunguk Shin, Meeyoung Cha, Byung-Jun Lee, Sungwon Park Abstract . Retrieval-Augmented Generation (RAG) grounds language models in factual evidence but introduces critical challenges regarding knowledge conflicts between internalized parameters and retrieved information. However, existing reliability methods, typically relying on scalar confidence, fail to explicitly distinguish between epistemic uncertainty and inherent data ambiguity in such hybrid scenarios. In this paper, we propose a new framework called ERA (Evidence-based Reliability Alignment) to enhance abstention behavior in RAG systems by shifting confidence estimation from scalar probabilities to explicit evidence distributions. Our method consists of two main components: (1) Contextual Evidence Quantification, which models internal and external knowledge as independent belief masses via the Dirichlet distribution, and (2) Quantifying Knowledge Conflict, which leverages Dempster-Shafer Theory (DST) to rigorously measure the geometric discordance between information sources. These components are used to disentangle epistemic uncertainty from aleatoric uncertainty and modulate the optimization objective based on detected conflicts. Experiments on standard benchmarks and a curated generalization dataset demonstrate that our approach significantly outperforms baselines, optimizing the trade-off between answer coverage and abstention with superior calibration. 1. Introduction Recent advances in Large Language Models (LLMs), trained on massive corpora, have profoundly transformed the landscape of Natural Language Processing (NLP). Despite their remarkable capabilities, these models remain prone to hallucinations, stemming from their reliance on static training data that may become outdated and their tendency to generate factually incorrect or misleading content ( Kalai et al. 2025 ; Zhang et al. 2024 ) . Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating external knowledge sources into the generation process, thereby grounding model outputs in factual evidence and improving overall reliability ( Lewis et al. 2020 ) . However, despite its advantages, RAG introduces a new class of challenges arising from its hybrid nature. In particular, conflicts may emerge between a model’s internalized parametric knowledge and the retrieved external information ( Longpre et al. 2021 ; Mallen et al. 2023 ) . Such discrepancies can create ambiguity during generation, making it difficult for the model to reconcile conflicting evidence. As a result, the model may exhibit inconsistent behavior, degraded response quality, or erroneous reasoning when it fails to appropriately prioritize the correct information source ( Shin and Kim 2025 ) . Addressing this challenge is critical for ensuring the trustworthiness of retrieval-augmented systems in real-world applications. To mitigate these issues, prior work has explored mechanisms for regulating a model’s reliance on retrieved information, including dynamic gating strategies. In parallel, early research investigated unsupervised approaches for assessing response reliability through statistical proxies. For example, Guerreiro et al. leveraged token-level output probabilities—such as average or minimum logit values—to estimate generation confidence ( Guerreiro et al. 2023 ) , while Wang et al. proposed Self-Consistency, which samples multiple reasoning paths and selects the most reliable answer via majority voting ( Wang et al. 2023 ) . In contrast, another line of work adopts a supervised paradigm. For instance, Sun et al. employed Direct Preference Optimization (DPO) to train models to abstain from answering when retrieved context is insufficient, using curated abstention datasets to align model behavior with reliability objectives ( Sun et al. 2025 ) . Despite these advances, existing approaches remain vulnerable to overfitting—either to the pre-training distribution in unsupervised methods or to specific abstention patterns in supervised ones. As a result, unsupervised methods often struggle to distinguish confident hallucinations from correct predictions, while supervised approaches may memorize refusal behaviors, limiting their generalization to unseen scenarios. These shortcomings stem from two fundamental challenges. First, conventional probabilistic frameworks rely on scalar confidence estimates that fail to distinguish epistemic uncertainty (arising from lack of knowledge) from aleatoric uncertainty (stemming from inherent data ambiguity), often leading to overconfident predictions ( Guo et al. 2017 ; Kuhn et al. 2023 ; Park et al. 2025 ) . Second, the aggregation of internal model knowledge and external retrieved contexts into a single output distribution obscures conflicts between these information sources, hindering the reliable identification of hallucinations ( Mallen et al. 2023 ; Jin et al. 2025 ) . This highlights the critical need for a robust quantification metric capable of explicitly disentangling belief from uncertainty while simultaneously measuring the conflict between internal parametric knowledge and external retrieved evidence. To address these limitations, we propose ERA (Evidence-based Reliability Alignment), a principled framework designed to enhance abstention behavior in RAG systems. Inspired by evidential deep learning ( Sensoy et al. 2018 ) , ERA shifts confidence estimation from scalar probabilities to explicit modeling of evidence distributions. By leveraging the Dirichlet distribution to parameterize evidence density, our approach disentangles epistemic and aleatoric uncertainty in a principled manner. Furthermore, ERA independently models belief masses derived from parametric knowledge and retrieved evidence. Using Dempster–Shafer Theory (DST) ( Jsang 2018 ) , it quantitatively measures belief conflict—the disagreement between internal priors and external information—thereby providing a rigorous geometric foundation for reliable and interpretable abstention. Experiments demonstrate that ERA optimizes the trade-off between answer coverage and abstention, maintaining high accuracy on answerable queries while selectively withholding responses in uncertain or conflicting scenarios. In comparisons with several recent baselines on standard RAG benchmarks, our results show that the model significantly improves response reliability without compromising its ability to answer supported queries. Furthermore, this robustness is validated through evaluations on a curated dataset of Wikipedia events, specifically designed to assess generalizability. Finally, extensive empirical analysis confirms that ERA produces well-calibrated confidence estimates, ensuring that its predicted uncertainty accurately reflects the true likelihood of correctness. The major contributions and findings of our work include: • Proposing a novel reliability alignment framework, ERA , that fundamentally shifts confidence quantification from scalar probabilities to evidence distributions via the Dirichlet distribution, explicitly disentangling epistemic uncertainty from aleatoric uncertainty. • Introducing a rigorous quantification of ‘belief conflict’ by leveraging Dempster-Shafer Theory (DST) to measure the geometric discordance between the model’s internal parametric knowledge and external retrieved evidence, which are modeled as independent belief masses. • Constructing a curated benchmark dataset derived from Wikipedia events specifically designed to evaluate generalization, verifying that ERA robustly identifies unsupported queries across diverse domains without overfitting to specific refusal patterns. • Demonstrating through extensive experiments that ERA produces well-calibrated confidence estimates and optimizes the trade-off between answer coverage and abstention, significantly outperforming existing baselines in enabling honest RAG. The training details and datasets are publicly available at https://anonymous.4open.science/r/ERA-318B . 2. Related work 2.1. Uncertainty Quantification and Evidential Deep Learning In deep learning classifiers, softmax probabilities are widely used as a proxy for confidence; however, they are often miscalibrated and can be overconfident ( Guo et al. 2017 ) . To mitigate this miscalibration, various approaches have been proposed, ranging from approximate Bayesian inference methods ( Gal and Ghahramani 2016 ) to Deep Ensembles ( Lakshminarayanan et al. 2017 ; Park et al. 2021 ) . While these

Read the complete text