ProvenAI: Provenance-Native Traces of Evidence in Generated Answers

Mohammad Faizan, Dalal Alharthi · 2026

Read ProvenAI: Provenance-Native Traces of Evidence in Generated Answers by Mohammad Faizan, Dalal Alharthi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26449.txt.

Introduction

Mohammad Faizan and Dalal Alharthi question a comforting habit of retrieval-augmented systems. Such systems answer questions using documents they fetch first. They often print citations beside the answer. But a citation does not prove that source shaped the answer. Their framework, ProvenAI, splits transparency into three layers. Each layer can be measured on its own. The layers cover answer correctness, citation quality, and real document influence.

ProvenAI runs a seven-stage pipeline over the HotpotQA distractor benchmark. That benchmark requires joining facts across documents. It covers more than seven thousand questions. The questions draw on a corpus of about half a million passages. Answers reached an accuracy a little above half. Citation quality scored higher. One worked example exposed the gap the authors name. A perfectly cited source had only weak influence. Meanwhile, seven uncited sources measurably shifted the answer.

Catalog record

CREATORMohammad Faizan, Dalal Alharthi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26449

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ProvenAI: Provenance-Native Traces of Evidence in Generated Answers Mohammad Faizan, Dalal Alharthi Abstract Retrieval-augmented systems routinely present citations alongside generated answers, yet a citation does not confirm that the corresponding source meaningfully shaped the output. This paper introduces ProvenAI, a framework that decomposes transparency in multi-hop question answering into three independently measurable layers: answer correctness, citation fidelity against benchmark supporting evidence, and per-document influence under leave-one-resource-out intervention. Targeting the HotpotQA distractor benchmark through a seven-stage pipeline covering data normalisation, retrieval indexing, citation-aware answer generation, attribution auditing, ablation-based influence estimation, batch evaluation, and interactive inspection, ProvenAI evaluates 7,405 validation examples drawn from a canonical corpus of 509,300 passages. The system achieves 53.53% answer accuracy alongside a mean citation-fidelity score of 71.55%, and a worked example surfaces what we call the citation-influence gap : a clean citation audit co-occurring with a profile in which one cited source registers only weak influence while seven uncited sources demonstrably shift the output. We formalise the relationship between the implemented surface proxy and a token-level KL-divergence target through a stated faithfulness condition, ground the framework in causal-mediation analysis and database-provenance theory, and discuss how the three measurement layers compose with cryptographic provenance architectures emerging in autonomous scientific discovery. ProvenAI establishes that meaningful transparency in retrieval-grounded QA requires traceable links across retrieved, cited, and behaviourally influential evidence as three distinct, independently measured layers. Preprint. 1 Introduction Retrieval-augmented generation has become a mainstream mechanism for improving the factual grounding of language model outputs by supplying external documents at inference time [ 21 , 18 ] . Multi-hop question answering amplifies the challenge: a correct answer typically requires chaining evidence across several documents, making it essential to understand not only what was retrieved but how each piece of evidence influenced the final response [ 37 , 34 ] . The HotpotQA distractor benchmark provides sentence-level supporting-fact annotations and has therefore become a principled testbed for studying how retrieved evidence propagates through a pipeline. Despite the promise of citation-bearing outputs, a model that receives ten retrieved passages and cites only two of them may still be shaped by the remaining eight. The citation list answers a single narrow question, namely what the model claims to have used, and says nothing about whether those sources matched the gold supporting facts, nor whether removing any particular document would have changed the response. State-of-the-art systems leave citations unsupported a substantial fraction of the time and frequently cite sources in ways that do not reflect their actual context usage [ 22 , 17 , 28 ] . Recent work further shows that language models can be distracted by irrelevant retrieved context [ 33 ] and may rely on parametric memory rather than the cited passages [ 23 ] , making the gap between cited and influential evidence operationally important. The need for output-level auditing is especially acute in security and forensic applications, where LLM-driven pipelines increasingly analyse logs and evidence yet must remain accountable to a verifiable record of what shaped each conclusion [ 7 , 2 ] . ProvenAI is built around this gap. It is not a stronger QA model but an infrastructure for measuring how evidence propagates through a retrieval-grounded pipeline. The core premise is that answer quality, citation faithfulness, and resource influence each capture a different dimension of transparency, and collapsing them into a single score discards the diagnostic information practitioners need. The implemented system follows a seven-stage workflow in which HotpotQA data are converted into stable local artefacts, a dense retrieval index is built, a generation step produces citation-aware answers, an auditing step checks citations against gold supporting facts, leave-one-resource-out ablations estimate per-document influence, metrics are aggregated over the full validation split, and a Streamlit dashboard exposes results alongside Model Context Protocol [ 9 ] trace artefacts. The contributions of this work are fourfold. We present a practical decomposition of retrieval-grounded QA transparency into three independently measurable layers and supply formal operationalisations for each. We report an end-to-end pipeline evaluated over the complete HotpotQA distractor validation split, with reproducible structured report artefacts at every stage. We exhibit and characterise the citation-influence gap, formalise the relationship between the implemented surface proxy and a token-level KL-divergence target, and connect the framework to causal-mediation analysis and database-provenance theory. Finally, we discuss how the three measurement layers compose with cryptographic provenance architectures relevant to autonomous scientific discovery, settings in which the audit trail must be an invariant of execution rather than retrospective annotation. 2 Related Work Multi-hop retrieval and RAG foundations. Retrieval-augmented generation pairs a parametric language model with a non-parametric retrieval index over a corpus [ 21 ] , with dense passage retrieval [ 20 ] and approximate nearest-neighbour indexing [ 19 ] as the standard implementation. Multi-hop benchmarks demand chained evidence: HotpotQA [ 37 ] provides sentence-level supporting-fact annotations across two-hop questions, and MuSiQue extends control over reasoning structure through single-hop compositions [ 35 ] . Surveys show that while RAG substantially reduces hallucinations on knowledge-intensive tasks, retrieval errors propagate through generation in ways aggregate accuracy scores cannot readily surface [ 18 , 12 ] . Self-RAG trains a single model to decide adaptively when to retrieve and to critique its own evidence through self-reflection tokens [ 10 ] , and dedicated multi-hop RAG evaluations show that existing dense and sparse retrieval methods perform poorly when several evidence hops are required [ 34 ] . Beyond single-model pipelines, structural analyses of multi-agent LLM communication show that reasoning reliability depends on the topology through which evidence propagates [ 26 ] , reinforcing that what flows between components, not only what each component emits, governs trust. ProvenAI does not train a new retriever or generator; it measures what can be inferred around an inference-only pipeline built from fixed pre-trained components [ 31 , 29 ] . Citation quality and verifiability. Generative search systems that produce fluent citation-bearing answers can still fail to ground those citations in the corresponding source passages [ 22 ] . FActScore decomposes long-form generations into atomic claims and checks each against a knowledge source [ 24 ] , RAGAS supplies reference-free metrics for faithfulness and context relevance [ 16 ] , and the AIS framework defines verifiable NLG as output attributable to identified sources with a two-stage annotation pipeline [ 30 ] . ALCE formalised end-to-end evaluation of citation-bearing answers, demonstrating that even strong models leave citations unsupported a significant fraction of the time [ 17 ] , and MIRAGE uses model internals, specifically KL-divergence shifts, to attribute answers to retrieved passages more faithfully than self-citation prompting [ 28 ] . ProvenAI is aligned with this evaluation-focused direction but adds an orthogonal question: after a document has been cited, does removing it from context actually change what the model generates? Context attribution, causal mediation, and provenance theory. Ablation-based attribution has a long lineage in machine-learning interpretability, from local surrogate models such as LIME [ 32 ] to causal-mediation analyses that intervene on internal model components [ 36 ] , formalised through the do-calculus [ 27 ] . ContextCite formalises context attribution by fitting a sparse linear surrogate over random context ablations, with the key finding that removing high-scoring context segments causes larger output probability drops than removing low-scoring ones

Read the complete text