Citation-Enforced RAG for Fiscal Document Intelligence: Cited, Explainable Knowledge Retrieval in Tax Compliance

Akhil Chandra Shanivendra · 2026

Read Citation-Enforced RAG for Fiscal Document Intelligence: Cited, Explainable Knowledge Retrieval in Tax Compliance by Akhil Chandra Shanivendra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14170.txt.

Introduction

Shanivendra presents a citation-enforced retrieval system for tax and fiscal documents. Tax work needs answers that can be audited, and standard chatbots often skip sources or invent facts. The framework ingests sources first, keeps page-level provenance, and forces citations in every answer. It can also abstain when proof runs thin. Tests on real IRS and state tax files show better citation fidelity, fewer made-up claims, and explanations that analysts can use.

Catalog record

CREATORAkhil Chandra Shanivendra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60595
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14170

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Citation-Enforced RAG for Fiscal Document Intelligence: Cited, Explainable Knowledge Retrieval in Tax Compliance Akhil Chandra Shanivendra Abstract Tax authorities and public-sector financial agencies rely on large volumes of unstructured and semi-structured fiscal documents—including tax forms, instructions, publications, and jurisdiction-specific guidance—to support compliance analysis and audit workflows. While recent advances in generative AI and retrieval-augmented generation (RAG) have shown promise for document-centric question answering [ 1 ] , existing approaches often lack the transparency, citation fidelity, and conservative behaviour required in high-stakes regulatory domains. In particular, unconstrained generation and summary-based multimodal retrieval can lead to hallucinated or weakly supported outputs that are difficult to verify. This paper presents a multimodal, citation-enforced RAG framework for fiscal document intelligence that prioritises explainability and auditability. The proposed system adopts a source-first ingestion strategy, embedding only content extracted directly from authoritative fiscal documents while preserving document identifiers and page-level provenance. Answer generation is constrained by explicit citation enforcement, which requires every generated claim to be grounded in retrieved evidence, and by an abstention mechanism that allows the system to decline to answer when document support is insufficient. The framework is evaluated on a corpus of real-world, publicly available tax documents from the U.S. Internal Revenue Service and two U.S. state tax authorities. Using a combination of automatic metrics and human evaluation, the study assesses retrieval performance, citation correctness, hallucination rates, abstention behaviour, and answer usefulness. Results demonstrate that the proposed design substantially improves citation fidelity and reduces unsupported claims while maintaining practical utility for analyst-facing tasks. Overall, this work illustrates how generative AI can be responsibly applied to multimodal fiscal document analysis by combining retrieval-based grounding with explicit constraints on generation, offering a practical pathway toward trustworthy AI systems for tax compliance and public-sector governance. Keywords: Retrieval-Augmented Generation (RAG), Fiscal Document Analysis, Multimodal AI, Explainable AI (XAI), Tax Compliance, Hallucination Mitigation, Document Intelligence. 1 Introduction 1.1 Background and Motivation Tax authorities and public-sector financial agencies operate in an environment characterised by an ever-growing volume of complex, unstructured documentation. Core compliance and audit workflows rely on a diverse set of fiscal artefacts, including scanned tax forms, filing instructions, policy manuals, audit memoranda, administrative notices, and jurisdiction-specific guidance documents. These materials are typically distributed as heterogeneous PDF files containing a mixture of free-form text, tables, structured layouts, and embedded images. As regulations evolve and reporting requirements change, maintaining accurate, consistent, and explainable access to this information presents a persistent operational challenge. Traditional approaches to fiscal document analysis—such as rule-based systems, keyword search, and manually curated knowledge bases—struggle to scale in this setting. Rule-based pipelines require continuous maintenance and are brittle to changes in document structure or language. Keyword-based information retrieval systems, such as those relying on BM25 or Okapi algorithms, often fail to capture semantic intent, returning incomplete or contextually irrelevant results [ 16 ] . More recently, large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, motivating interest in their application to document-intensive public-sector workflows. However, naïvely applying LLMs to tax and compliance tasks introduces significant risks, particularly hallucinated responses [ 4 ] , unverifiable claims, and the absence of explicit links between generated answers and authoritative source documents. In regulated domains such as taxation, explainability and traceability are not optional features but foundational requirements. Any automated system used to support compliance analysis or audit decision-making must allow analysts to verify outputs against the source materials, understand the provenance of each claim, and identify cases in which the available evidence is insufficient to support a definitive answer. These constraints sharply differentiate fiscal document intelligence from many consumer-facing or exploratory AI applications. 1.2 Problem Statement Despite rapid progress in generative AI and retrieval-augmented generation (RAG) systems [ 1 , 14 ] , existing approaches remain poorly suited to high-stakes fiscal and tax compliance settings. Standard RAG pipelines typically focus on maximising answer fluency and semantic relevance, often embedding unstructured text or LLM-generated summaries into vector databases and relying on unconstrained generation at inference time [ 15 ] . While effective for general question answering, such designs offer limited guarantees regarding citation fidelity, evidence completeness, or control of hallucinations. Multimodal RAG systems extend these ideas to documents containing images and tables, often by generating textual summaries of non-textual content and embedding them for retrieval. Although this strategy simplifies multimodal integration, it introduces an additional generative step before retrieval, effectively treating model-generated abstractions as primary evidence. In domains requiring auditability, this design choice obscures the relationship between system outputs and original documents, making it difficult to verify claims at the level of document spans, pages, or sections. Furthermore, most existing systems assume that an answer should always be produced, even when retrieved evidence is weak or ambiguous. In tax compliance contexts, confidently stating an incorrect interpretation can be more harmful than explicitly acknowledging uncertainty. The lack of abstention mechanisms in current RAG systems, therefore, represents a critical gap for responsible deployment in public-sector analytics. The central problem addressed in this work is the absence of a document-grounded, citation-enforced, and abstention-aware framework for multimodal fiscal document intelligence that satisfies the transparency and accountability requirements of tax compliance workflows. 1.3 Contributions In this paper, this study presents a Generative AI and Multimodal Retrieval-Augmented Generation framework designed specifically for fiscal and tax-related document analysis under high accountability constraints. The contributions are as follows: • Source-first multimodal RAG architecture: The proposed architecture preserves document provenance by embedding and retrieving only extracted source content, rather than LLM-generated summaries, enabling span-level traceability. • Citation-enforced answer generation: This study introduces a mechanism in which every generated statement must be explicitly grounded in retrieved evidence, with citations linked to document identifiers and page ranges. • Abstention-aware decision policy: The framework incorporates a decision policy that allows the system to withhold answers when retrieved evidence is insufficient or unreliable, reducing hallucination risk in high-stakes scenarios. • Real-world evaluation: The framework is evaluated on a corpus of real-world, publicly available fiscal documents from the U.S. Internal Revenue Service and two U.S. state tax authorities, without the use of synthetic or simulated data. • Comprehensive assessment: Both automatic and human evaluations are conducted to assess retrieval quality, citation correctness, hallucination rates, abstention behaviour, and answer usefulness. By situating generative AI within a rigorously constrained retrieval-and-citation framework, this work demonstrates how multimodal RAG systems can be adapted to support responsible, explainable decision-making in public-sector tax compliance. 2 Related Work This work intersects several active research areas, including document intelligence for public-sector applications, retrieval-augmented generation (RAG), multimodal RAG systems, and explainable or trustworthy AI. This section reviews these strands of literature and highlights the limitations that motivate the proposed approach. 2.1 Document Intelligence in Public-Sector and Financial Domains Automated document processing has long been a focus of research and practice in government and financial institutions. Early systems relied heavily on optical character recognition (OCR) pipelines combined with rule-based extraction and template matching to process structured forms and reports. In tax administration, such systems are commonly used to extract fields from standardised filings or to perform basic document classification. While effective for narrowly defined tasks, these approaches are brittle when faced with heterogeneous layouts, evolving regulations, and narrative guidance documents that do not conform to fixed templates. More

Read the complete text