A Multi-Agent Approach for Claim Verification from Tabular Data Documents
Rudra Ranajee Saha, Laks V. S. Lakshmanan, Raymond T. Ng · 2026
Read A Multi-Agent Approach for Claim Verification from Tabular Data Documents by Rudra Ranajee Saha, Laks V. S. Lakshmanan, Raymond T. Ng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17225.txt.
Introduction
Saha, Lakshmanan, and Ng propose MACE, a multi-agent framework for verifying claims from tabular data documents. A Planner drafts reasoning strategies, an Executor lays out computation steps, and a Verifier checks the logic. Each agent works zero-shot with chain-of-thought prompting, avoiding elaborate fine-tuning, and the traces stay interpretable. MACE tops two datasets and matches the best models on two others, while hitting 80 to 100 percent of best performance with far smaller models — 27 to 92B parameters against 235B.
Catalog record
| CREATOR | Rudra Ranajee Saha, Laks V. S. Lakshmanan, Raymond T. Ng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59185 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17225
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Multi-Agent Approach for Claim Verification from Tabular Data Documents Rudra Ranajee Saha, Laks V. S. Lakshmanan, Raymond T. Ng Abstract We present a novel approach for claim verification from tabular data documents. Recent LLM-based approaches either employ complex pretraining/fine-tuning or decompose verification into subtasks, often lacking comprehensive explanations and generalizability. To address these limitations, we propose a Multi-Agentic framework for Claim vErification ( Mace ) consisting of three specialized agents: Planner, Executor, and Verifier. Instead of elaborate fine-tuning, each agent employs a zero-shot Chain-of-Thought setup to perform its tasks. Mace produces interpretable verification traces, with the Planner generating explicit reasoning strategies, the Executor providing detailed computation steps, and the Verifier validating the logic. Experiments demonstrate that Mace achieves state-of-the-art (SOTA) performance on two datasets and performs on par with the best models on two others, while achieving 80--100% of best performance with substantially smaller models: 27--92B parameters versus 235B. This combination of competitive performance, memory efficiency, and transparent reasoning highlights our framework’s effectiveness. 1 1 1 Upon acceptance of the paper, we will release our codebase to the public. 1 Introduction Claim verification from tabular data documents is a critical task in Natural Language Processing, driven by the need to combat misinformation in domains where factual information is often stored in structured tables. Tables, embedded within documents such as scientific papers, financial reports, and corporate sustainability disclosures, serve as concise representations of complex information, making them pivotal for verifying claims about numerical, categorical, or relational data. Documents may contain contextual paragraphs alongside tables. As organizations increasingly rely on tabular data to communicate key metrics, accurate claim verification against these sources is critical to ensure trust and accountability. Row No. 2023 2022 2021 2020 2019 2018 2017 1 All Operations 2 Water withdrawal(2) 145,770 117,327 117,262 118,284 127,018 128,146 115,368 … … … … … … … … 5 Water reused/recycled 168,358 134,131 138,812 157,641 148,914 174,688 176,563 6 Operational water use(4) 315,784 250,449 256,074 275,925 275,931 302,835 291,931 7 Mining Operations 8 Water withdrawal(2) 72,645 47,701 45,222 47,739 51,954 60,003 44,225 … … … … … … … … 12 Water reused/recycled 168,358 134,131 138,812 157,641 148,914 174,688 176,563 13 Operational water use(4) 242,687 180,823 184,034 205,381 200,867 234,691 220,788 Table 1: Water Metrics in Megalitres (ML)(1). (2) Water withdrawal is water that enters the operational water system and is used to supply the operational water demands. … (4) Total water use is the sum of water withdrawals and water reused/recycled. Row No. column is added only for illustration purposes. Formally, the task takes a claim and evidence (tables/paragraphs) as input, outputting a verdict (“support,” “refute,” or “not enough info”) with reasoning. Throughout this paper, we use ‘ evidence ’ to refer to tables and paragraphs. This task spans closed-domain 19 ; 13 (claims paired with specific tables) and open-domain 23 ; 5 (claims paired with document corpora, with models having to retrieve relevant tables from the corpora) settings. Table 1 shows an example from a mining company’s sustainability report. For claim ‘Reused/recycled water made up 55.82% of all operational water use across all years’ , Table 1 provides supporting evidence (detailed analysis in Section 3 ). Despite recent advancements, claim verification from tabular data documents faces challenges that include diverse table structures and the need for sophisticated reasoning to integrate tabular and textual evidence. For instance, verifying this claim requires: identifying relevant rows based on scope (“All Operations” vs “Mining Operations”), understanding hierarchical structure (rows 2–6 under row 1), selecting data rows (5–6 for reused/recycled water and operational use), extracting values across years (2017–2023), and determining operation sequence (summation then percentage) to validate 55.82%. Additionally, open-domain retrieval, generating explainable outcomes, and generalizability across domains remain significant challenges 6 . To address these challenges, we propose ( Mace ), a novel, prompt-based approach that avoids elaborate pre-training and fine-tuning. Mace comprises three specialized agents : (i) Planner –devises reasoning strategies, (ii) Executor – implements the plan and performs verification, and (iii) Verifier –validates output for consistency and correctness. This design enables effective collaboration among agents while maintaining interpretability. A key innovation is our feedback loop mechanism: the Executor can request plan revisions from the Planner when encountering ambiguities, and the Verifier can request corrections from the Executor when detecting inconsistencies, preventing error propagation. Our framework achieves SOTA performance on two closed-domain datasets and matches the best models on two open-domain datasets, demonstrating its versatility in both claim verification settings. Smaller configurations (27–92B parameters) achieve 80–96% of 235B model performance using 11.5–39.1% memory, offering compelling performance-memory tradeoffs with step-by-step explainability that details the selected rows, columns, cells, and mathematical operations performed. 2 Related Work Prior works address claim verification through three main approaches: pre-training, fine-tuning, and prompt engineering. Pre-training and Fine-tuning Approaches. Recent advances include TableGPT2 16 , trained on 593.8K tables for schema and cell-level information, and TableRAG 2 , using retrieval-augmented generation for large table context limitations. Fine-tuning methods like TAT 24 decompose reasoning into extraction, reasoning, and execution steps; ProTrix 19 employs a Plan-then-Reason framework for diverse table queries. Claim Verification from Tabular Data. FinDVer 23 focuses on claim verification over financial documents, and shows that even models like GPT-4o underperform human experts in numerical reasoning. TART 13 bridges program-based precision and chain-of-thought explainability by integrating LLMs with specialized tools, achieving SOTA performance on SciTab 12 and PubHT 1 benchmarks. For open-domain, OpenTab 9 combines BM25 retrieval with SQL generation; GraphOTTER 10 transforms tables into graph representations, effective for tables with merged cells and nested structures. Despite this progress, several challenges persist. Many approaches rely on proprietary large models like GPT-3/4 ( 23 ; 13 ) , requiring substantial resources and hindering reproducibility. Fine-tuned models excel on specific datasets but struggle to generalize across diverse table formats and domains, while resource-intensive methods limit practicality. Furthermore, unidirectional task decomposition techniques ( 20 ; 22 ) are prone to error propagation, while SQL generation methods face difficulties with complex header hierarchies ( 10 ) . In contrast, our Mace framework incorporates feedback loops enabling iterative refinement, revision requests when detecting inconsistencies, mitigating error propagation. 3 Methodology Figure 1: Overview of the Mace framework. Black solid arrows indicate the standard workflow sequence among agents. Black dashed arrows represent feedback loops; Red arrows show the Group Chat agent monitoring all agents. Blue dashed arrows indicate the final verdict return path from the Verifier to the User agent. Mace is implemented using the AutoGen library 18 and it functions as a structured, constrained group-chat system where agents collaborate in a predefined sequence to verify claims against tabular data documents (Figure 1 ). It comprises four agents: User agent provides the claim and evidence; Planner agent designs a step-by-step verification strategy; Executor agent implements the plan and produces a provisional verdict; and Verifier agent evaluates the output for consistency and correctness. The group-chat operates through constrained speaker transitions managed by a custom selection function, following: User \rightarrow Planner \rightarrow Executor \rightarrow Verifier \rightarrow User. The framework incorporates a revision mechanism enabling the Executor to request plan revisions from the Planner, and the Verifier to request corrections from the Executor—a key advantage over unidirectional pipelines where errors propagate through subsequent stages. Each agent is