Enhancing TableQA through Verifiable Reasoning Trace Reward

Tung Sum Thomas Kwok, Xinyu Wang, Hengzhi He, Xiaofeng Lin, Peng Lu, Liheng Ma, Chunhe Wang, Ying Nian Wu, Lei Ding, Guang Cheng · 2026

Read Enhancing TableQA through Verifiable Reasoning Trace Reward by Tung Sum Thomas Kwok, Xinyu Wang, Hengzhi He, Xiaofeng Lin, Peng Lu, Liheng Ma, Chunhe Wang, Ying Nian Wu, Lei Ding, Guang Cheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22530.txt.

Introduction

Tung Sum Thomas Kwok and five co-authors train table-question agents with rewards for each checkable step. TableQA asks a model to answer from a table, but the answer needs a chain of changes to the table state. Their 2026 preprint notes that this chain, not a static read, is the hard part.

Rewards tied to each table change give the agent true feedback as it works. That should cut wild leaps that land on a lucky answer. It should also yield a trace a human can audit. The work aims at agents that do data chores with proof. Each step can be checked.

Catalog record

CREATORTung Sum Thomas Kwok, Xinyu Wang, Hengzhi He, Xiaofeng Lin, Peng Lu, Liheng Ma, Chunhe Wang, Ying Nian Wu, Lei Ding, Guang Cheng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22530

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing TableQA through Verifiable Reasoning Trace Reward Tung Sum Thomas Kwok, Xinyu Wang, Hengzhi He, Xiaofeng Lin, Peng Lu, Liheng Ma, Chunhe Wang, Ying Nian Wu, Lei Ding, Guang Cheng Abstract A major challenge in training TableQA agents, compared to standard text- and image-based agents, is that answers cannot be inferred from a static input but must be reasoned through stepwise transformations of the table state, introducing multi-step reasoning complexity and environmental interaction. This leads to a research question: Can explicit feedback on table transformation action improve model reasoning capability? In this work, we introduce RE-Tab , a plug-and-play framework that architecturally enhances trajectory search via lightweight, training-free reward modeling by formulating the problem as a Partially Observable Markov Decision Process. We demonstrate that providing explicit verifiable rewards during State Transition (“What is the best action?”) and Simulative Reasoning (“Am I sure about the output?”) is crucial to steer the agent’s navigation in table states. By enforcing stepwise reasoning with reward feedback in table transformations, RE-Tab achieves state-of-the-art performance in TableQA with almost 25% drop in inference cost. Furthermore, a direct plug-and-play implementation of RE-Tab brings up to 41.77% improvement in QA accuracy and 33.33% drop in test-time inference samples for consistent answer. Consistent improvement pattern across various LLMs and state-of-the-art benchmarks further confirms RE-Tab ’s generalisability. 1 1 1 The repository is available at https://github.com/ThomasK1018/RE_Tab . 1 Introduction Tabular data is a prevalent modality for storing and acting on structured information, widely used in healthcare, finance, and marketing ( 44 ; 21 ) . Table Question Answering (‘TableQA’) therefore serves as a practical interface between raw records and decision making. Recent Large Language Models (‘LLM’s) have achieved strong TableQA performance by integrating in-context learning ( 5 ; 46 ; 40 ) , Chain-of-Thought prompting ( 7 ; 64 ) , and agentic frameworks ( 62 ; 63 ) to support multi-turn table reasoning. A common execution pattern is a state-transition loop \texttt{Table}\rightarrow\texttt{Action}\rightarrow\texttt{New Table}, which resonates with state transition in world-model reasoning ( 58 ; 55 ) , with each intermediate table functioning as an explicit state. However, under this paradigm, actions are often executed without explicit step-level feedback about their quality. Without such feedback, table agents struggle to reflect on intermediate decisions. They may fail to identify suboptimal actions early, and errors can compound across turns. In the worst case, missing an optimal intermediate state (Figure 1 ) leads to continual state exploration and ultimately incorrect answers. Although post-hoc correction methods such as graph-based refinement ( 62 ) and test-time scaling ( 63 ) have been explored, they rely heavily on LLM internal signals and remain fragile in multi-hop TableQA, hence highlighting the importance of explicit reward feedback in tabular reasoning. Figure 1 : Illustration of the comparison between (a) Tabular agent without rewards (Chain-of-Tables ( 54 ) ), (b) VLM agent with world model rewards (VAGEN ( 52 ) ), and (c) Our proposed RE-Tab . Given a complex table where the score is embedded in the form of box score text, (a) retrieves correctly but lacks an explicit reward to reason correctly; (b) provides correct reasoning but falls short in accurately retrieving the table; (c) RE-Tab iteratively provides verifiable reward as feedback to the agent to evaluate transformation correctness, and conducts multiple thought processes to search for the most rewarded answer, allowing consistent improvements in both reasoning and retrieval tasks. Reward modeling is a standard ingredient for guiding world-model reasoning in other modalities ( 1 ; 31 ; 43 ) , but it does not transfer naturally to tables. Human-feedback rewards ( 35 ) are difficult to scale in tabular settings due to weak preference signals and costly, inconsistent annotations ( 61 ) . While verifiable rewards appear promising, existing formulations remain inadequate for TableQA. First, many require substantial manual engineering which limits scalability. Second, stepwise rewards from other modalities often rely on semantic similarity (e.g., CLIPScore ( 12 ) or cosine similarity ( 45 ) ), which fails to respect heterogeneous schemas and structural constraints. In tables, even a single cell error can disrupt row or column distributions and break schema fidelity, leading to unreliable reasoning (Figure 1 ). Third, embedding-based similarity require length truncation if input exceeds embedding model limitations ( 69 ; 66 ) , which directly destroys tabular structure and causes both semantic and structural information loss. These limitations motivate rewards tailored to tabular structure rather than generic semantic proximity. Since generic similarity rewards fail to reflect tabular structure, a suitable stepwise reward for TableQA should evaluate intermediate table states with respect to the query itself. This leads to our core question: “Is the current table sufficient to address the query?” We argue that sufficiency hinges on two complementary criteria: (1) Lexical Coverage : Does the current table contain the crucial information required by the query?, (2) Precision : Does the table state remain minimal, retaining only information necessary for computing the answer? and (3) Structural Integrity : Does evaluation preserve the full table structure? Motivated by these criteria, we extend ROUGE ( 23 ) to tabular data, using the Longest Common Subsequence (‘LCS’) component to capture coverage, and unigram-length behavior to quantify precision, thereby formulating TabROUGE . TabROUGE constitutes the backbone of RE-Tab , a lightweight, training-free framework that introduces world-model-style reasoning into tabular agents. First, during State Transition , TabROUGE provides turn-by-turn feedback for evaluating the quality of each action through its effect on the intermediate table state. Second, through Simulative Reasoning , the agent generates multiple candidate trajectories, and TabROUGE supports trajectory evaluation and selection before final answer inference. By introducing an explicit, structure-aware reward that is query-grounded and training-free, RE-Tab aims to make multi-turn TableQA both more reliable and more efficient. All in all, we make three key contributions: 1. A novel table-to-query relevance metric. We introduce TabROUGE , a tabular reward for evaluating intermediate table states with respect to the query, together with theoretical analysis of metric robustness (Section 3 ); 2. A plug-and-play, training-free framework for TableQA. Built on TabROUGE , RE-Tab augments existing TableQA paradigms with explicit feedback and trajectory selection, improving performance while reducing token generation costs (Section 4 ); and 3. Generalizable empirical validation. Incorporating RE-Tab yields consistent improvements across both open- and closed-source LLMs on multiple state-of-the-art TableQA datasets (Section 4 ). 2 Related Work 2.1 TableQA TableQA requires understanding structured tables to infer answers ( 22 ; 6 ) . Early approaches relied on semantic parsing and pre-training ( 17 ; 18 ) , while recent advances with LLMs and VLMs enable more complex reasoning ( 36 ; 19 ; 70 ) . Modern methods emphasize symbolic and multi-step reasoning, integrating executable programs with QA generation ( 7 ; 65 ) and retrieval-augmented strategies ( 24 ; 56 ) . Sequential Planning frameworks iteratively transform tables using predefined tools ( 67 ; 54 ) , whereas Compositional Planning decomposes queries into subproblems ( 51 ; 64 ; 16 ) , with additional enhancements in decomposition and causal analysis ( 15 ; 62 ; 63 ) . Search-based methods employ Monte Carlo Tree Search ( 47 ) and process-supervised rewards ( 20 ; 68 ) , with progressive verification for multi-step reasoning (

Read the complete text