Improving Table Retrieval with Question Generation from Partial Tables
Hsing-Ping Liang, Che-Wei Chang, Yao-Chung FanDepartment of Computer Science and Engineering,National Chung Hsing University, Taiwan [email protected] · 2025
Read Improving Table Retrieval with Question Generation from Partial Tables by Hsing-Ping Liang, Che-Wei Chang, Yao-Chung FanDepartment of Computer Science and Engineering,National Chung Hsing University, Taiwan [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06168.txt.
Introduction
Hsing-Ping Liang, Che-Wei Chang, and Yao-Chung Fan present a 2025 paper on answering questions over tables. Systems first fetch the right table, then read it to form an answer. Past work polished the reading step and the query side, while the table side of the match got little care.
The method asks a language model to invent likely questions from small slices of each table. Those invented questions are stored beside the slices in the search index. A user query then matches table slices through the invented questions that mimic real asking. Whole tables never need to be embedded, which keeps the index light. Scores rose across several benchmarks for two kinds of retrievers.
Catalog record
| CREATOR | Hsing-Ping Liang, Che-Wei Chang, Yao-Chung FanDepartment of Computer Science and Engineering,National Chung Hsing University, Taiwan [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06168
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Table Retrieval with Question Generation from Partial Tables Hsing-Ping Liang, Che-Wei Chang, Yao-Chung FanDepartment of Computer Science and Engineering,National Chung Hsing University, Taiwan [email protected] Abstract Recent advances in open-domain question answering over tables have widely adopted large language models (LLMs) under the Retriever-Reader architecture. Prior works have effectively leveraged LLMs to tackle the complex reasoning demands of the Reader component, such as text-to-text, text-to-SQL, and multi-hop reasoning. In contrast, the Retriever component has primarily focused on optimizing the query representation—training retrievers to retrieve relevant tables based on questions, or to select keywords from questions for matching table segments. However, little attention has been given to enhancing how tables themselves are represented in embedding space to better align with questions. To address this, we propose QGpT (Question Generation from Partial Tables), a simple yet effective method that uses an LLM to generate synthetic questions based on small portions of a table. These questions are generated to simulate how a user might query the content of the table currently under consideration. The generated questions are then jointly embedded with the partial table segments used for generation, enhancing semantic alignment with user queries. Without the need to embed entire tables, our method significantly improves retrieval performance across multiple benchmarks for both dense and late-interaction retrievers. 1 1 1 The code and reconstructed corpora are available at https://github.com/cc3374twa/QGpT 1 Introduction Figure 1: The QGpT pipeline: In the offline stage, top-10 rows from full tables are used to generate synthetic questions via LLM. The questions and table snippets are embedded and stored in the corpus, enhancing retrieval through semantic alignment without encoding full tables. Figure 2: An illustration of three strategies for enriching truncated tables to enhance semantic alignment with the input query: selecting headers, generating table descriptions, and generating synthetic questions. Table-based question answering (Table-QA) has drawn increasing attention in recent years, beginning with early works on Wiki-style tables ( Pasupat and Liang 2015 ; Zhong et al. 2017 ) . These early Table-QA tasks typically operate under the assumption that the relevant table is provided alongside the question. While this assumption simplifies the problem and allows a focused evaluation of reasoning over structured data, it fails to reflect the challenges of real-world open-domain usage scenarios. In practical settings, users do not typically specify which table to consult. Instead, they ask questions in natural language, and the system must first determine which tables might contain the relevant information before reasoning. The assumption of a known target table is thus insufficient in many realistic applications, where the answer may reside in any one of potentially thousands of tables within a large corpus. To address this gap, recent research has moved toward integrating table retrieval into the QA pipeline. This shift is marked by the adoption of Retriever-Reader architectures ( Chen et al. 2017 ) , where a retriever component is responsible for identifying candidate tables, followed by a reader module that performs QA over the retrieved tables. As a pioneering study, NQ-TABLES ( Herzig et al. 2021 ) provides naturally phrased questions and their corresponding answer tables extracted from the Natural Questions dataset ( Kwiatkowski et al. 2019 ) , and transforms TAPAS ( Herzig et al. 2020 ) , a BERT-based table reader, into a dense table retriever (DTR) by adopting the DPR ( Karpukhin et al. 2020 ) training paradigm. Yet another study named CLTR ( Pan et al. 2021 ) integrates the RCI (Row-Column Intersection; Glass et al. 2021 ) model with BM25 ( Robertson et al. 2009 ) for table retrieval, and introduces the E2E-WTQ dataset for RCI retriever fine-tuning. However, studies such as NQ-TABLES and CLTR operate under the assumption that the answer to a question resides in a specific cell within a single, relatively short table. While this setting facilitates controlled evaluation, it significantly limits the generalizability of these approaches to real-world applications, where answering questions often requires reasoning over multiple or lengthy tables. Therefore, MMQA ( Wu et al. 2025 ) extend the Table-QA paradigm by introducing complex reasoning tasks that integrate question answering with Text-to-SQL, using the Spider dataset ( Yu et al. 2018 ) as a foundation. They propose a multi-table retrieval (MTR) setting, in which a single question may require retrieving and reasoning over multiple relevant tables. Their approach decomposes the original query into sub-queries, enabling independent retrieval and re-ranking of candidate tables. Building on the idea of query decomposition, TableRAG ( Chen et al. 2024b ) adopts a similar strategy by splitting questions into schema-level and cell-level components and performing separate retrieval for each. Additionally, it segments tables into schema and content parts, allowing scalable retrieval across corpora with millions of cells, and focuses on retrieving localized table segments to improve efficiency and accuracy. In summary, Table-QA has evolved from simple single-table, short-answer settings ( Pasupat and Liang 2015 ; Zhong et al. 2017 ; Herzig et al. 2021 ; Chen et al. 2020 ) to more complex, multi-table, and reasoning-intensive tasks ( Wu et al. 2025 ; Li et al. 2025 ) . Nevertheless, practical deployment remains challenging due to the growing size and noise of real-world tables. Traditional retrievers ( Robertson et al. 2009 ; Karpukhin et al. 2020 ; Khattab and Zaharia 2020 ) struggle to capture full-table context in token limits, while more recent approaches ( Pan et al. 2021 ; Lin et al. 2023 ; Chen et al. 2024b ) primarily rely on table segmentation based on rows, columns, or schema structures to improve matching between query keywords and table fragments. These methods focus on keyword-level matching rather than learning a semantically rich representation of the table that aligns with user questions. Moreover, they are often bound to dataset-specific assumptions or require retriever fine-tuning ( Pan et al. 2021 ; Lin et al. 2023 ) . To tackle this issue, we propose Question Generation from Partial Tables (QGpT), a simple yet effective table retrieval method for long and complex Table-QA tasks. Our approach requires only a small snippet of the table and leverages LLMs to generate simulated questions that are likely to be asked. These questions are jointly embedded with the partial table snippet, enabling a dense representation with minimal token budget while improving retrieval accuracy. As shown in Figure 1 , QGpT is applied during the offline phase to augment the table corpus. During inference, it can adapt to various retrievers without fine-tuning, and enhances the performance of both dense and late-interaction retrievers ( Chen et al. 2024a ; Jha et al. 2024 ) . Our QGpT framework offers a lightweight and generalizable solution that improves semantic alignment between questions and tables, reduces context size, and maintains retrieval performance in increasingly large and complex table settings. 2 Related Work 2.1 Table Question Answering (TableQA) Early TableQA tasks typically assume the target table is known, focusing on reasoning within a single table. Wiki-TableQuestions ( Pasupat and Liang 2015 ) is a pioneering dataset that provides semi-structured Wikipedia tables with questions involving simple answering. WikiSQL ( Zhong et al. 2017 ) reframes the task as a Text-to-SQL problem, enabling structured query-based answering. Spider ( Yu et al. 2018 ) introduces higher complexity by requiring reasoning over multiple tables and