What to Keep and What to Drop: Adaptive Table Filtering Framework

Wonjune Jang · 2025

Read What to Keep and What to Drop: Adaptive Table Filtering Framework by Wonjune Jang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23463.txt.

Introduction

WonJune Jang trims oversized tables so language models can reason over them in this 2025 paper, writing alone. Table questions often hand a model far more rows and columns than its input window holds. Cutting blindly risks dropping the one cell that matters.

The framework filters with the question in mind. It drafts short descriptions of each column, groups similar ones, and scores rows and columns by sparse and dense matching. The pruning drops about seventy percent of cells. Table question answering improves outside the training domain, while fact checking dips slightly where full context counts. The filter bolts onto existing models with no retraining.

Catalog record

CREATORWonjune Jang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23463

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What to Keep and What to Drop: Adaptive Table Filtering Framework Wonjune Jang Abstract Large language models (LLMs) for table-based reasoning often struggle with large tables due to input length limits. We propose ATF (Adaptive Table Filtering Framework), a modular and question-aware filtering pipeline that prunes uninformative columns and rows using LLM-generated column descriptions, clustering, and sparse-dense alignment scores. ATF integrates seamlessly with existing models (e.g., TAPAS, TAPEX) without retraining. Experiments show that ATF reduces table cells by 70%, boosting performance on out-of-domain TableQA tasks while causing slight performance drops on Table Fact Verification, where full-table context is more critical. These results highlight ATF’s ability to adaptively balance informativeness and minimalism across tasks. 1 Introduction Table Question Answering (TableQA) has emerged as a key task in enabling natural language interaction with structured data. Recent advancements increasingly leverage large language models (LLMs OpenAI 2024 ) to interpret semi-structured tables in a flexible, end-to-end fashion Cheng et al. 2023 ; Zhang et al. 2023 . Despite promising progress, current systems continue to face critical limitations, particularly when operating on real-world tables that are lengthy, noisy, or semantically sparse Zhu et al. 2021 . Most notably, TableQA models often lack mechanisms to selectively compress large or noisy tables, instead encoding the entire table regardless of relevance. This leads to inefficiencies in reasoning and a higher risk of hallucinated or inaccurate answers Kweon et al. 2023b ; Wu and Feng 2024 . Prior attempts to mitigate this include retrieval-based subsetting Eisenschlos et al. 2021 and attention-based modeling Herzig et al. 2020 , but these approaches are limited by either weak table-awareness in retrieval or diffuse attention over irrelevant regions. Our proposed framework directly addresses this by incorporating column- and row-level filtering modules that leverage LLMs to assess question-conditioned relevance and explicitly prune irrelevant content prior to answer generation. Another key challenge is the limited interpretability of filtering decisions. While models like ReActable adopt Chain-of-Thought prompting to express intermediate reasoning Zhang et al. 2023 , they do not offer explicit rationales for the inclusion or exclusion of specific table components. In contrast, our method generates natural language explanations for each column and assigns semantic relevance scores Glenn et al. 2024 , enabling transparent, user-auditable filtering and enhancing trustworthiness in downstream reasoning. Furthermore, recent studies have explored the integration of reasoning paths within TableQA pipelines. For example, BINDER Cheng et al. 2023 decomposes table-based queries into latent sub-questions to guide multi-hop reasoning, offering structured pathways for inference. Similarly, recent studies have researched utilize question generation and evidence pinpointing to improve faithfulness Zhang et al. 2023 Seo et al. 2024 . However, even these sophisticated methods rely on fully serialized input tables and do not explicitly address table length constraints or the presence of structural noise. These limitations, as acknowledged by the authors themselves, reduce the robustness and scalability of such systems in complex, real-world environments. In this paper, we aim to compress the tables using a modular filtering framework that determines what to keep and what to drop , retaining only the parts relevant to the question before LLM answers begin. By structurally compressing the table through question-conditioned column and row filters followed by joint filtering we reduce noise, enhance answer accuracy, and support scalable, interpretable TableQA. Our column-level filtering leverages LLMs to assign semantic relevance scores to each column. However, a single-pass scoring approach may suffer from instability across multiple runs due to the inherent variability of LLM outputs. For column-level filtering, we propose a robust multipass scoring mechanism that aggregates LLM-generated scores through average- and standard deviation-based LLM scoring and clustering, improving consistency and reliability. For row-level filtering, we adopt a question–cell fusion strategy that combines both sparse retrieval signals (TF-IDF and BM25 Jones 1972 Robertson and Walker 1994 ) and dense semantic similarities Reimers and Gurevych 2019 , enabling fine-grained and context-aware relevance estimation. Our system is designed with modular orchestration, making it compatible with easy plug-and-play integration into other frameworks. Since our filtering module operates entirely prior to model inference, it can be seamlessly integrated with a wide range of downstream TableQA models—including TAPAS, TURL, SQLova, and even SQL-executing prompt-based LLMs—without requiring architectural changes. This modularity enables flexible deployment and facilitates performance enhancement across different modeling paradigms, regardless of whether they are pre-trained, fine-tuned, or prompt-based. To evaluate our method in both the in-domain (ID) and out-of-domain (OOD) settings, we conducted experiments using WikiTableQuestions (WTQ) as the ID dataset and Open-WikiTable Kweon et al. 2023a and AIT-QA Katsis et al. 2021 as OOD datasets that reflect realistic, noisy, and previously unseen tabular scenarios. The results confirm substantial gains in both performance and robustness, particularly in OOD settings. The main contributions of this work are as follows: • We propose a novel pre-processing framework , ATF (Adaptive Table Filtering), that adaptively prunes table columns and rows based on question relevance, effectively addressing the input token length limitations of Transformer-based TableQA models such as TAPAS and TAPEX. • We empirically demonstrate that ATF can reduce table cells by up to 70% while improving or maintaining performance in out-of-domain TableQA tasks (e.g., Open-WikiTable, AIT-QA), without requiring any additional model fine-tuning or architectural changes. • We show that, even with aggressive filtering, ATF preserves sufficient semantics for reasoning, enabling smaller models like TAPAS-base to match or exceed the performance of larger models like TAPAS-large in certain tasks. • Our findings also highlight a task-specific trade-off: while ATF improves performance in TableQA—where question-relevant signals are often localized—it may slightly degrade accuracy in Table Fact Verification tasks that require full-table context, revealing the potential for task-aware adaptive filtering strategies. 2 Related Work 2.1 Table-Based QA Models Recent approaches in TableQA have sought to improve reasoning over structured data by adapting transformer architectures. TAPAS Herzig et al. 2020 introduced a BERT-based model that performs weakly supervised table parsing by selecting relevant cells and learning aggregation operations. While effective, TAPAS encodes the entire table regardless of question relevance, and relies solely on attention mechanisms, which often fail to suppress semantically irrelevant content—particularly in large or noisy tables. MATE Eisenschlos et al. 2021 explores a novel multi-view attention mechanism that integrates row-wise, column-wise, and question-based perspectives. This multi-view design helps the model focus more precisely on informative table regions. However, these recent studies do not incorporate explicit table filtering and still process the full table as input. Consequently, these models are prone to content dilution and inefficiencies when applied to real-world tables, which often contain irrelevant information. This not only increases the risk of hallucinations during the QA process but also leads to unnecessarily long input sequences that strain the model’s context capacity. 2.2 Approaches for Handling Large and Noisy Tables To address the challenges posed by lengthy and noisy tables, recent TableQA research has explored various strategies that aim to reduce input complexity prior to LLM-based reasoning. These approaches vary in how they structure the filtering and reasoning pipeline, ranging from symbolic decomposition to dynamic, language-driven table transformation. One stream of work emphasizes programmatic decomposition, wherein complex questions are broken down into interpretable sub-operations that are mapped to structured queries such as SQL. This strategy allows systems to filter out irrelevant content early in the pipeline, thereby reducing the reasoning

Read the complete text