CORE-T: COherent REtrieval of Tables for Text-to-SQL

Hassan Soliman, Vivek Gupta, Dan Roth, Iryna Gurevych · 2026

Read CORE-T: COherent REtrieval of Tables for Text-to-SQL by Hassan Soliman, Vivek Gupta, Dan Roth, Iryna Gurevych (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13111.txt.

Introduction

Hassan Soliman, Vivek Gupta, Dan Roth, and Iryna Gurevych tackle a choke point in text to SQL work. In such work a plain text query must turn into a database query. Real tasks often need to join many tables at once. Picking the right set of tables thus sets the score of the whole chain.

The team studies an open book case. Queries must be met from huge mixed pools of tables drawn from many sources. No clean tag marks which source a query needs. Their method, CORE-T, aims to pull the right tables as one linked set, not one by one. For data teams, sharp table picks cut wrong joins and bad answers.

Catalog record

CREATORHassan Soliman, Vivek Gupta, Dan Roth, Iryna Gurevych
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13111

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CORE-T: COherent REtrieval of Tables for Text-to-SQL Hassan Soliman, Vivek Gupta, Dan Roth, Iryna Gurevych Abstract Realistic text-to-SQL workflows often require joining multiple tables. As a result, accurately retrieving the relevant set of tables becomes a key bottleneck for end-to-end performance. We study an open-book setting where queries must be answered over large, heterogeneous table collections pooled from many sources, without clean scoping signals such as database identifiers. Here, dense retrieval (DR) achieves high recall but returns many distractors, while join-aware alternatives often rely on extra assumptions and/or incur high inference overhead. We propose CORE-T , a scalable, training-free framework that enriches tables with LLM-generated purpose metadata and pre-computes a lightweight table-compatibility cache. At inference time, DR returns top- K K candidates; a single LLM call selects a coherent, joinable subset, and a simple additive adjustment step restores strongly compatible tables. Across Bird , Spider , and MMQA , CORE-T improves table-selection F1 by up to 22.7 points while retrieving up to 42% fewer tables, improving multi-table execution accuracy by up to 5.0 points on Bird and 6.9 points on MMQA , and using 4 4 – 5 × 5\times fewer tokens than LLM-intensive baselines. 1 1 1 Our code and data are available at https://github.com/UKPLab/arxiv2026-core-t . 1 Introduction Natural language interfaces to structured data (text-to-SQL) aim to let non-experts query relational tables in everyday language ( Yu et al. 2018 ; Li et al. 2023 ) . A common paradigm is to (i) retrieve relevant tables from a large corpus and then (ii) generate SQL conditioned on those retrieved tables. Since the SQL generator can only reason over what is retrieved, table retrieval is a critical bottleneck. Figure 1: Querying setups. Top: Closed-book: each query targets a known database. Bottom: Open-book: queries must be answered over integrated clusters of tables spanning various domains pooled from multiple database schemas. Most prior text-to-SQL and table-retrieval work assumes a closed-book setting, where the target database (or schema graph) is known and retrieval is confined to a small schema ( Yu et al. 2018 ; Lee et al. 2021 ; Li et al. 2023 ; Zhong et al. 2017 ; Herzig et al. 2021 ; Chen et al. 2020 ; Wang et al. 2022 ) . In contrast, data-lake and semantic join discovery research focuses on open-book analytics over large, heterogeneous table collections, where the system must discover relevant and joinable tables without a predefined schema graph ( Zhu et al. 2019 ; Nargesian et al. 2019 ; Zhang and Ives 2020 ; Cong et al. 2023 ) . This setting mirrors open-book text-to-SQL in integrated enterprise corpora, where tables are pooled across sources and database identifiers are unavailable. In real deployments, business intelligence workloads often require multiple tables to answer a single question (89% of models are multi-table; 4.8 tables on average) ( Lai et al. 2025 ) . Because organizations normalize data and split it across related tables, retrieval must return a set of tables that is both relevant and joinable . Figure 1 illustrates why this becomes challenging in heterogeneous table collections. In a scoped (closed-book) setting ( top ), queries such as “How many art museums charge no admission fee?” can be answered within a clearly delimited database schema (e.g., museums vs. university). In contrast, in an open-book setting ( bottom ), tables from multiple domains are pooled together, and the retriever must identify the correct subset for a query like “How many university buildings were constructed after 2010?” amid many similarly named or semantically overlapping tables. For example, a table about buildings could appear in both the museums and university table collections of the corpus; when the corpus is integrated, the retriever must disambiguate these candidates based on their attributes and relationships, without relying on clean scoping signals such as database identifiers (e.g., db_id = museums vs. db_id = university ). This open-book setup introduces a joinability challenge that directly affects end-to-end correctness. First, multi-table queries are brittle: missing even one required table can break the join path and make SQL generation fail, even if other relevant tables were retrieved. Second, distractors are strong: irrelevant but similar-looking tables can appear highly relevant in isolation, yet lead to incompatible joins or spurious joins, confusing the SQL generator. Therefore, high recall alone is insufficient; retrieval must also produce compact, coherent, join-consistent table sets. Figure 2: Overview. CORE-T combines offline table enrichment and compatibility caching with a lightweight online pipeline: DR, single-shot LLM selection, and a small additive adjustment. Existing multi-table retrievers only partially resolve this tension. Dense retrieval (DR) ( Karpukhin et al. 2020 ) and a reranked DR variant (DRR) scale well to large corpora, but remain join-agnostic and can still surface many near-duplicate or spurious candidates. Agentic approaches such as ReAct ( Yao et al. 2023 ) can iteratively expand evidence, but often require multiple LLM calls. Join-aware methods such as JAR and ARM ( Chen et al. 2024 ; Chen et al. 2025c ) incorporate relational structure via combinatorial selection, but rely on additional scoping assumptions ( db_id ) and/or may incur substantial inference overhead. We therefore seek a scalable , join-aware retriever for open-book table collections that returns a small, join-coherent schema slice for SQL generation. In our problem setting, we assume an open-book corpus of tables pooled across sources, with no db_id and no gold foreign keys. In summary, we contribute: • Training-free, scalable join-aware table retrieval. We propose CORE-T , which enriches tables with LLM-generated purpose metadata and leverages an offline compatibility cache to approximate joinability, and performs a single LLM selection pass plus a lightweight additive adjustment step over initially retrieved top- K candidates. • Improved precision/F1 and efficiency. We present an empirical comparison against DR, DRR, ReAct, and recent SOTA methods (JAR/ARM) under pooled multi-database evaluation on Bird , Spider , and MMQA ( Yu et al. 2018 ; Li et al. 2023 ; Wu et al. 2025 ) . CORE-T improves the precision–recall balance for multi-table retrieval, returning more coherent table sets for SQL generation while reducing LLM usage (up to \sim 5 \times fewer tokens than heavier multi-draft generation methods, e.g., ARM). 2 Overview Figure 2 provides a high-level overview of CORE-T. We delegate schema understanding into offline enrichment and caching, and keep online inference lightweight. Offline. We enrich tables with brief purpose metadata and build a dense index over the enriched table representations, following offline index enrichment ( Chen et al. 2025b ) . In parallel, we pre-compute a table–table compatibility cache that approximates joinability and provides candidate join edges. Online. Given a query, DR returns a small top- K candidate set. A single LLM call then selects a coherent, connected subset using the candidates and cached compatibility evidence, and a lightweight additive adjustment step recovers strongly compatible tables from the original top- K set before SQL generation. 3 Methodology We propose a scalable, join-aware multi-table retriever for open-book text-to-SQL, where tables from multiple DBs are pooled, and the system must retrieve relevant, joinable tables without db_id s or gold foreign keys. Let \mathcal{T}=\{t_{1},\ldots,t_{N}\} be the unified table corpus. Given a query q , we output a table set S(q)\subseteq\mathcal{T} that balances high gold-table recall with fewer irrelevant tables,

Read the complete text