Track-SQL: Enhancing Generative Language Models with Dual-Extractive Modules for Schema and Context Tracking in Multi-turn Text-to-SQL

Bingfeng Chen, Shaobin Shi, Yongqi Luo, Boyan Xu, Ruichu Cai, Zhifeng Hao · 2026

Read Track-SQL: Enhancing Generative Language Models with Dual-Extractive Modules for Schema and Context Tracking in Multi-turn Text-to-SQL by Bingfeng Chen, Shaobin Shi, Yongqi Luo, Boyan Xu, Ruichu Cai, Zhifeng Hao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05996.txt.

Introduction

Chen and team propose Track-SQL, boosting making models with dual-pulling modules tracking schema and context in multi-turn Text-to-SQL. Making models show promise in single-turn Text-to-SQL, but not as much in multi-turn settings, from weakness handling context and dynamic schema linking. Track-SQL adds a Meaning-boosted Schema Puller and a Schema-aware Context Puller. Tests show state-of-the-art scores on SparC and CoSQL. Cut-out studies reveal improved multi-turn running score by 7.1 percent and above 9 percent in turn.

Catalog record

CREATORBingfeng Chen, Shaobin Shi, Yongqi Luo, Boyan Xu, Ruichu Cai, Zhifeng Hao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63688
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05996

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Track-SQL: Enhancing Generative Language Models with Dual-Extractive Modules for Schema and Context Tracking in Multi-turn Text-to-SQL Bingfeng Chen, Shaobin Shi, Yongqi Luo, Boyan Xu, Ruichu Cai, Zhifeng Hao Abstract Generative language models have shown significant potential in single-turn Text-to-SQL. However, their performance does not extend equivalently to multi-turn Text-to-SQL. This is primarily due to generative language models’ inadequacy in handling the complexities of context information and dynamic schema linking in multi-turn interactions. In this paper, we propose a framework named Track-SQL, which enhances generative language models with dual-extractive modules designed to track schema and contextual changes in multi-turn Text-to-SQL. Specifically, Track-SQL incorporates a Semantic-enhanced Schema Extractor and a Schema-aware Context Extractor . Experimental results demonstrate that Track-SQL achieves state-of-the-art performance on the SparC and CoSQL datasets. Furthermore, detailed ablation studies reveal that Track-SQL significantly improves execution accuracy in multi-turn interactions by 7.1% and 9.55% on these datasets, respectively. Our implementation will be open-sourced at https://github.com/DMIRLAB-Group/Track-SQL . 1 Introduction Text-to-SQL 29 is a critical semantic parsing task that converts natural language queries into corresponding SQL statements based on a given database schema. While generative language models have demonstrated significant potential in single-turn Text-to-SQL tasks, their performance diminishes in multi-turn scenarios. The challenges in these settings primarily stem from the models’ difficulties in handling the complexities of context information and dynamic schema linking across multiple turns of interaction. However, extractive model to solving these two challenges—schema linking and context utilization—have limitations when directly applied to the generative language model paradigm. The primary limitation in multi-turn Text-to-SQL is the ability to maintain effective schema linking as the dialogue progresses. Although many studies have confirmed that proper schema linking significantly enhances SQL generation, existing approaches struggle to handle the increasing complexity in multi-turn settings. In recent research, RASAT 14 leverages relational self-attention mechanisms to capture the relationships between text and schemas. However, in multi-turn dialogue scenarios, as the number of interactions between the user and the system increases along with the expansion of the database schemas, the scale of the schema linking graph grows, inevitably leading to the issue of redundant links. CQR-SQL 20 rewrites multi-turn dialogues and simplifies schema linking information, which might also result in the loss of critical schema linking details due to over-simplification. TP-Link 11 integrates schema linking prediction into multi-task pre-training to reduce redundant relationships between questions and schemas, but overlooks the problem of semantic inconsistencies between questions and schemas. Moreover, existing schema linking methods are predominantly static, lacking mechanisms to incorporate linking results from prior turns. The key idea to overcome this limitation is to introduce a dynamic updating mechanism that adapts to the evolving dialogue contexts in multi-turn interactions. The secondary limitation in multi-turn Text-to-SQL is their difficulty in managing continuous interactions where users reference or omit prior information, relying on the system to track the evolving context. In recent research, EditSQL 27 uses prior turn SQL queries for predicting current turn queries, but loses effectiveness when dialogue lacks coherence. STaR 1 and CoE-SQL 26 track dependencies via SQL similarity and changes, but lack source record verification, which can lead to error buildup. The key idea to overcome this limitation is to design effective retrieval and verification mechanisms for improving the accuracy and reliability of multi-turn Text-to-SQL. To address these issues, we propose a Track-SQL framework, aimed at solving the problems of dynamic schema linking and context information filtering in multi-turn Text-to-SQL dialogues. First, in the schema extraction phase, we developed a Semantic-enhanced Schema Extractor (SESE) that identifies the user’s current focus schemas by combining changes in user interests with previously extracted signals. At the same time, we introduce a semantic enhancement module to reduce the semantic gap between user questions and schemas, thereby improving the precision of schema linking. Second, in the SQL generation phase, we design a Schema-aware Context Extractor (SACE) module to identify key SQLs from historical records. Then, we combine these with past questions and extracted schemas as input, and fine-tune the text-to-SQL generation model in a supervised manner, with the target output being normalized SQL queries. This approach reduces the difficulty for the generation model to learn schema linking and context information filtering, thus enhancing the accuracy of SQL generation. Additionally, the results from the aforementioned extractors make the basis for the model’s SQL generation more transparent, increasing the explainability of the system. Our contributions are summarized as follows: • We propose the Track-SQL framework, specifically designed for Multi-turn Text-to-SQL tasks. This framework utilizes a Semantic-enhanced Schema Extractor to ensure that the SQL generation model acquires accurate schema information in each dialogue turn. • We have devised a Schema-aware Context Extractor to obtain the most relevant historical SQL queries that fit the current conversational context, thereby enhancing the dialogue history understanding capability and SQL generation accuracy of the generative language model. • We conducted extensive performance evaluations and detailed ablation studies to verify the effectiveness of each component. The Track-SQL framework achieved leading results on the validation sets of two authoritative benchmark datasets, SParC and CoSQL, demonstrating its superior performance and broad applicability. 2 Methodology Figure 1: The overall framework of Dual-Extractive Modules for Schema and Context Tracking. The framework trains a schema item classification model and an SQL generator. Based on the former, we construct a Semantic-enhanced Schema Extractor and a Schema-aware Context Extractor . The extraction results from these two extractors are utilized for subsequent training of the SQL generation model. The core idea of Track-SQL is to reduce the gap between the input and the target SQL before entering the multi-turn SQL generation phase by means of dynamic schema linking and context information extraction. In the multi-turn Text-to-SQL task, the goal is to address the problem of mapping a sequence of multi-turn questions \mathcal{Q}_{\leq m} and database schemas \mathcal{S}=(t_{i},c_{i,n_{i}}) to the target SQL query s_{m} , where t_{i} represents the i^{th} table in the database, and c_{i,n_{i}} denotes the n_{i}^{th} column within t_{i} . This section will provide an overview of the framework designed to solve this problem and delve into its design details. 2.1 Model Overview In multi-turn Text-to-SQL tasks, we decompose two preparatory tasks: Dynamic Schema Linking and Context Information Filtering. Enhancing the performance of the generative language model is achieved through utilizing dual-extractive modules to identify key schema and contextual information. Figure 1 illustrates the overall architecture of the proposed Track-SQL framework, which includes two history information repositories and their corresponding extraction modules, along with a supervised fine-tuned SQL generator. Specifically, during the m^{th} interaction, we input the first m questions and all schema information into Schema Extractor to obtain the probabilities of all schemas for the current question \mathcal{Q}_{m} . Based on these probabilities and using fixed threshold s , we filter and rank the schemas (Section 2.2 ). Additionally, by utilizing the schema probabilities stored in the History Schema Store, we can resolve the coreference relationships between \mathcal{Q}_{m} and \mathcal{Q}_{<m} and select the base SQL from History Question \& SQL Store which applicable to current question (Section 2.3 ). These filtered schemas and base SQL serve together as prompt information and constraints to facilitate the generation of SQL at the m^{th} turn. 2.2 Semantic-enhanced Schema Extractor In the context of multi-turn dialogues involving databases,

Read the complete text