EntSQL: A Benchmark for Grounding Text-to-SQL in Long-Context Enterprise Knowledge

Chengxi Liao 1,* Tao Xu 2,* Zulong Chen 2, † \dagger Chuanfei Xu 3 Yiyan Wang 2 Xinyun Wang 2 Yanlong Zhang 2 Xiaojun Chen 2 Zhibo Yang 2 Zeyi Wen 1, † \dagger 1 HKUST (GZ) 2 Alibaba Group 3 Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) [email protected] , [email protected] · 2026

Read EntSQL: A Benchmark for Grounding Text-to-SQL in Long-Context Enterprise Knowledge by Chengxi Liao 1,* Tao Xu 2,* Zulong Chen 2, † \dagger Chuanfei Xu 3 Yiyan Wang 2 Xinyun Wang 2 Yanlong Zhang 2 Xiaojun Chen 2 Zhibo Yang 2 Zeyi Wen 1, † \dagger 1 HKUST (GZ) 2 Alibaba Group 3 Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) [email protected] , [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03363.txt.

Description

Liao and co-authors build a benchmark for text-to-SQL in enterprise settings. Language models have raised text-to-SQL skill a lot. Top benchmarks test schema spread, big databases, and real workflows. They mostly skip the enterprise case, where writing SQL needs private business knowledge: inner metrics, reporting habits, and company rules that no schema shows.

Their benchmark, EntSQL, holds 1,066 aligned Chinese-English examples across five business domains. Most items need domain knowledge past the question and schema. Many need complex SQL structures as well. Long business documents are supplied as the knowledge source. On English inputs, the best system tested reached just about 16 percent accuracy with those documents in hand. That low score marks how hard grounding in enterprise knowledge is. The authors offer EntSQL as a test of whether models can read a firm's own papers and write SQL that fits them.

Catalog record

CREATORChengxi Liao 1,* Tao Xu 2,* Zulong Chen 2, † \dagger Chuanfei Xu 3 Yiyan Wang 2 Xinyun Wang 2 Yanlong Zhang 2 Xiaojun Chen 2 Zhibo Yang 2 Zeyi Wen 1, † \dagger 1 HKUST (GZ) 2 Alibaba Group 3 Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) [email protected] , [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03363

Browse the full library · About the Tower of Babel