TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice

Gang Hu, Yating Chen, Haiyan Ding, Wang Gao, Jiajia Huang, Min Peng, Qianqian Xie, Kun Yue · 2026

Read TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice by Gang Hu, Yating Chen, Haiyan Ding, Wang Gao, Jiajia Huang, Min Peng, Qianqian Xie, Kun Yue (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08948.txt.

Description

Hu and seven colleagues introduce TaxPraBen, the first benchmark built for language models doing realistic Chinese tax work rather than isolated language tasks. It combines ten standard application tasks with practical exercises graded against Bloom's taxonomy of learning levels. The field is knowledge-heavy and rule-bound, and general models show clear gaps there. Tests of 19 models find large gaps in scores: big closed-source models lead, Chinese models such as Qwen2.5 generally beat rivals in other languages, and a tax-tuned model improves only modestly.

Catalog record

CREATORGang Hu, Yating Chen, Haiyan Ding, Wang Gao, Jiajia Huang, Min Peng, Qianqian Xie, Kun Yue
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE210786
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08948

Browse the full library · About the Tower of Babel