TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice
Gang Hu, Yating Chen, Haiyan Ding, Wang Gao, Jiajia Huang, Min Peng, Qianqian Xie, Kun Yue · 2026
Read TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice by Gang Hu, Yating Chen, Haiyan Ding, Wang Gao, Jiajia Huang, Min Peng, Qianqian Xie, Kun Yue (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08948.txt.
Description
Hu and seven colleagues introduce TaxPraBen, the first benchmark built for language models doing realistic Chinese tax work rather than isolated language tasks. It combines ten standard application tasks with practical exercises graded against Bloom's taxonomy of learning levels. The field is knowledge-heavy and rule-bound, and general models show clear gaps there. Tests of 19 models find large gaps in scores: big closed-source models lead, Chinese models such as Qwen2.5 generally beat rivals in other languages, and a tax-tuned model improves only modestly.
Catalog record
| CREATOR | Gang Hu, Yating Chen, Haiyan Ding, Wang Gao, Jiajia Huang, Min Peng, Qianqian Xie, Kun Yue |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 210786 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.08948