Who Wrote This Line? Evaluating the Detection of LLM-Generated Classical Chinese Poetry

Jiang Li, Tian Lan, Shanshan Wang, Dongxing Zhang, Dianqing Lin, Guanglai Gao, Derek F. Wong, Xiangdong Su · 2026

Read Who Wrote This Line? Evaluating the Detection of LLM-Generated Classical Chinese Poetry by Jiang Li, Tian Lan, Shanshan Wang, Dongxing Zhang, Dianqing Lin, Guanglai Gao, Derek F. Wong, Xiangdong Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10101.txt.

Description

Li and seven colleagues build ChangAn, a benchmark for telling human-written classical Chinese poetry from poems generated by language models, a hard task given strict meter, shared imagery, and flexible syntax. The set holds 30,664 poems, with 10,276 human-written and 20,388 produced by four popular models. A systematic test of 12 detectors across text lengths and generation strategies finds current Chinese detectors unreliable for this poetry, confirming the need for a dedicated benchmark.

Catalog record

CREATORJiang Li, Tian Lan, Shanshan Wang, Dongxing Zhang, Dianqing Lin, Guanglai Gao, Derek F. Wong, Xiangdong Su
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50474
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10101

Browse the full library · About the Tower of Babel