Who Wrote This Line? Evaluating the Detection of LLM-Generated Classical Chinese Poetry
Jiang Li, Tian Lan, Shanshan Wang, Dongxing Zhang, Dianqing Lin, Guanglai Gao, Derek F. Wong, Xiangdong Su · 2026
Read Who Wrote This Line? Evaluating the Detection of LLM-Generated Classical Chinese Poetry by Jiang Li, Tian Lan, Shanshan Wang, Dongxing Zhang, Dianqing Lin, Guanglai Gao, Derek F. Wong, Xiangdong Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10101.txt.
Description
Li and seven colleagues build ChangAn, a benchmark for telling human-written classical Chinese poetry from poems generated by language models, a hard task given strict meter, shared imagery, and flexible syntax. The set holds 30,664 poems, with 10,276 human-written and 20,388 produced by four popular models. A systematic test of 12 detectors across text lengths and generation strategies finds current Chinese detectors unreliable for this poetry, confirming the need for a dedicated benchmark.
Catalog record
| CREATOR | Jiang Li, Tian Lan, Shanshan Wang, Dongxing Zhang, Dianqing Lin, Guanglai Gao, Derek F. Wong, Xiangdong Su |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50474 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10101