HoWToBench: Ho listic Evaluation for LLM’s Capability in Human-level W riting using T ree o f Writing

Andrew Zhuoer Feng, Cunxiang Wang, Yu Luo, Lin Fan, Yilin Zhou, Zikang Wang, Xiaotao Gu, Jie Tang, Hongning Wang, Minlie Huang Department of Computer Science and Technology, Tsinghua University, Z.ai {fze22, aihuang}@[email protected] · 2026

Read HoWToBench: Ho listic Evaluation for LLM’s Capability in Human-level W riting using T ree o f Writing by Andrew Zhuoer Feng, Cunxiang Wang, Yu Luo, Lin Fan, Yilin Zhou, Zikang Wang, Xiaotao Gu, Jie Tang, Hongning Wang, Minlie Huang Department of Computer Science and Technology, Tsinghua University, Z.ai {fze22, aihuang}@[email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19071.txt.

Introduction

Feng and nine colleagues propose Tree-of-Writing for LLM writing judgment, plus HoWToBench, a large Chinese writing benchmark. Traditional metrics and judge methods underassess thousand word open ended writing. Tree-of-Writing models sub-feature weights explicitly, resolving judge aggregation inconsistency. HoWToBench spans 12 genres and 1302 instructions across completion, outline writing, and open ended generation. It mitigates biases, reaching 0.93 Pearson correlation with human judgments. Overlap metrics and judge practices prove vulnerable to disturbances, while it stays robust. Longer inputs mean lower content scores in the Guide task.

Catalog record

CREATORAndrew Zhuoer Feng, Cunxiang Wang, Yu Luo, Lin Fan, Yilin Zhou, Zikang Wang, Xiaotao Gu, Jie Tang, Hongning Wang, Minlie Huang Department of Computer Science and Technology, Tsinghua University, Z.ai {fze22, aihuang}@[email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE196229
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19071

Browse the full library · About the Tower of Babel