PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models
Ziliang Zhao, Zenan Xu, Shuting Wang, Hongjin Qian, Yan Lei, Minda Hu, Zhao Wang, Shihan Dou, Zhicheng Dou, Pluto Zhou, Gaoling School of Artificial Intelligence, Renmin University of China, Equal contribution. Corresponding author · 2026
Read PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models by Ziliang Zhao, Zenan Xu, Shuting Wang, Hongjin Qian, Yan Lei, Minda Hu, Zhao Wang, Shihan Dou, Zhicheng Dou, Pluto Zhou, Gaoling School of Artificial Intelligence, Renmin University of China, Equal contribution. Corresponding author (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20873.txt.
Description
Ziliang Zhao and nine colleagues present PlanningBench, a system for generating scalable and checkable planning data. Planning requires coordinating goals, constraints, resources, and lasting consequences into executable, checkable solutions. Existing benchmarks treat planning data as fixed sets. That limits scenario coverage and ties challenge to surface proxies rather than structural roots. It starts from real scenarios and abstracts workflows into a structured taxonomy, a clear map of task types of over 30 task types, subtasks, constraint families, and challenge factors.
Catalog record
| CREATOR | Ziliang Zhao, Zenan Xu, Shuting Wang, Hongjin Qian, Yan Lei, Minda Hu, Zhao Wang, Shihan Dou, Zhicheng Dou, Pluto Zhou, Gaoling School of Artificial Intelligence, Renmin University of China, Equal contribution. Corresponding author |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 112341 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20873