Com 2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models

Kai Xiong, Xiao Ding, Yixin Cao, Yuxiong Yan, Li Du, Yufei Zhang, [-.05cm] Jinglong Gao, Jiaqian Liu, Bing Qin, Ting Liu, [-.05cm] Research Center for Social Computing and Interactive Robotics[-.06cm]Harbin Institute of Technology, Harbin, China, [-.06cm] Institute of Trustworthy Embodied AI, Fudan · 2025

Read Com 2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models by Kai Xiong, Xiao Ding, Yixin Cao, Yuxiong Yan, Li Du, Yufei Zhang, [-.05cm] Jinglong Gao, Jiaqian Liu, Bing Qin, Ting Liu, [-.05cm] Research Center for Social Computing and Interactive Robotics[-.06cm]Harbin Institute of Technology, Harbin, China, [-.06cm] Institute of Trustworthy Embodied AI, Fudan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07064.txt.

Description

Kai Xiong and co-authors build a 2025 test set for the kind of everyday reasoning that chains many small causes. Language models ace plain facts but stumble on long, hidden chains of cause and effect. Their benchmark, named Com2, grows test cases from graphs of events and their causes.

They twist the graphs with causal tools to forge fresh scenes, then let a model draft cases that call for slow, step-wise thought. A harder subset hides the chains inside detective tales. Top models still lacked depth and breadth, though extra training and slow thought helped. The set gives the field a sterner yardstick.

Catalog record

CREATORKai Xiong, Xiao Ding, Yixin Cao, Yuxiong Yan, Li Du, Yufei Zhang, [-.05cm] Jinglong Gao, Jiaqian Liu, Bing Qin, Ting Liu, [-.05cm] Research Center for Social Computing and Interactive Robotics[-.06cm]Harbin Institute of Technology, Harbin, China, [-.06cm] Institute of Trustworthy Embodied AI, Fudan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07064

Browse the full library · About the Tower of Babel