Rationality Check! Benchmarking the Rationality of Large Language Models
Zhilun Zhou, Jing Yi Wang, Nicholas Sukiennik, Chen Gao, Fengli Xu, Yong Li, James Evans · 2025
Read Rationality Check! Benchmarking the Rationality of Large Language Models by Zhilun Zhou, Jing Yi Wang, Nicholas Sukiennik, Chen Gao, Fengli Xu, Yong Li, James Evans (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14546.txt.
Introduction
Zhilun Zhou and six co-authors benchmark the rationality of large language models in 2025, across both thinking and acting. Models now simulate people and assist decisions widely, raising a plain question: do they reason and choose as rational agents should? Rationality has theoretical and practical sides.
Their benchmark is presented as the first omnibus test of model rationality across many domains. It probes consistency of beliefs, preference logic and decision quality under varied framings. Multiple leading models are compared on the same suite. Human like fluency can mask systematic irrationality, such as framing effects or inconsistent trade offs. A shared rationality scorecard helps buyers and researchers see where a model can be trusted as a simulated or advising agent.
Catalog record
| CREATOR | Zhilun Zhou, Jing Yi Wang, Nicholas Sukiennik, Chen Gao, Fengli Xu, Yong Li, James Evans |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-14546
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rationality Check! Benchmarking the Rationality of Large Language Models Zhilun Zhou, Jing Yi Wang, Nicholas Sukiennik, Chen Gao, Fengli Xu, Yong Li, James Evans Abstract Large language models (LLMs), a recent advance in deep learning and machine intelligence, have manifested astonishing capacities, now considered among the most promising for artificial general intelligence. With human-like capabilities, LLMs have been used to simulate humans and serve as AI assistants across many applications. As a result, great concern has arisen about whether and under what circumstances LLMs think and behave like real human agents. Rationality is among the most important concepts in assessing human behavior, both in thinking ( i.e. , theoretical rationality) and in taking action ( i.e. , practical rationality). In this work, we propose the first benchmark for evaluating the omnibus rationality of LLMs, covering a wide range of domains and LLMs. The benchmark includes an easy-to-use toolkit, extensive experimental results, and analysis that illuminates where LLMs converge and diverge from idealized human rationality. We believe the benchmark can serve as a foundational tool for both developers and users of LLMs. Our code and dataset can be found at https://github.com/tsinghua-fib-lab/LLM-Rationality-Benchmark 1 Introduction Large Language Models (LLMs) Zhao et al. 2023 represent a significant advancement in the field of artificial intelligence, manifesting human-like capability in natural language processing, understanding, and generation. As emphasized in developmental psychology, language is a primary means through which children form mental models of the world McCall 1977 , constituting one of humanity’s fundamental abilities and a primary tool for interaction with the world. Therefore, besides linguistic abilities, LLMs also exhibit strong performance on complex reasoning and planning tasks, such as solving mathematical problems Romera-Paredes et al. 2023 , playing video games Zhu et al. 2023 , role-playing Shanahan et al. 2023 , etc. This showcases LLMs’ promising potential in many fields as an agent rather than a language model alone Xi et al. 2023 ; Wang et al. 2023b . As a result, LLM agents have been employed as emulators in many fields to simulate human activities Gao et al. 2023a and serve as AI assistants Boiko et al. 2023 ; Huang et al. 2023 . In these contexts, LLMs are utilized in problem-solving and decision-making tasks in place of humans. Nevertheless, the decisions made by LLMs bear immense significance for the stability of human society, particularly in critical domains dealing with personal privacy or security. Insofar as we engaged LLM agents for these tasks, it is critical to ensure they can demonstrate reasonable and responsible beliefs and actions, which motivates our assessment their rationality in this paper. Rationality is an anchoring concept underlying human decision-making and belief, which can be understood as the quality of being guided by reasons or being reasonable Knauff and Spohn 2021 . It typically implies an agent has reflected on the probable consequences of their actions and the goals they were designed to realize. In this way, rationality is a complex concept that involves reasoning, values, and even emotions. Any particular domain’s evaluations or definitions will only cover specific aspects. Nevertheless, it is widely acknowledged that rationality can be divided into theoretical and practical aspects Wahlström 1999 , with the former focusing on whether the internal belief is reasonable, and the latter emphasizing the capacity to make appropriate decisions in real-world contexts. These two folds of rationality are closely related and are both quite essential in assessing the final actions. For LLMs, an extensive evaluation of twofold rationality involves determining whether they have human-like rationality levels in handling real-world decisions or task execution, thereby establishing a solid foundation for safer and more responsible AI applications. Despite its importance, extensively benchmarking the rationality of LLMs remains unexplored. In this work, we take the pioneering step to establish a systematic benchmark for measuring the rationality of various LLMs, covering different domains’ definitions and assessments of rationality. Specifically, we organized the framework into six distinct domains: psychology, cognitive science, decision-making, economics, game theory, and collective rationality. Leveraging widely acknowledged rationality questionnaires from various domains, we conduct comprehensive assessments of the rationality of various LLMs, which encompass both open-source LLMs and commercial API-based models, aiming to extensively cover commonly used models. While it might not encompass all individual rationality measures, our benchmark covers the main subclasses of rationality; thus, for an uncovered measure, we believe it easy to find a suitable substitute or reference results in our benchmark. Overall, our benchmark serves as a fundamental evaluation tool for both developers and users of LLMs. For developers, the benchmark can serve as a reference for optimizing and training models, indicating the position of a model’s rationality and identifying potential areas for further enhancement. For users, our benchmark offers a standardized evaluative system, facilitating assessments of rationality levels within specific usage scenarios. This helps mitigate risks associated with applications utilizing LLMs as crucial AI assistance tools in decision-making. Under our framework for rationality assessment, our experiments have the following findings. First, LLMs demonstrate an overall level of high rationality, particularly evident in larger-scale models that exhibit greater prowess. Second, LLMs show very high collective rationality, showcasing a greater inclination toward cooperation and a more homogeneous AI society compared to human society. Third, LLMs showcased higher levels of rationality in non-abstract scenarios, indicating their capability for understanding and making decisions in real-world scenarios. Furthermore, the results of our benchmark have revealed a multitude of insightful observations across different domains, including exhibiting both similar and widely different responses to humans. Our contribution can be summarized as follows. • We propose a comprehensive taxonomy of rationality evaluation based on extensive literature review, which organizes rationality into individual, interpersonal, and societal levels, covering six domains of rationality research. This taxonomy provides a structured foundation for evaluating rationality from both theoretical and practical perspectives. • Based on this taxonomy, we construct the first benchmark for measuring LLMs’ rationality, including a wide range of questionnaires, tests, and games. • We conduct a detailed assessment of a bundle of renowned LLMs and rationality scales, with extensive analyses of the results, including comparisons with human rationality, inter-domain analysis, theoretical-practical analysis, the impact of training methodologies and model parameters on rationality, and the relationship between individual and collective rationality. We believe that these conclusions hold significant implications for both developers and users of LLMs. 1 1 1 Our employed measurements and code can be found at https://github.com/tsinghua-fib-lab/LLM-Rationality-Benchmark 2 Related Work 2.1 Evaluation of LLMs The most evaluated aspect for LLMs is natural language processing, including natural language understanding Liang et al. 2022 ; Bang et al. 2023 ; Peña et al. 2023 ; Yang and Menczer 2023 ; Lee et al. 2023 and natural language generation Chang et al. 2023 . Additionally, LLM evaluations have expanded to simulations and decision-making contexts, where they act as autonomous agents mimicking human behavior Gao et al. 2023b ; Argyle et al. 2023 ; Li et al. 2023 . While these evaluations provide significant insights into LLM capabilities, the evaluation of rationality, a core component of human cognition, remains underdeveloped. Although some recent studies have started to explored the rationality in LLMs like GPT-4 Macmillan-Scott and Musolesi 2024 , these efforts are limited to test from a single domain