Exploring the Necessity of Reasoning in LLM-based Agent Scenarios
Xueyang Zhou, Guiyao Tie, Guowen Zhang, Weidong Wang, Zhigang Zuo, Di Wu, Duanfeng Chu, Pan Zhou, Neil Zhenqiang Gong Lichao Sun · 2025
Read Exploring the Necessity of Reasoning in LLM-based Agent Scenarios by Xueyang Zhou, Guiyao Tie, Guowen Zhang, Weidong Wang, Zhigang Zuo, Di Wu, Duanfeng Chu, Pan Zhou, Neil Zhenqiang Gong Lichao Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11074.txt.
Description
Xueyang Zhou, Guiyao Tie, Guowen Zhang, and seven colleagues ask when AI agents actually need deep reasoning, in this two thousand twenty-five paper. Large reasoning models, trained to think at length, are disrupting agent frameworks built around faster, execution-oriented language models. The authors built LaRMA, a testbed of nine tasks spanning tool usage, plan design, and problem solving. Three top standard models and five leading reasoning models were compared across it.
Reasoning models won on reasoning-heavy tasks like plan design, where iterative reflection pays off. Standard models won on execution-driven tool usage, where speed matters more. Hybrid setups, a standard model acting with a reasoning model reflecting, gave the best overall balance. The catch is cost: reasoning models take longer, spend more compute, and sometimes overthink or ignore facts. The study maps where deep thinking helps agents and where it hurts.
Catalog record
| CREATOR | Xueyang Zhou, Guiyao Tie, Guowen Zhang, Weidong Wang, Zhigang Zuo, Di Wu, Duanfeng Chu, Pan Zhou, Neil Zhenqiang Gong Lichao Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 177 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11074