The Tool-Overuse Illusion: Why Does LLM Prefer External Tools over Internal Knowledge?

Yirong Zeng, Shen You, Yufei Liu, Qunyao Du, Xiao Ding, Yutai Hou, Yuxian Wang, Wu Ning, Haonan Song, Dandan Tu, Bibo Cai, Ting Liu · 2026

Read The Tool-Overuse Illusion: Why Does LLM Prefer External Tools over Internal Knowledge? by Yirong Zeng, Shen You, Yufei Liu, Qunyao Du, Xiao Ding, Yutai Hou, Yuxian Wang, Wu Ning, Haonan Song, Dandan Tu, Bibo Cai, Ting Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19749.txt.

Introduction

Zeng and 11 colleagues reveal tool overuse in language models: the unnecessary use of external tools during reasoning, found across diverse models. They trace the habit to a knowledge epistemic illusion, where models misjudge the bounds of their own internal knowledge and fail to sense what they actually know. The study first maps tool-use behavior across regions of differing internal knowledge availability. To counter it, they propose a knowledge-aware boundary alignment strategy built on direct preference optimization.

Catalog record

CREATORYirong Zeng, Shen You, Yufei Liu, Qunyao Du, Xiao Ding, Yutai Hou, Yuxian Wang, Wu Ning, Haonan Song, Dandan Tu, Bibo Cai, Ting Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56172
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19749

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Tool-Overuse Illusion: Why Does LLM Prefer External Tools over Internal Knowledge? Yirong Zeng, Shen You, Yufei Liu, Qunyao Du, Xiao Ding, Yutai Hou, Yuxian Wang, Wu Ning, Haonan Song, Dandan Tu, Bibo Cai, Ting Liu Abstract Equipping LLMs with external tools effectively addresses internal reasoning limitations. However, it introduces a critical yet under-explored phenomenon: tool overuse, the unnecessary tool-use during reasoning. In this paper, we first reveal this phenomenon is pervasive across diverse LLMs. We then experimentally elucidate its underlying mechanisms through two key lenses: (1) First, by analyzing tool-use behavior across different internal knowledge availability regions, we identify a knowledge epistemic illusion : models misjudge internal knowledge boundaries and fail to accurately perceive their actual knowledge availability. To mitigate this, we propose a knowledge-aware epistemic boundary alignment strategy based on direct preference optimization, which reduces tool usage in by 82.8% while yielding an accuracy improvement. (2) Second, we establish a causal link between reward structures and tool-use behavior by visualizing the tool-augmented training process. It reveals that outcome-only rewards inadvertently encourage tool overuse by rewarding only final correctness, regardless of tool efficiency. To verify this, we balance reward signals during training rather than relying on outcome-only rewards, cutting unnecessary tool calls by 66.7% (7B) and 60.7% (32B) without sacrificing accuracy. Finally, we provide theoretical justification in this two lenses to understand tool overuse. Figure 1 : An overview of tool overuse in LLMs. We provide a systematic investigation into why models invoke external tools unnecessarily. Our analysis reveals that this widespread phenomenon is driven by two primary mechanisms: knowledge epistemic illusion (a miscalibration of internal knowledge) and outcome-only rewards (optimization biases during training). 1 Introduction Large Language Models (LLMs) can significantly improve their reasoning capabilities by interacting with external tools, a paradigm known as tool-integrated reasoning (TIR) ( 28 ; 6 ) . It represents a promising frontier to transcend their internal knowledge boundaries ( 3 ; 2 ) , and solve problems that are infeasible through text-only reasoning. However, TIR also raises a critical problem, i.e., LLMs often overuse tools in problem-solving. Tool overuse refers to calling external tools in unnecessary context, such as calling irrelevant tools or executing actions that the model’s parametric knowledge could resolve internally. Such behaviors directly incur avoidable resource consumption, and yield no information gain ( 21 ) . Recent research extensively employs tools to enhance complex problem-solving; however, the underlying mechanisms and systematic impacts of tool overuse have not be unexplored. In this paper, we present the first investigation of the tool overuse problem and elucidate its underlying mechanisms (see Figure 1 ). We begin by quantifying the prevalence of this phenomenon across diverse models (e.g., frontier, OSS and RLVR-trained 1 1 1 Reinforcement Learning with Verifiable Rewards, a mainstream train approach to enhancing tool-integrated reasoning. LLMs), finding an average of 0.93 unnecessary tool calls per query that requires no external assistance. Crucially, enabling tool use leads to a 3.29\sim 14.48\% drop in accuracy on questions solvable using internal knowledge alone. Finally, through the following two analyses, we demystify the mechanisms driving this behavior and offer actionable insights for mitigation: Firstly, we measure internal knowledge availability via avg@1024 (i.e., the average accuracy in 1,024 independently inference per sample) and analyze tool-use behavior across knowledge regimes. Our analysis reveals knowledge epistemic illusion, where models fail to perceive the actual internal knowledge availability. Moreover, we observe higher internal knowledge availability does not lead to fewer tool calls. For instance, Qwen3-8B averages 2.2 tool calls per query even in high-knowledge regions (e.g., avg@1024>0.8 ). They effectively hallucinate having reached the boundary of their internal knowledge. To bridge this gap, we construct preference pairs that yield correct answers with minimal against excessive tool usage. By employing knowledge-aware direct preference optimization, we align the model’s perceived boundaries with its actual capabilities. This strategy mitigates the tool-overuse problem of 32B-scale model by 82.8% while yielding a 3% improvement in response accuracy. Secondly, recent research primarily focused on applying RLVR to enhance the tool-use capabilities of LLMs ( 15 ) , which successfully improve task accuracy via outcome-driven rewards ( 1 ; 16 ; 28 ) . However, our analysis reveals that outcome-only rewards act as a misleading incentive, inadvertently reinforcing the model’s tool overuse illusion. Specifically, we observe that the tool overuse problem worsens progressively as training steps increase, ultimately reaching a 65% increase in tool call turns. To support this observation experimentally, we propose a reward strategy that balances outcome correctness and tool efficiency by perceiving model’s capability ceiling through large inter-group sampling size during rollouts. Results on mathematical reasoning benchmarks demonstrate that our strategy reduces tool-call turns by 66.7% for the 7B model and 60.7% for the 32B model, while maintaining the response accuracy. Besides, we provide a theoretical proof to substantiate these two mechanisms, offering a comprehensive framework for understanding and mitigating tool overuse in LLMs. Overall, this study provides a deep understanding of tool overuse, yielding mechanistic insights for building reliable tool-augmented LLMs. 2 Preliminaries 2.1 Problem Formulation We formulate the tool-integrated reasoning process as a partially observable markov decision process, denoted as a tuple \langle\mathcal{S},\mathcal{A},P,R,\Omega,O\rangle . At each time step t , the agent receives an observation history h_{t} and selects an action a_{t} from the action space \mathcal{A} . Hybrid Action Space. Distinct from standard language modeling, the action space \mathcal{A}=\mathcal{A}_{\text{gen}}\cup\mathcal{A}_{\text{tool}} comprises two disjoint sets: • Generation Actions ( \mathcal{A}_{\text{gen}} ): Tokens from the vocabulary \mathcal{V} used for internal reasoning or generating final responses. • Tool Actions ( \mathcal{A}_{\text{tool}} ): A set of predefined APIs. An action a_{t}\in\mathcal{A}_{\text{tool}} involves generating a structured call c_{t}=(\text{func\_name},\text{args}) . Tool Overuse . Tool overuse refers to the phenomenon where LLMs perform tool actions a_{t}\in\mathcal{A}_{\text{tool}} unnecessarily within the decision-making process, specifically when the internal parametric knowledge is sufficient to derive the correct answer, or when the tool call provides no information gain. Taxonomy . We formally define two modes of overuse that hinder efficient reasoning: (1) Redundant usage, the model delegates trivial tasks to external tools despite possessing sufficient parametric knowledge. This behavior introduces unnecessary latency and dependency. (2) Irrelevant usage, the model hallucinates tool capabilities to compensate for reasoning gaps, invoking irrelevant tools. This yields no informational gain and further increases context burden. 2.2 RLVR Algorithms Reinforcement Learning with Verifiable Rewards (RLVR) has established itself as a paradigm for endowing LLMs with robust tool-integrated reasoning capabilities. By optimizing against outcome-oriented signals, RLVR enables models to explore and consolidate complex decision-making paths that are often missed in supervised learning. In this work, we adopt the DAPO algorithm ( 31 ) , a state-of-the-art RL framework designed for large-scale reasoning tasks. DAPO enhances the standard Group Relative Policy Optimization (GRPO ( 9 ) ) by introducing four key techniques, e.g., Decoupled Clipping and Dynamic Sampling , which effectively mitigate entropy collapse and stabilize policy updates in long-CoT scenarios. The algorithm details and hyperparameter settings are provided in Appendix Section C.1 . Table 1 : Evaluation of reasoning capabilities and tool-integration efficiency on GSM8K test benchmark. We report the average@8 accuracy and tool-use frequency across simple and complex samples of each LLM. \spadesuit denotes frontier models accessing by API, \heartsuit denotes RLVR-Trained models in TIR, \clubsuit denotes OSS

Read the complete text