Toward Efficient Agents: A Survey of Memory, Tool learning, and Planning

Xiaofang Yang 1 , 2 , † {}^{1,2,\text{\textdagger}} Lijun Li 1 , † , = {}^{1,\text{\textdagger},{{\mbox{=}}}} Heng Zhou 1 , 3 , † {}^{1,3,\text{\textdagger}} Tong Zhu 1 , † {}^{1,\text{\textdagger}} Xiaoye Qu 1 Yuchen Fan 1,4 Qianshan Wei 5 Rui Ye 4 Li Kang 1,4 Yiran Qin 6 Zhiqiang Kou 7 Daizong Liu · 2026

Read Toward Efficient Agents: A Survey of Memory, Tool learning, and Planning by Xiaofang Yang 1 , 2 , † {}^{1,2,\text{\textdagger}} Lijun Li 1 , † , = {}^{1,\text{\textdagger},{{\mbox{=}}}} Heng Zhou 1 , 3 , † {}^{1,3,\text{\textdagger}} Tong Zhu 1 , † {}^{1,\text{\textdagger}} Xiaoye Qu 1 Yuchen Fan 1,4 Qianshan Wei 5 Rui Ye 4 Li Kang 1,4 Yiran Qin 6 Zhiqiang Kou 7 Daizong Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14192.txt.

Introduction

Xiaofang Yang and a large team survey how AI agents can be made more efficient in 2026. Recent years have seen growing interest in extending language models into agentic systems. Agents must remember, use tools, and plan to act well. Each of those skills can waste time, tokens, and compute if done poorly.

Catalog record

CREATORXiaofang Yang 1 , 2 , † {}^{1,2,\text{\textdagger}} Lijun Li 1 , † , = {}^{1,\text{\textdagger},{{\mbox{=}}}} Heng Zhou 1 , 3 , † {}^{1,3,\text{\textdagger}} Tong Zhu 1 , † {}^{1,\text{\textdagger}} Xiaoye Qu 1 Yuchen Fan 1,4 Qianshan Wei 5 Rui Ye 4 Li Kang 1,4 Yiran Qin 6 Zhiqiang Kou 7 Daizong Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE110 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14192

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Toward Efficient Agents: A Survey of Memory, Tool learning, and Planning Xiaofang Yang 1 , 2 , † {}^{1,2,\text{\textdagger}} Lijun Li 1 , † , = {}^{1,\text{\textdagger},{{\mbox{=}}}} Heng Zhou 1 , 3 , † {}^{1,3,\text{\textdagger}} Tong Zhu 1 , † {}^{1,\text{\textdagger}} Xiaoye Qu 1 Yuchen Fan 1,4 Qianshan Wei 5 Rui Ye 4 Li Kang 1,4 Yiran Qin 6 Zhiqiang Kou 7 Daizong Liu 8 Qi Li 5 Ning Ding 9 Siheng Chen 4 Jing Shao 1 , = {}^{1,{{\mbox{=}}}} 1 Shanghai Artificial Intelligence Laboratory, 2 Fudan University, 3 University of Science and Technology of China, 4 Shanghai Jiaotong University, 5 Institute of Automation, Chinese Academy of Sciences, 6 The Chinese University of Hong Kong (Shenzhen), 7 Hong Kong Polytechnic University, 8 Wuhan University, 9 Tsinghua University Abstract Abstract: Recent years have witnessed increasing interest in extending large language models into agentic systems. While the effectiveness of agents has continued to improve, efficiency , which is crucial for real-world deployment, has often been overlooked. This paper therefore investigates efficiency from three core components of agents: memory, tool learning, and planning , considering costs such as latency, tokens, steps, etc. Aimed at conducting comprehensive research addressing the efficiency of the agentic system itself, we review a broad range of recent approaches that differ in implementation yet frequently converge on shared high-level principles including but not limited to bounding context via compression and management, designing reinforcement learning rewards to minimize tool invocation, and employing controlled search mechanisms to enhance efficiency, which we discuss in detail. Accordingly, we characterize efficiency in two complementary ways: comparing effectiveness under a fixed cost budget, and comparing cost at a comparable level of effectiveness. This trade-off can also be viewed through the Pareto frontier between effectiveness and cost. From this perspective, we also examine efficiency oriented benchmarks by summarizing evaluation protocols for these components and consolidating commonly reported efficiency metrics from both benchmark and methodological studies. Moreover, we discuss the key challenges and future directions, with the goal of providing promising insights. † {}^{\text{\textdagger}} Main contributors = {}^{{\mbox{=}}} Corresponding Author Keywords : Agents, Efficiency, Agent Memory, Tool Learning, Planning = Date : January 20th, 2026 = Projects : https://efficient-agents.github.io/ Code Repository : https://github.com/yxf203/Awesome-Efficient-Agents = Contact : [email protected] , [email protected] , [email protected] , [email protected] 1 Introduction Figure 1 : The evolutionary trajectory of efficient agent research. The diagram is organized into four principal branches: Memory , Tool Learning , Planning , and Benchmarks . Key works and their institutional affiliations are mapped chronologically to illustrate the field’s development and categorization from 2023 to 2025. The landscape of Artificial Intelligence has undergone a paradigm shift, evolving from the era of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) to the advent of Large Language Models (LLMs), and the emergence of LLM-based Agents currently [ 53 , 27 , 107 , 44 , 173 , 37 ] . Unlike their predecessors, which primarily focused on perception or static text generation, agentic systems do not merely process information; they actively interact with external environments to execute complex, multi-step workflows across diverse domains, such as autonomous software engineering [ 183 , 166 ] and accelerated scientific discovery [ 161 , 75 , 29 ] . However, this shift toward autonomous action has introduced a critical bottleneck: efficiency . While the deployment of LLMs is already resource-intensive, this challenge is significantly exacerbated in agentic systems. Unlike a standard LLM that typically operates in a linear, single-turn query-response format, an agent consumes exponentially more resources due to its recursive nature. To automate intricate real-world tasks [ 38 , 34 , 82 , 166 ] , agents must perform extensive memory management, iterative tool usage, and complex planning over multiple steps. This multi-step execution leads to prohibitive latency, context window saturation, and excessive token consumption, raising profound concerns regarding the long-term sustainability and equitable accessibility of these increasingly capable systems. To understand the urgency of agent efficiency, one must examine the typical agentic workflow. Upon receiving a user instruction, an agent engages in a recursive loop that heavily uses the following key components: memory, planning, and tool learning to observe output and provide the final solution. \displaystyle\mathrm{Input}\rightarrow\Bigl[\,\underbrace{\mathrm{Memory}}_{\text{Context}}\rightarrow\underbrace{\mathrm{Planning}}_{\text{Decision}}\rightarrow\underbrace{\mathrm{Tool\ Learning}}_{\text{Action}}\rightarrow\underbrace{\mathrm{Observation}}_{\text{Feedback}}\,\Bigr]_{\!n}\rightarrow\mathrm{Solution}. In each iteration n , the system must first retrieve relevant context from memory, reason over the current state to formulate a plan, execute a specific tool-incorporated action, and process the resulting observation. This cycle creates a compounding accumulation of tokens, where the output of step n becomes the input cost of step n+1 , resulting in high inference costs and slow response times. Consequently, mere model compression is insufficient. We therefore define an efficient agent as follows: Efficient agent is not a smaller model, but as an agentic system optimized to maximize task success rates while minimizing resource consumption, including token usage, inference latency, and computational cost across memory, tool usage, and planning modules. Our survey aims to systematize the numerous efforts in this emerging field. While a large number of existing surveys focus on Efficient LLMs [ 156 , 201 , 123 ] , which serve as the backbone of agents, there is a lack of comprehensive literature addressing the efficiency of the agentic system itself. To bridge this gap, we categorize existing works into three strategic directions: 1) Efficient Memory: Techniques for compressing historical context, managing memory storage, and optimizing context retrieval. 2) Efficient Tool Learning: Strategies to minimize the number of tool calls and reduce the latency of external interactions. 3) Efficient Planning: Strategies to reduce the number of executing steps and API calls required to solve a problem. The remainder of this survey is organized as follows: Section 2 introduces the preliminaries and highlights the efficiency gap between agents and LLMs. Sections 3 through 5 explore component-level efficiency, with a focus on memory, tool learning, and planning optimizations. Subsequently, Section 6 addresses the quantification of efficiency. The survey concludes with a discussion on open challenges and future research directions. 2 Preliminaries 2.1 Agent Formulation We model an LLM-based agent interacting with an environment as a partially observable Markov decision process (POMDP) augmented with an external tool interface and an explicit memory component. Formally, we define the overall model as \mathcal{M}=(\mathcal{S},\mathcal{O},\mathcal{A},P,R,\gamma;\ \mathcal{T},\Psi;\ \mathcal{M}_{mem},U,\rho). Here \mathcal{S} denotes the latent environment state space, \mathcal{O} the observation space, and \mathcal{A} the agent action space. The environment dynamics are given by the transition kernel P , the reward function R , and the discount factor \gamma\in[0,1) . The agent is additionally equipped with a set of external tools \mathcal{T} and a tool interface \Psi , which specifies how tool calls are executed and what tool outputs are returned to the agent. Finally, we model explicit agent memory with memory state space \mathcal{M}_{mem} , an update rule U that maps the current memory and available information to the next memory state, and an initialization distribution \rho over the initial memory. 2.2 From Pure LLMs to Agents Figure 2 : From LLMs to agents: standalone reasoning to trajectory-level reasoning with memory, planning, and tool learning, while introducing additional cost sources. We define efficiency through a cost–performance trade-off: achieving comparable performance with lower cost, or achieving higher performance under a similar cost budget. We acknowledge that many efficiency techniques

Read the complete text