Network and Systems Performance Characterization of MCP-Enabled LLM Agents

Zihao Ding, Mufeng Zhu, Yao Liu · 2025

Read Network and Systems Performance Characterization of MCP-Enabled LLM Agents by Zihao Ding, Mufeng Zhu, Yao Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07426.txt.

Introduction

Zihao Ding, Mufeng Zhu, and Yao Liu measure what happens when language models use the Model Context Protocol. The protocol gives models a standard way to call outside tools and services. That power comes with long prompts, tool definitions, and histories attached to every request.

Longer context means more tokens, higher bills, and heavier load on model services. The authors run measurement-based tests across models and protocol setups to map trade-offs among capability, speed, and cost. Their results show where token use balloons and which choices control it. System builders get concrete guidance for deploying tool-using agents without wasteful overhead.

Catalog record

CREATORZihao Ding, Mufeng Zhu, Yao Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07426

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Network and Systems Performance Characterization of MCP-Enabled LLM Agents Zihao Ding, Mufeng Zhu, Yao Liu Abstract . Model Context Protocol (MCP) has recently gained increased attention within the AI community for providing a standardized way for large language models (LLMs) to interact with external tools and services, significantly enhancing their capabilities. However, the inclusion of extensive contextual information, including system prompts, MCP tool definitions, and context histories, in MCP-enabled LLM interactions, dramatically inflates token usage. Given that LLM providers charge based on tokens, these expanded contexts can quickly escalate monetary costs and increase the computational load on LLM services. This paper presents a comprehensive measurement-based analysis of MCP-enabled interactions with LLMs, revealing trade-offs between capability, performance, and cost. We explore how different LLM models and MCP configurations impact key performance metrics such as token efficiency, monetary cost, task completion times, and task success rates, and suggest potential optimizations, including enabling parallel tool calls and implementing robust task abort mechanisms. These findings provide useful insights for developing more efficient, robust, and cost-effective MCP-enabled workflows. 1. Introduction Large language models (LLMs) have surged in popularity in recent years, enabling everyday users to interact with them via chat-based interfaces. More recently, AI agents powered by LLMs also mark a significant advancement, capable of autonomous completion of complex tasks ( Luo et al. 2025 ) . To facilitate interoperability among LLMs and external tools or APIs, the Model Context Protocol (MCP) was proposed as a standard by Anthropic ( Ant [n. d.] ; MCP [n. d.] ) . Since its introduction in November 2024, it has attracted considerable interest within the AI community. To date, website mcp.so indexes more than 13,000 MCP servers, allowing LLMs to access a diverse range of tools such as Github, Redis, Slack, Blender ( ahujasid 2025 ) , and Unity ( justinpbarnett 2025 ) . While MCP offers a promising step towards standardizing agent-tool interaction, its workflow introduces important performance considerations. As LLM APIs are largely stateless services, MCP-enabled interactions rely on rich contextual information, including detailed system prompts, conversation history, and results from previous tool calls, being included in each LLM prompt. This approach, while ensuring LLM has the necessary context for planning and action, can result in significant token consumption. This, in turn, increases monetary costs to users and places heavier computational load on the LLM service providers for processing these input prompts. Furthermore, the increased computational load can increase the task completion time, a key performance metric. In this paper, we investigate the performance implications of MCP-enabled LLM agent interactions. We instrumented Cline, an open-source MCP Host, to conduct controlled experiments: executing a set of MCP-enabled tasks with a diverse range of LLMs, repeated multiple times to obtain more stable estimates of their performance distribution. The metrics collected from these experiments include token counts, monetary costs, task completion times, and task success rates. To establish a comparative baseline for token usage patterns, we also analyzed a 90-day LLM general usage trace from an LLM replay service, OpenRouter. Overall, this paper makes the following contributions: • We empirically quantify the exceptionally low completion-to-prompt (C/P) token ratios in MCP-enabled LLM interactions. This is a direct consequence of the substantial contextual information, including system prompts and interaction history, that must be sent with each input prompt, underscoring the prompt-heavy nature of MCP tool calls. • We describe a multi-dimensional performance characterization of LLMs in MCP-enabled workflows. Using radar charts, we provide a comparative analysis of LLMs in terms of token usage, total monetary token cost, task success rate, and task completion time. • We identify inefficiencies in multi-tool usage scenarios where current LLMs typically return only a single tool call per API request. We highlight potentials for reducing cumulative prompt token usage and task completion time by enabling LLMs to output multiple tool calls for parallel processing by MCP clients. • We document cases where LLMs become stuck during complex tasks, which can result in the generation of excessive completion tokens and lead to high monetary costs, thereby necessitating reliable task abort mechanisms. 2. Background 2.1. Model Context Protocol (MCP) Figure 1. MCP-enabled workflow Figure 1 illustrates the primary parties involved in the execution flow of MCP-enabled LLM agents. These include the user initiating the task, the LLM providing reasoning capabilities, the underlying tool performing the action, and the core MCP components: the Host, Client, and Server. MCP Host is the application that the user interacts with (e.g., an AI-enabled IDE ( cli 2025 ; cur [n. d.] ) or a desktop application like Claude Desktop ( cla [n. d.] ) ). The Host receives user prompts, constructs the full context (including conversation history, system instructions, and information about available MCP tools/resources), communicates with the LLM, interprets the LLM’s response (including potential requests to use a tool), and invokes the appropriate MCP Client to initiate tool execution. MCP Client receives invocation requests from the Host when a specific MCP tool needs to be used. The Client handles the communication with the corresponding MCP Server according to the MCP specification (typically using JSON-RPC over a defined transport, e.g., with stdio or server-sent events (SSE) for server-to-client communication ( mcp [n. d.] ) . The Client translates the Host’s request into MCP messages for the Server and relays the Server’s response back to the Host. MCP Server exposes specific capabilities (Tools, Resources, Prompts) via the MCP protocol. It is a RPC server that listens for connections from MCP Clients. Upon receiving a valid request (e.g., a tool call request), the Server invokes the underlying tool’s API on behalf of the Client. The Server then sends the result back to the Client. 2.2. MCP Interaction Model and Context Management Taking the MCP Host “Cline” ( cli 2025 ) as an example, Figure 2 shows the full prompt constructed and sent by the Host to the LLM. All information in the figure is included in the context window, and is sent as part of the API request to the model server. The total length of the context window sent in the N -th LLM API request, \mathcal{L}_{N} , can be obtained as \mathcal{L}_{N}=\mathcal{S}_{N}+\mathcal{H}_{N}+p_{N} , where \mathcal{H}_{N}=\sum_{i=1}^{N-1}\left(p_{i}+o_{i}\right) represents the length of conversation history from the previous N-1 turns. The total length of messages (both API request and responses) transmitted during a N-turn conversation can be represented as \mathcal{T}_{N}=\sum_{i=1}^{N}\left(\mathcal{S}_{i}+\mathcal{H}_{i}+p_{i}\right)+o_{N} . System Prompt (\mathcal{S}) • Persona definition of the assistant • Tool use instructions, examples, guidelines • Introduction to MCP framework, connected MCP servers, detailed MCP manuals describing supported tools/resources • Defines the two operational modes: ACT and PLAN • AI’s capabilities and how tools can be combined • Rules AI must follow • Details about operating environment (OS, Shell, Paths) • Instructions on how AI can solve the problem Interaction History (\mathcal{H}) \dots (repeat for turns 1..N-1 ) Turn i : • { User Prompt | Tool Call Result } ( p_{i} ) • LLM Output ( o_{i} ) Current Turn N Information (\mathcal{C}) • Current { User Prompt | Tool Call Result } ( p_{N} ) Figure 2. Structure of the API requests sent from Cline (the MCP Host) to the LLM 2.3. MCP-Enabled vs. Chat-Based LLM Use Maintaining conversational context by including interaction

Read the complete text