Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms
Tarek Gasmi, Ramzi Guesmi, Ines Belhadj, Jihene Bennaceur · 2025
Read Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms by Tarek Gasmi, Ramzi Guesmi, Ines Belhadj, Jihene Bennaceur (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06323.txt.
Introduction
Tarek Gasmi, Ramzi Guesmi, Ines Belhadj. Jihene Bennaceur matched the security of two ways of wiring tools into text model agents in a 2025 study. Agents built on function calling and agents built on the Model Context Rules face both AI-set attacks like prompt injection and classic software flaws like JSON injection and denial of service. The two literatures rarely meet. The team ran over three thousand attack scenarios across seven models, spanning simple, composed, and chained attacks.
Function calling setups fell more often overall, about seventy-four percent of attacks succeeding versus about sixty-three for the rules. Function calling weaker on system-centric flaws and the rules more exposed on model-centric ones. Chained attacks succeeded over ninety percent of the time, and stronger thinking models proved more exploitable despite spotting threats better. Design, the authors conclude, reshapes the threat landscape itself.
Catalog record
| CREATOR | Tarek Gasmi, Ramzi Guesmi, Ines Belhadj, Jihene Bennaceur |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06323
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridging AI and Software Security: A Comparative Vulnerability Assessment of LLM Agent Deployment Paradigms Tarek Gasmi, Ramzi Guesmi, Ines Belhadj, Jihene Bennaceur Abstract Large Language Model (LLM) agents face security vulnerabilities spanning AI-specific and traditional software domains, yet current research addresses these separately. This study bridges this gap through comparative evaluation of Function Calling architecture and Model Context Protocol (MCP) deployment paradigms using a unified threat classification framework. We tested 3,250 attack scenarios across seven language models, evaluating simple, composed, and chained attacks targeting both AI-specific threats (prompt injection) and software vulnerabilities (JSON injection, denial-of-service). Function Calling showed higher overall attack success rates (73.5% vs 62.59% for MCP), with greater system-centric vulnerability while MCP exhibited increased LLM-centric exposure. Attack complexity dramatically amplified effectiveness, with chained attacks achieving 91-96% success rates. Counterintuitively, advanced reasoning models demonstrated higher exploitability despite better threat detection. Results demonstrate that architectural choices fundamentally reshape threat landscapes. This work establishes methodological foundations for cross-domain LLM agent security assessment and provides evidence-based guidance for secure deployment. Code and experimental materials are available at https://github.com/theconsciouslab-ai/llm-agent-security . Keywords: LLM agents; Function Calling; Model Context Protocol; architectural security; prompt injection; composed attacks; vulnerability assessment; deployment paradigms. 1 Introduction Large Language Models (LLMs) have transformed artificial intelligence by enabling text generation capabilities that closely mimic human reasoning [ 1 ] . These models have evolved beyond their initial role as standalone text generators into LLM-based agents [ 2 , 3 ] : autonomous systems augmented with action modules [ 2 ] for function execution and API integration, enabling them to interact with software environments and external components [ 2 ] . Their deployment has accelerated dramatically across high-stakes domains including healthcare [ 4 ] , finance [ 5 ] , and customer service [ 6 ] , where these agents now automate complex decision-making processes, perform data analysis, and manage user interactions [ 2 , 3 ] . Recent industry reports indicate that over 70% of Fortune 500 companies have deployed or are actively experimenting with LLM-based agent systems as of early 2025 [ 7 ] . This widespread adoption has been driven by diverse implementation paradigms, particularly the emergence of Function Calling as a core feature in many LLM systems [ 8 ] . Major AI companies, including OpenAI and Anthropic, developed their own distinct approaches to tool integration [ 9 , 10 ] , while efforts to standardize these implementations led to the creation of the Model Context Protocol (MCP) [ 11 ] by early 2025. Each paradigm balances competing requirements for scalability, integration simplicity, and performance optimization [ 9 , 10 , 11 ] . However, the sophisticated architecture of LLM-based agents introduces unique vulnerabilities to AI-specific security threats, including prompt injection attacks [ 12 ] , jailbreaking techniques [ 13 ] , and methods for extracting training data [ 11 ] . These exploits specifically target the generative nature of these models while bypassing traditional input validation mechanisms. Notable security incidents, such as misuse of ChatGPT for planning harmful activities [ 14 ] , demonstrate the real-world impact of these vulnerabilities. Within information security theory, these challenges fundamentally relate to the CIA (Confidentiality, Integrity, and Availability) triad framework, but require unique interpretations when applied to LLM agent contexts due to their probabilistic outputs, semantic understanding capabilities, and autonomous decision-making processes. Current AI security research has primarily approached LLM-based agents through an AI-centric lens, treating the LLM component as the primary attack surface while neglecting interactions with surrounding software components. Studies like InjecAgent [ 15 ] document agent responses to jailbreaking attacks in functional environments, while others have developed taxonomies of prompt injection vulnerabilities [ 10 , 16 ] . Detection mechanisms like LLM-Guard [ 17 ] and resistance frameworks like ReAct [ 18 ] and RLHF [ 19 ] have strengthened agent defenses. Recent architectural work [ 20 ] introduces the LLM-Agent-UMF framework, formalizing modularity in LLM-based agents through core components like the core-agent coordinator [ 20 ] . However, these approaches often overlook the interplay between AI-specific threats and traditional software vulnerabilities inherent to multi-component systems. Importantly, LLM-based agents are fundamentally software applications that integrate components such as APIs and databases, all shaped by their underlying architecture [ 20 ] , making them susceptible to classical software vulnerabilities including code injection and denial of service. An initially contained prompt injection attack might traverse system boundaries and escalate to data exfiltration or service disruption, yet current development paradigms often prioritize functional integration and performance [ 21 ] over comprehensive security hardening. This research addresses the critical gap between AI and software security by investigating how architectural design decisions influence vulnerability profiles across both domains. We are guided by the following key questions: 1. How do different LLM-agent tool-calling architecture paradigms (Function Calling vs. MCP) influence vulnerability profiles across both AI-specific and traditional software attack vectors? 2. To what degree does the internal architecture of an LLM, such as its reasoning capability, influence the susceptibility and trajectory of security breaches? 3. How does the complexity of attack progressions (simple, composed, chained) affect exploit success rates across different architectural patterns? To address these questions, we conduct a comprehensive assessment of two representative architectural frameworks: Function Calling [ 9 , 10 ] and the Model Context Protocol (MCP) [ 11 ] . These paradigms were selected not only to represent contrasting design philosophies; Function Calling being manual and platform-specific [ 9 , 10 ] , while MCP offers a dynamic, standardized protocol [ 11 ] ; but also to reveal how different architectural approaches to tool orchestration influence vulnerability exposure. Our investigation provides the following primary contributions: • Comparative architectural analysis : Examining how Function Calling and MCP paradigms influence exposure to both AI-specific and traditional software vulnerabilities in LLM-based agent systems. • Reasoning capability impact assessment : Investigating how the internal architecture of standalone LLMs, particularly their reasoning capabilities, impacts system susceptibility to security breaches and influences attack trajectories. • Cross-domain vulnerability amplification : Demonstrating how classical software vulnerabilities amplify AI-specific threats, revealing interdependence between traditional security flaws and modern LLM behavior. • Attack progression evaluation : Assessing the increased exploitability posed by simple, composed, and chained attacks across different architectural patterns. • Extensible testing framework : Proposing a reproducible framework tailored for evaluating LLM-based agents across both Function Calling and MCP paradigms. Our findings demonstrate that architectural choices significantly impact security postures, with Function Calling exhibiting greater resilience against direct prompt injection but increased vulnerability to tool manipulation, while MCP demonstrates stronger containment properties but higher susceptibility to cross-boundary attacks. Overall, composed attacks linking AI and software vulnerabilities achieved success rates significantly higher than isolated attacks across both paradigms. The remainder of this paper is structured as follows: Section 2 reviews related work, establishing the foundation for our study. Section 3 details our experimental setup, including implementation of default configurations for Function Calling and MCP paradigms. Section 4 presents our methodology, defining the threat framework and categorization of attack vectors targeting both AI and traditional software vulnerabilities. Section 5 discusses experimental results, analyzing attack efficacy across paradigms and identifying vulnerable architectural patterns. Finally, Section 6 proposes a unified security framework integrating both AI and software security principles, along with