The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey Journal: CSUR Volume: 0 0 0 2 DOI: 10.1145/0000000.0000000 CCS: Security and privacy Systems security CCS: Security and privacy Software and application security CCS: Computing methodologies Artificial intelligence

Juhee Kim, Xiaoyuan Liu, Zhun Wang, Shi Qiu, Bo Li, Wenbo Guo, Dawn Song · 2026

Read The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey Journal: CSUR Volume: 0 0 0 2 DOI: 10.1145/0000000.0000000 CCS: Security and privacy Systems security CCS: Security and privacy Software and application security CCS: Computing methodologies Artificial intelligence by Juhee Kim, Xiaoyuan Liu, Zhun Wang, Shi Qiu, Bo Li, Wenbo Guo, Dawn Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11088.txt.

Introduction

Juhee Kim and coauthors present what they describe as the first systematic survey of security for AI agents. Such agents pair language models with ordinary software components in real applications. Their flexibility creates security problems unlike those of traditional software. The survey maps the design space, the attack landscape, and the defense mechanisms available. Case studies expose gaps in how current agentic systems are secured. The authors frame open challenges. These concern building agents that can be trusted in deployment.

Catalog record

CREATORJuhee Kim, Xiaoyuan Liu, Zhun Wang, Shi Qiu, Bo Li, Wenbo Guo, Dawn Song
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93715
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11088

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey Journal: CSUR Volume: 0 0 0 2 DOI: 10.1145/0000000.0000000 CCS: Security and privacy Systems security CCS: Security and privacy Software and application security CCS: Computing methodologies Artificial intelligence Juhee Kim, Xiaoyuan Liu, Zhun Wang, Shi Qiu, Bo Li, Wenbo Guo, Dawn Song Abstract . AI agents that combine large language models with non-AI system components are rapidly emerging in real-world applications, offering unprecedented automation and flexibility. However, this unprecedented flexibility introduces complex security challenges fundamentally different from those in traditional software systems. This paper presents the first systematic and comprehensive survey of AI agent security, including an analysis of the design space, attack landscape, and defense mechanisms for secure AI agent systems. We further conduct case studies to point out existing gaps in securing agentic AI systems and identify open challenges in this emerging domain. Our work also introduces the first systematic framework for understanding the security risks and defense strategies of AI agents, serving as a foundation for building both secure agentic systems and advancing research in this critical area. 1. Introduction The rapid advancement of agentic AI systems has fundamentally transformed the AI landscape, marking a paradigm shift from isolated language models to integrated hybrid systems that combine Large Language Models (LLMs) with diverse software components. These hybrid systems demonstrate unprecedented capabilities by seamlessly integrating AI reasoning and traditional software, enabling dynamic tool usage and autonomous task execution. Agentic AI systems now power a wide range of applications, from a simple chatbot ( 112 ; 50 ) to software development ( 48 ; 31 ; 27 ) and web browsing automation ( 122 ) . The security implications of agentic AI systems are becoming increasingly critical, as recent incidents demonstrate the severity of their vulnerabilities. Prompt injection attacks have been exploited to access private GitHub repositories ( 60 ) , while remote code execution vulnerabilities ( 96 ; 98 ) have enabled attackers to gain unauthorized system access. Data exfiltration attacks ( 125 ; 128 ) have compromised sensitive information through malicious document attachments and email forwarding, while servers have exposed user chat and credential data ( 110 ; 132 ) . Attackers are also exploiting web agents to gain access to users’ personal banking accounts ( 18 ) . These incidents underscore that while the flexibility and automation capabilities make agentic systems powerful, they also create complex security challenges, which differ fundamentally from those associated with traditional software systems or standalone AI models. Although existing research has made important contributions to understanding AI agent security, most efforts have focused on specific attack vectors or individual system components, mainly prompt injection attacks ( 89 ; 183 ; 179 ; 185 ; 16 ) . However, these studies lack a comprehensive perspective that considers the defense of agentic systems as a whole. The community needs a systematic framework for understanding how the integration of multiple components introduces novel attack surfaces and demands fundamentally different security approaches. This paper addresses this gap by providing the first comprehensive systematization of knowledge on the security landscape of agentic AI systems. We approach agent security from a holistic systems perspective, examining how the combination of LLMs and traditional software creates unique security challenges that cannot be mitigated through component-level defenses alone. Our analysis begins with a systematic characterization of agent design dimensions that influence security properties, followed by a comprehensive taxonomy of attack vectors and security risks across the entire agent ecosystem. We then conduct a systematic survey of existing defense mechanisms, categorizing them based on their protection approaches and identifying critical gaps in current security strategies. Finally, we conduct case studies on various real-world agents, including a concrete case of AutoGPT, to further highlight gaps in existing defenses for agentic systems. Our contributions are threefold: • Agent Design Dimensions: We present a systematic framework that characterizes agentic AI systems through seven key design dimensions: input trust, access sensitivity, workflow, action, memory, tool, and user interface. We then analyze how flexibility along each dimension impacts security risks and map these dimensions to established frameworks, including MITRE ATLAS and OWASP Top 10 for LLM. • Comprehensive Attack Landscape and Taxonomy: We develop a systematic taxonomy of attack vectors organized by threat models (i.e., external, user-level, and internal adversaries) and provide a comprehensive classification of seven security risk categories spanning the CIA triad, along with a system-level analysis of risk interactions and amplification patterns. • Defense Landscape Systematization: We systematically survey existing defense mechanisms and conduct various case studies, identifying specific design dimensions for defense and open challenges. To the best of our knowledge, this is the first work to systematically analyze the security landscape of agentic AI systems from a comprehensive system perspective. Our systematization provides a foundational framework for understanding security risks and defense strategies in agentic AI systems, guiding future research toward building secure agentic systems. This work serves as a handbook for researchers and developers working with agentic AI systems. 2. Overview In this section, we define the scope of our work, introduce our methodology, and discuss the key differences from existing agent security surveys. Scope. We focus on security risks and defenses that are unique to, or significantly amplified in, agentic systems compared to traditional software and standalone LLMs. We first characterize how agents differ from standalone models across seven design dimensions ( §3 ). We then analyze agent-specific security risks both at the component and system levels ( §4 ). For risks that exist in non-agentic LLMs (e.g., jailbreak, hallucination), we emphasize how agent autonomy and environment access magnify their impact (e.g., data exfiltration, unintended system manipulation). We exclude attacks targeting model internals, such as model inversion ( 41 ) , as these do not fundamentally worsen in agentic contexts where agents operate purely through inference-time input-output interfaces. Finally, §5 systematizes the agent defense landscape, describing existing approaches and open challenges. Methodology. First, we define the agent structure and design dimensions based on existing definitions and real-world agent implementations. This forms the foundation of our agent risk taxonomy, which analyzes risks at both the component and system levels. We also refer to the taxonomy of the OWASP Top 10 for LLM Applications ( 118 ) and MITRE ATLAS Matrix ( 95 ) . We then propose the defense landscape for agentic systems by applying the defense in-depth principle, informed by traditional system security. Under this framework, we conduct a systematic review of academic literature and web documents on agentic AI security from 2023 to October 2025, corresponding to the proliferation of agent systems ( 178 ) . We search with keywords across four dimensions: i) general terminology (e.g., agent security ), ii) OWASP-defined risks (e.g., prompt injection , memory poisoning ), iii) component-centric terms (e.g., RAG security , tool security ), and iv) traditional security adaptations (e.g., isolation , access control ). We prioritize top-tier security venues (e.g., USENIX Security, IEEE S&P, CCS, and NDSS) and ML conferences (e.g., NeurIPS, ICLR, and ICML), alongside high-impact preprints, industry whitepapers, and CVEs. We manually exclude work on standalone models to focus explicitly on agents. The review yields 128 papers, including 51 attack methods and 60 defense methods; the remaining works

Read the complete text