Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattacks

Minrui Xu, Jiani Fan, Xinyu Huang, Conghao Zhou, Jiawen Kang, Dusit Niyato, Shiwen Mao, Zhu Han, Xuemin (Sherman) Shen, Kwok-Yan Lam · 2025

Read Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattacks by Minrui Xu, Jiani Fan, Xinyu Huang, Conghao Zhou, Jiawen Kang, Dusit Niyato, Shiwen Mao, Zhu Han, Xuemin (Sherman) Shen, Kwok-Yan Lam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12786.txt.

Introduction

Minrui Xu and co-authors survey the threat from language-model agents that can run cyberattacks on their own, in this 2025 paper. Such agents have moved past chatting: they can browse the web, write malicious code, craft deceptive content, and make decisions. That shift cuts the cost, skill, and time an attack needs while swelling its scale, a trend the authors call cyber threat inflation.

The survey first lays out what these agents can do, from scouting targets and remembering past steps to reasoning and acting, sometimes alongside other agents or human operators. It then compares attacks across static, mobile, and infrastructure-free networks and asks where the agents' weak points lie in each. Existing defenses, the authors find, lag behind the threat because attack and defense are out of balance. They close with research directions and defensive ideas meant to harden older network systems against autonomous attackers.

Catalog record

CREATORMinrui Xu, Jiani Fan, Xinyu Huang, Conghao Zhou, Jiawen Kang, Dusit Niyato, Shiwen Mao, Zhu Han, Xuemin (Sherman) Shen, Kwok-Yan Lam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12786

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattacks Minrui Xu, Jiani Fan, Xinyu Huang, Conghao Zhou, Jiawen Kang, Dusit Niyato, Shiwen Mao, Zhu Han, Xuemin (Sherman) Shen, Kwok-Yan Lam Abstract . With the continuous evolution of Large Language Models (LLMs), LLM-based agents have advanced beyond passive chatbots to become autonomous cyber entities capable of performing complex tasks, including web browsing, malicious code and deceptive content generation, and decision-making. By significantly reducing the time, expertise, and resources, AI-assisted cyberattacks orchestrated by LLM-based agents have led to a phenomenon termed Cyber Threat Inflation, characterized by a significant reduction in attack costs and a tremendous increase in attack scale. To provide actionable defensive insights, in this survey, we focus on the potential cyber threats posed by LLM-based agents across diverse network systems. Firstly, we present the capabilities of LLM-based cyberattack agents, which include executing autonomous attack strategies, comprising scouting, memory, reasoning, and action, and facilitating collaborative operations with other agents or human operators. Building on these capabilities, we examine common cyberattacks initiated by LLM-based agents and compare their effectiveness across different types of networks, including static, mobile, and infrastructure-free paradigms. Moreover, we analyze threat bottlenecks of LLM-based agents across different network infrastructures and review their defense methods. Due to operational imbalances, existing defense methods are inadequate against autonomous cyberattacks. Finally, we outline future research directions and potential defensive strategies for legacy network systems. CCS: Networks Network security CCS: Computing methodologies Artificial intelligence CCS: General and reference Surveys and overviews 1. Introduction 1.1. Background and Motivation The evolving capabilities of large language models (LLMs) are rapidly transforming attack and defense operations in cybersecurity ( Guo et al., 2025 ) . Major AI companies have begun to systematically evaluate these risks using the Cyber Kill Chain Framework ( Microsoft, 2025 ; Rodriguez et al., 2025 ) . For instance, Google’s Project Naptime team has demonstrated that frontier LLMs can autonomously assist in offensive security tasks with minimal human input, including code exploitation and vulnerability discovery ( Glazunov and Brand, 2024 ) . Similarly, Anthropic has deployed red teams, i.e., offensive attackers, to test its Claude models against cybersecurity misuse scenarios, revealing new emergent risks in autonomous agent behavior ( Anthropic, 2025 ) . These findings reinforce the concern that LLMs have significantly lowered the technical threshold and cost of multi-stage intrusions ( Singer et al., 2025 ) . Leveraging LLMs equipped with perception, memory, reasoning, and action modules, LLM-based agents can conduct cyberattacks autonomously with minimal human intervention ( Konstantinou et al., 2025 ; Crumrine et al., 2024 ) . Specifically, LLM-based agents introduce novel attack paradigms, e.g., jailbreak attack ( Shen et al., 2024a ) , and significantly amplify existing cyberattacks, e.g., vulnerability exploitation, malware generation, and social engineering ( Caballero and Jenkins, 2025 ) . LLM-based agents allow attackers with limited skills and resources to conduct complex cyberattacks with minimal human intervention. Therefore, LLM-based agents accelerate attack deployment, scale offensive activities, and erode traditional resource bottlenecks, resulting in Cyber Threat Inflation. This inflation in cybersecurity describes the drastic reduction in operational costs for launching cyberattacks alongside a significant increase in their scalability. LLM-based agents can reduce time, expertise, and resource requirements across all stages of cyberattacks, e.g., vulnerability detection, customized exploitation, and persistent installation ( Rodriguez et al., 2025 ) . Therefore, cyberattacks that previously required months of labor and substantial expert involvement can now be accomplished within hours ( Razavi and Jamali, 2024 ) . In addition to cost collapse, scale uplift manifests in three critical dimensions ( Alotaibi et al., 2024 ) . First, capability uplift refers to the automation of offensive tasks such as vulnerability scanning and social engineering, traditionally limited to skilled red-team experts. For instance, PentestGPT ( Deng et al., 2024 ) demonstrates a 228.6% increase in task completion, and RapidPen ( Nakatani, 2025 ) achieves shell access within 200–400 seconds at an estimated cost of $0.3–$0.6 per run, with a 60% success rate. Second, throughput uplift captures the ability of LLM-based agents to execute continuous and large-scale attacks in parallel. To generate next-packet predictions based on previous traffic context in unmanned aerial vehicle (UAV) networks, Net-GPT ( Piggott et al., 2023 ) achieves 95% packet-generation accuracy and maintains time man-in-the-middle (MitM) sessions for 30 min without expert intervention. Finally, autonomous risk emergence highlights how LLMs with reasoning abilities can dynamically adapt to defensive mechanisms. In satellite networks, PLLM-CS ( Hassanin et al., 2025 ) autonomously interprets satellite telemetry to detect intent-based anomalies, signaling the rise of real-time, self-adjusting adversarial agents. While advanced persistent threat (APT) groups often leverage sophisticated techniques such as advanced phishing ( Chen et al., 2024b ) , zero-day exploitation ( Zhu et al., 2024 ) , and polymorphic malware ( Rondanini et al., 2024 ) , individual attackers have also demonstrated the ability to execute similar methods. However, the emergence of LLM-based agents will empower individual attackers to achieve sophisticated attacks. Through the integration of LLMs with tool APIs and accessible programming interfaces, organizations with limited technical capabilities are now able to orchestrate complex operations, encompassing systematic vulnerability assessment and coordinated exploit deployment. This transformation has effectively dismantled the traditional security asymmetry between attackers and defenders, as sophisticated attack vectors are no longer restricted to well-resourced threat actors. Furthermore, an LLM-based agent might probe systems outside of typical human working hours or adapt in real-time. Therefore, defenses should remain vigilant at all times to detect and respond to these autonomous intrusions. Consequently, the potential for widespread, cost-effective system compromises has expanded dramatically. The cyber threat inflation has profound implications for legacy network infrastructures, including enterprise networks, cellular core networks, cloud platforms, and embedded systems. However, many applications of LLMs in cybersecurity still assume traditional threat models, where human attackers remain the principal adversaries ( Pascoe, 2023 ) . While human attackers have traditionally posed the primary threat in cybersecurity, integrating LLMs now augments or even substitutes their expertise in many domains. Accordingly, LLMs are employed to enhance performance across established cybersecurity tasks and evaluation benchmarks.For instance, LLMCloudHunter ( Schwartz et al., 2024 ) and AppPoet ( Zhao et al., 2025 ) present targeted solutions for cloud threat intelligence extraction and Android malware detection, respectively, yet lack a systematic analysis for LLM-based cyberattack agents across different types of networks. 1.2. Related Works Table 1. Related works on LLM Agents, cyberattacks, and network systems. Ref. Survey Focus LLM agents Cyber-attacks Networks ( Wang et al., 2024a ) Architecture, capabilities, applications, and evaluation of LLM-based agents \checkmark \times \times ( Luo et al., 2025 ) The life-cycle of LLM agents including construction, collaboration, and evolution \checkmark \times \times ( Jin et al., 2024a ) LLM applications in software engineering and evolution into agents \checkmark \times \times ( He et al., 2024 ) LLM-based multi-agent systems for software engineering and human-in-the-loop \checkmark \times \times ( Zhang et al., 2025 ) LLMs for cybersecurity tasks like threat intelligence and vulnerability detection \times \checkmark \times ( Ferrag et al., 2024 ) Benchmarking 42 LLMs on intrusion and malware detection tasks \times \checkmark \times ( Zhou et al., 2024 ) Evaluation of 37 LLMs for bug detection and patch generation \times \checkmark \times ( Basic

Read the complete text