When LLMs Team Up: A Coordinated Attack Framework for Automated Cyber Intrusions

Minfeng Qi, Tianqing Zhu, Zijie Xu, Congcong Zhu, Qin Wang, Wanlei Zhou · 2026

Read When LLMs Team Up: A Coordinated Attack Framework for Automated Cyber Intrusions by Minfeng Qi, Tianqing Zhu, Zijie Xu, Congcong Zhu, Qin Wang, Wanlei Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08763.txt.

Introduction

Minfeng Qi and six coauthors study how teams of language model agents carry out intrusion style cyber tasks in a controlled setting. One agent juggling evidence, planning, execution, and validation in a single context invites drift and compounding errors. Their CAESAR framework splits the workflow into five typed roles coordinated over bounded rounds, with a persistent knowledge base and gated promotion of validated findings.

Write access is isolated by capability tokens, keeping artifacts traceable. On twenty five capture the flag tasks across four model backends, the team beats a matched single agent baseline with steadier results, especially on multi step exploit chains. Security research gains structural signals for monitoring coordinated agent behavior beyond single prompts.

Catalog record

CREATORMinfeng Qi, Tianqing Zhu, Zijie Xu, Congcong Zhu, Qin Wang, Wanlei Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08763

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When LLMs Team Up: A Coordinated Attack Framework for Automated Cyber Intrusions Minfeng Qi, Tianqing Zhu, Zijie Xu, Congcong Zhu, Qin Wang, Wanlei Zhou Abstract Automated intrusion-style workflows require LLM agents to reason over partial observations, tool outputs, and executable artifacts under bounded budgets. A single LLM instance often compresses evidence extraction, planning, execution, and validation into one context, which increases the risk of context drift and error propagation. Existing LLM-based multi-agent systems support general collaboration, but they do not explicitly model the role boundaries, artifact provenance, and cost constraints that characterize multi-stage intrusion workflows. This paper presents CAESAR , a coordinated multi-agent framework for controlled analysis of LLM-agent behavior in intrusion-style tasks. CAESAR decomposes the workflow into five typed roles and coordinates them through a bounded round protocol with a persistent knowledge base, a per-round workspace, validator-gated knowledge promotion, and capability-token write isolation. We evaluate CAESAR on 25 CTF tasks across five categories and four LLM backends. Compared with a single-agent baseline under matched budgets and tool access, CAESAR improves task success and reduces performance variance, with larger gains on tasks requiring multi-step exploit composition. A secondary simulated interactional-security study suggests that the role structure can transfer beyond code-native surfaces. The results indicate that role transitions, artifact provenance, and knowledge-promotion events provide useful structural signals for monitoring coordinated LLM-agent behavior beyond individual prompt and output inspection. The dataset, implementation, and evaluation logs are released at https://github.com/Xu-Qiu/CMAS . I Introduction Large language models (LLMs) have entered the offensive security toolchain. Recent studies report that a single model instance can triage vulnerabilities, draft exploit scaffolding, and assist with reverse engineering [ 7 , 8 , 35 , 15 ] . These results encourage a view of the LLM as a general-purpose reasoning component for security analysis. The tasks examined in such work, however, are largely self-contained: a specific binary, a specific CVE, or an isolated proof obligation. Real intrusion campaigns, including Advanced Persistent Threats (APTs) 1 1 1 APTs are stealthy, well-resourced adversaries that sustain prolonged, multi-phase intrusion campaigns against a chosen target [ 21 ] . , proceed through interdependent phases in which reconnaissance, hypothesis formation, exploit construction, post-compromise activity, and observation of defender reactions must be reconciled across repeated rounds [ 16 , 2 ] . Reasoning at this scale exceeds the practical budget of a single LLM call and exposes known weaknesses of current models, including hallucination, limited long-range coherence, and weak memory management [ 24 , 25 , 5 ] . In practice, single-agent intrusion pipelines tend to collapse into trial-and-error sequences that fail to converge in heterogeneous domains such as binary analysis, memory corruption, and algebraic inference. The mismatch is structural rather than incidental. Skilled human intrusion teams distribute responsibility across specialists: one analyst extracts features from captured artifacts, a second organizes candidate hypotheses, a third selects a strategy under operational constraints, and the remaining members execute actions and verify outcomes [ 42 , 11 ] . Information flows along well-defined interfaces, and validated observations are retained while speculation is discarded. Single-agent LLM pipelines compress these responsibilities into a single conversational thread. Once such a thread begins to drift, the system rarely recovers, because no independent channel is available for a second reasoner to challenge the prevailing hypothesis. Prior LLM-based multi-agent studies have explored debate, generic role play, and tool-using agents in open domains [ 34 , 4 ] , but they do not simultaneously address the requirements particular to adversarial multi-stage reasoning, namely typed information flow among heterogeneous roles, persistent validated memory across rounds, and budget-aware plan selection under token, time, and risk constraints. This paper presents CAESAR (Coordinated Adversarial Execution and Strategic Reasoning), a coordinated multi-agent framework for automated cyber intrusion. CAESAR is formalized as a round-based protocol over a fixed set of typed role operators and a shared persistent memory: a Detective extracts evidence from the target environment; a Strategist organizes evidence into hypothesis graphs; a General translates selected hypotheses into executable plans under a budget vector that bounds token, time, and risk expenditure; Executors invoke domain-specific tooling; and a Validator inspects the resulting traces and promotes only reliable patterns, executor capabilities, and role-specific feedback to a persistent knowledge base. Separation among roles is enforced at the protocol level through typed artifacts, capability-token write isolation, and a validator-gated promotion rule, so that every coordination decision is externalized and auditable. The same protocol is portable across LLM backends because each role exposes a typed interface rather than a prompt. We evaluate CAESAR along two axes. The primary study uses 25 real-world Capture-the-Flag (CTF) challenges drawn from the AntCTF \times D 3 CTF 2021 event and spanning the Reverse, Pwn, Crypto, Misc, and Web categories. CTF challenges provide a controlled analog of intrusion workflows: each task exposes a vulnerable artifact, a hidden flag that signals a successful compromise, and an oracle that verifies capture. We instantiate the framework on four contemporary LLM backends (GPT-5, Gemini 2.5, Grok-4, and DeepSeek-R1) and compare it against single-agent configurations under identical tool access and environment conditions. A second study applies the same framework to a social-engineering infiltration scenario in which no binary or protocol artifact is available, so as to test whether the coordination pattern transfers beyond code-native attack surfaces. The experimental evidence supports three observations. First, coordinated operation improves success rates and reduces time-to-solve across all five CTF categories, and the improvement is stable across the four backends, which suggests that the gain originates in the coordination structure rather than in any single model’s reasoning capacity. Second, performance stabilizes after a small number of successful rounds, consistent with the hypothesis that validator-gated memory suppresses error amplification across iterations. Third, the same coordination pattern yields higher extraction success and lower detection risk in the social-engineering study, which indicates that the benefit is not confined to vulnerability-centric tasks. These findings carry defensive implications: when adversaries can reorganize their internal workflow rather than rely on a single model’s reasoning ceiling, content-level safeguards alone are insufficient, and the locus of defense moves toward structural monitoring of role dynamics and cross-message strategy formation. Contributions. This paper makes four contributions. (1) We propose CAESAR , a coordinated multi-agent framework that operationalizes role specialization, validator-gated knowledge promotion, and budget-aware plan selection under a typed round protocol, together with a formal model that specifies operator signatures, artifact schemas, and termination guarantees. (2) We conduct a systematic evaluation on 25 real-world CTF challenges across five categories and four contemporary LLM backends, reporting consistent gains in success reliability and solving efficiency relative to single-agent baselines under identical tool access. (3) We demonstrate that CAESAR transfers beyond code-native attack surfaces through a social-engineering infiltration study, in which coordinated role interaction attains higher extraction success and lower detection risk than single-agent settings. (4) We derive empirical insights into how coordination, rather than raw model capability, drives emergent attack strength, and discuss defensive implications, including the need to shift from content-based filtering toward structural monitoring of role dynamics. The dataset, implementation, and evaluation logs are released at https://github.com/Xu-Qiu/CMAS . II Preliminary II-A LLM Agents and Tool Use An LLM agent is a language-model instance wrapped with three external components: a structured prompt context c , a tool interface \mathcal{T} with typed

Read the complete text