Co-RedTeam : Orchestrated Security Discovery and Exploitation with LLM Agents
Pengfei He, Ash Fox, Lesly Miculicich, Stefan Friedli, Daniel Fabian, Burak Gokturk, Jiliang Tang, Chen-Yu Lee, Tomas Pfister, Long T. Le · 2026
Read Co-RedTeam : Orchestrated Security Discovery and Exploitation with LLM Agents by Pengfei He, Ash Fox, Lesly Miculicich, Stefan Friedli, Daniel Fabian, Burak Gokturk, Jiliang Tang, Chen-Yu Lee, Tomas Pfister, Long T. Le (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02164.txt.
Introduction
Pengfei He and others propose Co-RedTeam, a multi-agent method mirroring professional red-teaming for auto vulnerability finding and exploitation. Earlier methods falter through weak contact, poor grounding in execution, and no reuse of experience. The team splits analysis into coordinated finding and exploitation stages fed by security knowledge, code-aware thought, and long-term memory. Agents plan, run, validate, and refine actions from real execution feedback. Across demanding benchmarks, the system beats strong rivals on several backbones with high exploitation success and a clear finding gain.
Catalog record
| CREATOR | Pengfei He, Ash Fox, Lesly Miculicich, Stefan Friedli, Daniel Fabian, Burak Gokturk, Jiliang Tang, Chen-Yu Lee, Tomas Pfister, Long T. Le |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87032 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.02164
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Co-RedTeam : Orchestrated Security Discovery and Exploitation with LLM Agents Pengfei He, Ash Fox, Lesly Miculicich, Stefan Friedli, Daniel Fabian, Burak Gokturk, Jiliang Tang, Chen-Yu Lee, Tomas Pfister, Long T. Le Abstract Large language models (LLMs) have shown promise in assisting cybersecurity tasks, yet existing approaches struggle with automatic vulnerability discovery and exploitation due to limited interaction, weak execution grounding, and a lack of experience reuse. We propose Co-RedTeam , a security-aware multi-agent framework designed to mirror real-world red-teaming workflows by integrating security-domain knowledge, code-aware analysis, execution-grounded iterative reasoning, and long-term memory. Co-RedTeam decomposes vulnerability analysis into coordinated discovery and exploitation stages, enabling agents to plan, execute, validate, and refine actions based on real execution feedback while learning from prior trajectories. Extensive evaluations on challenging security benchmarks demonstrate that Co-RedTeam consistently outperforms strong baselines across diverse backbone models, achieving over 60% success rate in vulnerability exploitation and over 10% absolute improvement in vulnerability detection. Ablation and iteration studies further confirm the critical role of execution feedback, structured interaction, and memory for building robust and generalizable cybersecurity agents. 1 Introduction Red teaming plays a foundational role in modern cybersecurity by proactively identifying, exploiting, and mitigating vulnerabilities ( 13 ; 4 ; 22 ) before they are abused in real-world attacks. Systematic red-teaming efforts help organizations assess their security posture, validate defenses, and reduce potential financial and operational losses caused by software vulnerabilities ( 2 ; 19 ) . Standardized frameworks like the Common Weakness Enumeration (CWE) ( 15 ) and the OWASP Top 10 ( 18 ) systematize recurring software flaws, highlighting the widespread prevalence and severity of vulnerabilities in deployed systems. In practice, however, effective red teaming remains a complex and labor-intensive process that requires deep domain expertise, iterative hypothesis testing, and careful reasoning across large codebases and system configurations. Manual red-teaming workflows are time-consuming, costly, and difficult to scale, making it challenging to provide timely and comprehensive security assessments for rapidly evolving software systems 20 . These limitations motivate the development of automated red-teaming techniques that can continuously and systematically uncover vulnerabilities at scale. Recent advances in large language models (LLMs) ( 3 ; 1 ) have sparked growing interest in automating aspects of cybersecurity analysis, including vulnerability discovery and exploitation ( 28 ; 31 ) . LLMs and agent systems offer a promising foundation for automatic red teaming due to their ability to reason over code, generate exploits, and interact with complex environments ( 7 ; 11 ; 26 ) . However, existing approaches based on individual LLMs, single-agent setups ( 10 ; 30 ) , or generic coding agents ( 23 ) often fall short when applied to realistic security tasks. For example, empirical evidence from established benchmarks such as CyBench ( 30 ) , BountyBench ( 29 ) , and CyberGym ( 25 ) shows that these systems struggle with multi-step reasoning, adaptive attack planning, and robust exploration of the vulnerability space. Addressing these challenges requires automated red-teaming systems that can decompose complex security workflows into specialized roles, support structured interaction, and iteratively critique and refine intermediate hypotheses. LLM-based multi-agent systems naturally meet these requirements, offering a more principled and effective framework for automated red teaming in software security. Contribution. We propose Co-RedTeam , a security-aware multi-agent framework for automatic software vulnerability discovery and exploitation, explicitly designed to overcome core limitations of existing LLM-based security systems, namely brittle single-shot reasoning, lack of execution-grounded validation, and the inability to learn from prior attacks. Inspired by how human security experts conduct red teaming, Co-RedTeam tightly integrates four capabilities essential for realistic cybersecurity tasks: security grounding , code-aware analysis , execution-driven reasoning , and experience accumulation . Concretely, agents are grounded in established security standards and vulnerability documentation (e.g., CWE and OWASP) and equipped with code-browsing tools to precisely analyze large, complex codebases and generate evidence-backed vulnerability hypotheses. To move beyond static analysis, the framework employs a closed-loop planning–execution–evaluation process, enabling agents to iteratively refine exploitation strategies based on real execution feedback in isolated environments. Finally, Co-RedTeam introduces a layered long-term memory that captures reusable vulnerability patterns, high-level attack strategies, and concrete technical actions, allowing the system to improve over time. Together, these design choices directly address the shortcomings of prior automatical red-teaming approaches, yielding a principled, execution-grounded, and experience-driven framework tailored to real-world software security analysis. To validate effectiveness, we evaluate Co-RedTeam on recent and challenging cybersecurity benchmarks, including CyBench ( 30 ) , BountyBench ( 29 ) , and CyberGym ( 25 ) . Experimental results demonstrate that Co-RedTeam substantially outperforms prior approaches, achieving over 60% exploitation success and 20% detection accuracy. We further conduct ablation studies to verify the importance of key design components and demonstrate that Co-RedTeam continually improves over time through long-term memory. 2 Related works LLMs for Cybersecurity tasks . Software vulnerabilities, such as injection flaws, improper access control, and insecure deserialization, remain a fundamental challenge in cybersecurity, as formalized by widely adopted standards and benchmarks including CWE ( 15 ) , the OWASP Top 10 ( 18 ) , and OSS-Fuzz ( 8 ) . Recent advances in code-capable large language models (LLMs) ( 3 ; 1 ) have spurred growing interest in using LLMs for vulnerability-related tasks, including detection, exploitation, and repair ( 31 ; 28 ) . Early studies show promising results, demonstrating that LLMs can identify certain vulnerability patterns and, in controlled settings, even autonomously exploit websites ( 6 ) , with chain-of-thought prompting further improving performance in vulnerability discovery and repair ( 16 ) . However, subsequent empirical evaluations reveal substantial limitations: LLMs struggle with complex reasoning in vulnerability detection ( 5 ) , and both detection and exploitation remain challenging across diverse benchmarks and realistic settings ( 21 ; 24 ; 32 ) . Agentic Systems for Security . Beyond single-LLM approaches, recent work increasingly adopts agentic system designs that structure LLMs as autonomous agents capable of interacting with tools, environments, and intermediate feedback ( 12 ; 14 ) . While training-based methods can be promising ( 33 ) , agentic approaches are often favored for their flexibility, modularity, and ability to directly leverage rapidly advancing state-of-the-art LLMs without retraining. Prior efforts include single-agent security workflows that iteratively analyze codebases and refine vulnerability hypotheses ( 5 ; 30 ; 10 ) , but their effectiveness remains limited for complex, multi-step tasks. More recent work explores multi-agent designs, where agents collaborate via structured interaction or task decomposition, such as mock-court–style vulnerability detection ( 27 ) and coordinated exploitation of real-world one-day vulnerabilities ( 6 ) . However, results on challenging benchmarks ( 30 ; 29 ; 25 ) show that existing single-agent and generic coding-agent systems achieve low success rates (often below 10%) on large, realistic codebases, motivating the need for security-aware multi-agent LLM systems. 3 Co-RedTeam Figure 1 : Overview of Co-RedTeam . Co-RedTeam is a security-aware multi-agent framework for automatic vulnerability discovery and exploitation. (Top) Given a target codebase (and optional vulnerability hints), the orchestrator coordinates two stages. Stage I ( Vulnerability Discovery): Analysis and Critique agents discuss together leveraging code-browsing tools and security documentation to identify and validate candidate vulnerabilities with concrete evidence. Stage II (Iterative Exploitation): Planning, Validation, Execution, and Evaluation agents interact with