Design principles for the Construction of a Benchmark Evaluating Security Operation Capabilities of Multi-agent AI Systems

Yicheng Cai, Mitchell John DeStefano, Guodong Dong, Pulkit Handa · 2026

Read Design principles for the Construction of a Benchmark Evaluating Security Operation Capabilities of Multi-agent AI Systems by Yicheng Cai, Mitchell John DeStefano, Guodong Dong, Pulkit Handa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28998.txt.

Introduction

Cai and co-authors set out design principles for a benchmark of security operation skills in multi-agent AI systems. Most existing benchmarks test red team skills, yet security centers are dominated by blue team work. No systematic benchmark for coordinated blue team AI existed, they note. Their principles guide the construction of SOC-bench. A conceptual design follows from the principles. It holds a family of five blue team tasks. All five sit in the context of large scale ransomware attack incident response.

Catalog record

CREATORYicheng Cai, Mitchell John DeStefano, Guodong Dong, Pulkit Handa
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63851
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.28998

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Design principles for the Construction of a Benchmark Evaluating Security Operation Capabilities of Multi-agent AI Systems Thanks: Corresponding author Yicheng Cai, Mitchell John DeStefano, Guodong Dong, Pulkit Handa Abstract As Large Language Models (LLMs) and multi-agent AI systems are demonstrating increasing potential in cybersecurity operations, organizations, policymakers, model providers, and researchers in the AI and cybersecurity communities are interested in quantifying the capabilities of such AI systems to achieve more autonomous SOCs (security operation centers) and reduce manual effort. In particular, the AI and cybersecurity communities have recently developed several benchmarks for evaluating the red team capabilities of multi-agent AI systems. However, because the operations in SOCs are dominated by blue team operations, the capabilities of AI systems & agents to achieve more autonomous SOCs cannot be evaluated without a benchmark focused on blue team operations. To our best knowledge, no systematic benchmark for evaluating coordinated multi-task blue team AI has been proposed in the literature. Existing blue team benchmarks focus on a particular task. The goal of this work is to develop a set of design principles for the construction of a benchmark, which is denoted as SOC-bench , to evaluate the blue team capabilities of AI. Following these design principles, we have developed a conceptual design of SOC-bench, which consists of a family of five blue team tasks in the context of large-scale ransomware attack incident response. K eywords SOC-bench \cdot Design principles \cdot Multi-agent AI systems 1 Introduction Security Operation Centers (SOCs) are addressing a fundamental societal challenge: enabling organizations (e.g., enterprises across various industry sectors, educational institutions, governments) to deal with cyber threats. The action-taking aspect of a SOC is supported by a sophisticated decision-making process, and this process involves a combination of both lower-order cognitive skills (e.g., summarizing, retrieval, recall) and higher-order cognitive skills (e.g., explanation, evaluation, reasoning). Accordingly, today’s cybersecurity operations are heavily relying on manual effort, though security teams do leverage a variety of information technology tools such as Intrusion Detection systems, SIEM (Security Information Event Management) systems, and SOAR (Security Orchestration, Automation and Response) tool suites. As Large Language Models (LLMs) and multi-agent AI systems are demonstrating increasing potential in cybersecurity operations, organizations, policymakers, model providers, and researchers in the AI and cybersecurity communities are interested in quantifying the capabilities of such AI systems to achieve more autonomous SOCs and reduce manual effort. In particular, the AI and cybersecurity communities have recently developed several benchmarks (e.g., Cybench [ 29 ] , CyberGym [ 25 ] ) for evaluating the red team capabilities (e.g., penetration testing) of multi-agent AI systems. Taking Cybench [ 29 ] as an example, it includes 40 professional-level Capture the Flag (CTF) tasks from 4 distinct CTF competitions, spanning a wide range of difficulties. However, because the operations in a SOC are dominated by blue team operations, the capabilities of multi-agent AI systems to achieve more autonomous SOCs cannot be evaluated without a benchmark focused on blue team operations. (To the best of our knowledge, no systematic benchmark for evaluating coordinated multi-task blue team AI has been proposed in the literature. Existing blue team benchmarks focus on a particular task (e.g., indicators extraction from threat reports). ) The goal of this work is to develop a set of design principles for the construction of a benchmark, which is denoted as SOC-bench , to evaluate blue team operation capabilities of multi-agent AI systems. Due to the fundamental differences between red team and blue team operations, the design principles we seek to develop are very different from the existing work focused on developing a benchmark evaluating read team AI. In particular, five design principles are identified: (DP1) Except for only allowing humans to serve as a supervisor, the as-is SOC (incident response) system, not the to-be SOC system, serves as the gold standard. (DP2) Because AI systems should autonomously explore and leverage the interdependence between the family of blue team tasks, SOC-bench should not provide AI systems with any cross-task hints. (DP3) AI systems could go beyond mimicking humans. (DP4) Real-world SOC (incident response) systems are inherently imperfect. (DP5) SOC-bench should not be specific to any current capabilities of AI systems. In order to validate these design principles, we have followed these principles and developed a conceptual design of SOC-bench which consists of a family of five blue team tasks in the context of large-scale ransomware attack incident response: (Task Fox) Early cyberattack campaign detection; (task Goat) file system forensics; (task Mouse) data exfiltration analysis; (task Tiger) analysis of indicators of compromise (IOCs) to attribute the attack and report the used Tactics, Techniques, and Procedures (TTPs); (task Panda) recommending containment actions. The rest of this paper is organized as follows. In Section 2, we explain why a benchmark focused on evaluating blue team AI agents would play an indispensable role in the technology adoption lifecycle of real-world SOCs in the era of AI. In Section 3, we present a set of design principles for SOC-bench. In Section 4, we provide an overview of the conceptual design of SOC-bench. From Section 5 to Section 9, we present the five major blue team tasks of our conceptual design. In Section 10, we conclude the paper. 2 Why SOC-bench? SOC-bench is clearly not the first benchmark in the intersection of Cybersecurity and AI. In fact, there are a number of benchmarks (e.g., [ 27 , 7 , 10 ] ) in the intersection. From the viewpoint of real-world cybersecurity operations, the existing benchmarks as well as the potentially meaningful benchmarks can be broken into the following categories: • Red Team - Penetration Testing benchmarks . Benchmarks (e.g., [ 30 ] ) in this category assume the standard real-world penetration testing setup, where each to-be-tested vulnerability has a particular CVE number. • Red Team - Vulnerability Discovery benchmarks . Benchmarks (e.g., [ 28 ] ) in this category are used to evaluate the capabilities of AI systems to identify unknown vulnerabilities. • Red Team - Competition . Benchmarks in this category are used to evaluate the capabilities of AI systems to win a competition. Such competition not only include Capture-the-Flag (CTF) competitions (e.g., the DARPA AI Cyber Challenge [ 4 ] ), but also include AI model specific competitions (e.g., adversarial examples against DNN models, backdoor attacks against AI models). • Blue Team - Single Task . Benchmarks (e.g., [ 5 ] ) in this category focus on a particular task performed by blue teams. For example, a benchmark may be developed to evaluate whether an AI system can effectively extract IOCs from CTI (Cyber Threat Intelligence) reports. For another example, a benchmark can be developed to evaluate whether an AI system can correctly generate patches. • Blue Team - Incident Response . In the presence of large-scale cyberattack campaigns, real-world incident response processes are never a single task process. In contrast, it is a sophisticated real-time process that involves seamless coordination of multiple security teams working on a family of complementary tasks. Some of the representative tasks include early detection of cyberattack campaigns, preliminary system forensics, data exfiltration analysis, attack containment, threat intelligence analysis, risk management, and recovery. • Blue Team - Competition . Benchmarks (e.g., [ 8 ] ) in this category are

Read the complete text