STRIATUM-CTF: A Protocol-Driven Agentic Framework for General-Purpose CTF Solving

James Hugglestone 1 , Samuel Jacob Chacko 1 , Dawson Stoller, Ryan Schmidt, Xiuwen Liu · 2026

Read STRIATUM-CTF: A Protocol-Driven Agentic Framework for General-Purpose CTF Solving by James Hugglestone 1 , Samuel Jacob Chacko 1 , Dawson Stoller, Ryan Schmidt, Xiuwen Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22577.txt.

Introduction

Hugglestone and co-authors present STRIATUM-CTF, an agent framework for solving capture-the-flag security challenges. Language models handle code well but falter on long, stateful attack chains. Their system plugs tools for inspection, decompilation, and debugging into one protocol, so the agent keeps a steady context. They entered the system in a live university contest in late 2025. It won first place against twenty-one human teams. Log analysis shows the shared tool protocol cuts made-up steps compared with plain prompting.

Catalog record

CREATORJames Hugglestone 1 , Samuel Jacob Chacko 1 , Dawson Stoller, Ryan Schmidt, Xiuwen Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34281
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22577

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

STRIATUM-CTF: A Protocol-Driven Agentic Framework for General-Purpose CTF Solving James Hugglestone 1 , Samuel Jacob Chacko 1 , Dawson Stoller, Ryan Schmidt, Xiuwen Liu Abstract Large Language Models (LLMs) have demonstrated potential in code generation, yet they struggle with the multi-step, stateful reasoning required for offensive cybersecurity operations. Existing research often relies on static benchmarks that fail to capture the dynamic nature of real-world vulnerabilities. In this work, we introduce STRIATUM-CTF (A S earch-based T est-time R easoning I nference A gent for T actical U tility M aximization in Cybersecurity), a modular agentic framework built upon the Model Context Protocol (MCP). By standardizing tool interfaces for system introspection, decompilation, and runtime debugging, STRIATUM-CTF enables the agent to maintain a coherent context window across extended exploit trajectories. We validate this approach not merely on synthetic datasets, but in a live competitive environment. Our system participated in a university-hosted Capture-the-Flag (CTF) competition in late 2025, where it operated autonomously to identify and exploit vulnerabilities in real-time. STRIATUM-CTF secured First Place , outperforming 21 human teams and demonstrating strong adaptability in a dynamic problem-solving setting. We analyze the agent’s decision-making logs to show how MCP-based tool abstraction significantly reduces hallucination compared to naive prompting strategies. These results suggest that standardized context protocols are a critical path toward robust autonomous cyber-reasoning systems. 1 These authors contributed equally. I Introduction Offensive security assessments, including penetration testing, red-teaming, and Capture-the-Flag (CTF) competitions, remain predominantly manual and labor-intensive endeavors. To successfully compromise a target, analysts must execute a complex, non-linear workflow: enumerating vast attack surfaces, interpreting verbose scanner outputs, selecting appropriate exploitation primitives, and iteratively tuning payloads to bypass defenses. While powerful tools exist for specific phases (e.g., Nmap, Ghidra, Hashcat), the orchestration of these tools remains a cognitive bottleneck. Human operators must act as the “glue,” manually parsing data from one tool to feed into another, a process that is prone to errors and cognitive biases such as confirmation bias [ 1 ] , and is increasingly difficult to scale with the rapid cadence of modern software delivery pipelines. As system complexity grows, the sheer volume of alerts and the requirement for continuous context switching lead to alert fatigue, degrading the operator’s ability to maintain high-fidelity mental models of the target environment [ 7 ] . The emergence of Large Language Models (LLMs) [ 26 ] offers a potential paradigm shift. Their ability to process unstructured text and generate code makes them well-suited to automate the high-level reasoning required to connect these disparate tools. However, early attempts to build autonomous security agents have faced significant architectural hurdles [ 8 ] . Existing methods largely fall into two categories: “copilots” that require constant human prompting, or “naive autonomous agents” that simply pipe model output into a shell [ 9 ] . Recent evaluations of these naive approaches reveal critical vulnerabilities beyond simple hallucination. For instance, Inter-Agent Trust Exploitation [ 12 ] has shown that LLMs often blindly execute malicious payloads if they originate from peer agents, lacking the introspection to verify the origin of a command. Furthermore, while models like GPT-4o [ 10 ] excel at high-level planning, they suffer from a Reasoning-Action Gap [ 25 ] , where the model correctly identifies a vulnerability (e.g., SQL injection) but fails to generate the syntactically correct payload to exploit it due to a lack of grounded environment feedback, frequently hallucinating non-existent command-line flags or software packages, a failure mode that introduces downstream supply-chain risks such as slopsquatting [ 15 ] . This disconnect is deepened in long-horizon tasks, where “context drift” causes the agent to lose track of early reconnaissance data [ 11 ] , further observed in recent surveys on LLM hallucinations in cybersecurity [ 24 ] , leading to loops of redundant, failed attempts. To address these limitations, we introduce STRIATUM-CTF (A S earch-based T est-time R easoning I nference A gent for T actical U tility M aximization in Cybersecurity), a neuro-symbolic agentic framework that decouples neural reasoning from tool execution using the Model Context Protocol (MCP) [ 2 ] for solving CTF problems. By formalizing the interface between the LLM and the execution environment, we transform the model from a passive text generator into an active system operator. Internally, the agent is equipped with a curated arsenal of offensive capabilities, including symbolic execution via Angr [ 21 ] , static analysis with Ghidra [ 14 ] , and runtime debugging through GDB. Externally, a containerized environment exposes industry-standard reconnaissance and exploitation utilities such as Nmap, Nuclei, FFUF, and TLSX, allowing the agent to interact with the target system safely and reproducibly. Upon receiving a high-level objective, STRIATUM-CTF autonomously formulates a multi-step plan, invokes tools via structured MCP calls, parses standard error streams to self-correct failed attempts, and iterates until the objective is achieved or the search space is exhausted. This paper makes the following contributions to the field of autonomous cyber-operations: 1) A Protocol-Driven Agentic Architecture: We propose a novel framework that utilizes the Model Context Protocol to standardize LLM interactions with offensive security tools, reducing hallucinations by collapsing the output manifold via strict schema compliance for tool invocation, and enabling robust error recovery through structured feedback loops; 2) Integration of Specialized Analysis Primitives: We integrate complex, domain-specific tooling, including symbolic execution (Angr) and dynamic debugging (GDB), within an LLM’s context window, allowing deep binary analysis and exploit generation beyond simple scripting; and 3) Validation via Live Competition: We empirically demonstrate the system’s efficacy with a first-place victory in a live, multi-team Capture-the-Flag competition, providing a rigorous case study of autonomous agent performance under time constraints and dynamic uncertainty compared to human baselines. The code and data will be made available upon acceptance. II Related Work The evolution of LLMs from static knowledge bases to active agents relies on scaling test-time compute, allocating computational resources to iterative reasoning during inference rather than relying solely on pre-trained weights [ 23 ] . While early approaches like Toolformer [ 19 ] and Gorilla [ 16 ] attempted to bake tool usage into the model via fine-tuning, this strategy remains rigid and prone to becoming obsolete as APIs change. Modern research increasingly favors dynamic, inference-time planning; however, purely neural reasoning strategies like Chain-of-Thought [ 28 ] still suffer from functional hallucination, where the model confidently generates syntactically invalid commands. Our work bridges this gap by extending test-time compute into the symbolic domain. By utilizing the MCP as a hard constraint layer, similar to grammar-constrained decoding [ 17 , 7 ] , we transform the inference process from a probabilistic random walk into a structured, deterministic search, effectively grounding the model’s “thinking” time in verified system feedback. While techniques such as ReAct (Reasoning and Acting) [ 30 ] successfully integrate trace generation with action execution, they fundamentally rely on the Large Language Model’s context window to maintain the entire history of the conversation. In long-horizon scenarios such as CTF competitions, which often require hundreds of interaction turns, this dependency becomes a critical vulnerability. Empirical analyses on long-context attention [ 11 ] demonstrate that transformer architectures suffer from “context drift,” where the model’s ability to retrieve and attend to early-state constraints degrades as the context window fills. In

Read the complete text