Environment-Grounded Multi-Agent Workflow for Autonomous Penetration Testing

Michael Somma 1 3 , Markus Großpointner 1 2 , Paul Zabalegui 4 , Eppu Heilimo 5 , Branka Stojanović 1 · 2026

Read Environment-Grounded Multi-Agent Workflow for Autonomous Penetration Testing by Michael Somma 1 3 , Markus Großpointner 1 2 , Paul Zabalegui 4 , Eppu Heilimo 5 , Branka Stojanović 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24221.txt.

Introduction

Somma and co-authors use language models to automate penetration testing of robotic systems. Robots are networked cyber-physical systems, so their security matters in industry and logistics. Their multi-agent design is grounded in the test environment. During a run, the agents build a shared graph memory of topology, channels, flaws, and tried exploits. They test the system on a robotics Capture-the-Flag setup with ROS and ROS2. The system solved the challenge in all five runs, they report, while keeping traceability and human oversight.

Catalog record

CREATORMichael Somma 1 3 , Markus Großpointner 1 2 , Paul Zabalegui 4 , Eppu Heilimo 5 , Branka Stojanović 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30535
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24221

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Environment-Grounded Multi-Agent Workflow for Autonomous Penetration Testing Michael Somma 1 3 , Markus Großpointner 1 2 , Paul Zabalegui 4 , Eppu Heilimo 5 , Branka Stojanović 1 Abstract The increasing complexity and interconnectivity of digital infrastructures make scalable and reliable security assessment methods essential. Robotic systems represent a particularly important class of operational technology, as modern robots are highly networked cyber-physical systems deployed in domains such as industrial automation, logistics, and autonomous services. This paper explores the use of large language models for automated penetration testing in robotic environments. We propose an environment-grounded multi-agent architecture tailored to Robotics-based systems. The approach dynamically constructs a shared graph-based memory during execution that captures the observable system state, including network topology, communication channels, vulnerabilities, and attempted exploits. This enables structured automation while maintaining traceability and effective context management throughout the testing process. Evaluated across multiple iterations within a specialized robotics Capture-the-Flag scenario (ROS/ROS2), the system demonstrated high reliability, successfully completing the challenge in 100% of test runs (n=5). This performance significantly exceeds literature benchmarks while maintaining the traceability and human oversight required by frameworks like the EU AI Act. I Introduction As digital infrastructures become increasingly complex and interconnected, the need for reliable, scalable, and efficient security assessment methods is growing rapidly [ 1 , 2 ] . This challenge is particularly pronounced in Operational Technology (OT) environments due to their increasing connection to IT networks [ 3 ] , where cyber vulnerabilities can directly impact physical processes and safety-critical systems [ 4 ] . Unlike traditional IT infrastructures, OT networks often rely on legacy protocols, require strict operational uptime, and offer limited tolerance for intrusive interventions. These characteristics create unique constraints for security analysis and risk mitigation, demanding approaches that balance thorough assessment with operational safety [ 5 ] . Robotic systems represent a particular and increasingly important class of OT environments [ 6 , 7 ] . Modern robots are highly networked cyber-physical systems deployed in domains such as industrial automation, logistics, and autonomous service applications [ 8 , 9 ] . Middleware frameworks such as ROS and ROS2 have become a de facto standard for building distributed robotic architectures [ 10 ] . While this modular communication paradigm accelerates development, it also introduces significant attack surfaces through exposed topics, services, and nodes, as well as historically permissive default configurations [ 11 ] . Recent advancements in Large Language Models (LLMs) have opened new possibilities for partially automating security tasks such as reconnaissance, vulnerability triage, exploit generation, and reporting. Their ability to generalize across tasks and adapt to diverse inputs makes them attractive for complex security workflows [ 12 , 13 , 14 , 15 ] . However, relying on a single LLM for penetration testing is often insufficient due to limited long-term memory, weak role separation, and reduced traceability of decisions. Furthermore, regulatory frameworks such as the EU AI Act [ 16 ] introduce requirements for traceability, technical documentation, and effective human oversight, particularly for safety-relevant AI systems. Purely monolithic LLM-based solutions may struggle to satisfy these requirements in practical deployments. In this context, multi-agentic LLM-systems promise to automate complex processes such as penetration testing by orchestrating specialized agents and decomposing large challenges into manageable sub-problems. In this work, we explore how the advantages of LLMs and multi-agent systems can be leveraged while improving regulatory alignment. To this end, we propose an environment-grounded multi-agent architecture tailored for ROS-based penetration testing. Rather than relying on predefined knowledge structures, the system dynamically constructs a shared graph-based memory during execution that is anchored in observable system state. This memory incrementally captures the discovered network topology and operational artifacts, including nodes, communication channels, vulnerabilities, and attempted exploits. This approach improves coordination, reduces redundant exploration, and provides a transparent record of agent reasoning and actions. We evaluate the workflow based on a recent taxonomy [ 17 ] for multi-agent LLM-systems and in a robotics capture-the-flag (CTF) environment. Results are compared against a literature state-of-the-art, and we additionally analyze performance across different LLM-architectures and model sizes to investigate how smaller state-of-the-art models affect effectiveness and efficiency. II Related Work Recent advances in LLM-driven offensive security have led to a new generation of semi-autonomous penetration-testing assistants. Early systems [ 18 , 19 ] position LLMs primarily as interactive copilots that support human operators through script generation, command suggestions, and tool orchestration. These approaches focus on augmenting productivity rather than replacing human decision-making, providing recommendations that still require continuous supervision. While they demonstrate the usefulness of natural-language interfaces for security workflows, they remain fundamentally human-driven, achieving only a low degree of automation and falling short of true semi-autonomous operation. More recent research moves toward modular automation. PentestGPT [ 14 ] introduces a structured pipeline in which discrete sub-tasks, such as reconnaissance, vulnerability scanning, and output interpretation, are partially automated through specialized prompts and tool integrations. This modularization represents an important step toward scalable workflow orchestration. However, the strong separation between modules makes system behavior difficult to interpret from an external perspective and limits the ability to generate new tasks dynamically based on previously discovered knowledge. In addition, reliance on external proprietary models raises concerns regarding privacy, reproducibility, and deployment in sensitive environments. Multi-agent architectures such as HackSynth [ 20 ] explore planner-summarizer paradigms to coordinate complex attack sequences. By delegating planning and summarization to distinct agents, these systems demonstrate emerging autonomous capabilities and improved task sequencing. Nevertheless, their reliance on summarization as the primary mechanism for context transfer can introduce information loss, which limits long-term consistency and reduces the persistence of operational knowledge across workflow steps. Other work focuses on specialized phases of the attack lifecycle. AutoAttacker [ 13 ] , for instance, emphasizes post-exploitation automation and demonstrates how LLMs can execute hands-on-keyboard activities without direct human input. Although this represents a significant advance toward operational autonomy within a constrained domain, the system lacks persistent memory structures that would allow multiple specialized agents to robustly share and reuse discovered information about the target system. Across these approaches, traceability and human oversight remain only partially addressed, which poses challenges for two main reasons. First, existing implementations typically rely on logs or ad-hoc summaries that do not allow analysts to reliably reconstruct why specific actions were taken, which contextual information informed them, or how intermediate findings influenced subsequent steps. This limitation becomes particularly critical in regulated or safety-critical environments, where transparent and auditable decision-making processes are essential. Second, emerging regulatory frameworks such as the EU AI Act [ 16 ] introduce explicit requirements for traceability, technical documentation, and effective human oversight, which current systems only partially support. Three major gaps emerge from the current state of the art in LLM-driven automation of penetration testing: 1. Incomplete Automation. Existing solutions demonstrate promising capabilities for isolated tasks or specific phases, but they rarely generate autonomous tasks based on previously discovered findings. As a result, true end-to-end autonomous penetration-testing workflows remain a challenge. 2. Lack of Persistent Context Management. Current approaches lack a context-management mechanism that is decoupled from the repetitive execution steps of the workflow. Architectures either risk losing information between modules or rely heavily on summarization, which introduces inconsistencies and reduces reliability during long-running engagements. 3. Limited Traceability and Human

Read the complete text