ADAPT: A Game-Theoretic and Neuro-Symbolic Framework for Automated Distributed Adaptive Penetration Testing
Haozhe Lei 1 2 , Yunfei Ge 2 , Quanyan Zhu · 2024
Read ADAPT: A Game-Theoretic and Neuro-Symbolic Framework for Automated Distributed Adaptive Penetration Testing by Haozhe Lei 1 2 , Yunfei Ge 2 , Quanyan Zhu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00217.txt.
Description
Abstract The integration of AI into modern critical infrastructure systems, such as healthcare, has introduced new vulnerabilities that can significantly impact workflow, efficiency, and safety. Additionally, the increased connectivity has made traditional human-driven penetration testing insufficient for assessing risks and developing remediation strategies.
Catalog record
| CREATOR | Haozhe Lei 1 2 , Yunfei Ge 2 , Quanyan Zhu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00217
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ADAPT: A Game-Theoretic and Neuro-Symbolic Framework for Automated Distributed Adaptive Penetration Testing Thanks: 2 Authors contributed equally, 1 Corresponding author, Authors belong to Department of Electrical and Computer Engineering New York University, New York 11201, USA {hl4155, yg2047, qz494}@nyu.edu Haozhe Lei 1 2 , Yunfei Ge 2 , Quanyan Zhu Abstract The integration of AI into modern critical infrastructure systems, such as healthcare, has introduced new vulnerabilities that can significantly impact workflow, efficiency, and safety. Additionally, the increased connectivity has made traditional human-driven penetration testing insufficient for assessing risks and developing remediation strategies. Consequently, there is a pressing need for a distributed, adaptive, and efficient automated penetration testing framework that not only identifies vulnerabilities but also provides countermeasures to enhance security posture. This work presents ADAPT, a game-theoretic and neuro-symbolic framework for automated distributed adaptive penetration testing, specifically designed to address the unique cybersecurity challenges of AI-enabled healthcare infrastructure networks. We use a healthcare system case study to illustrate the methodologies within ADAPT. The proposed solution enables a learning-based risk assessment. Numerical experiments are used to demonstrate effective countermeasures against various tactical techniques employed by adversarial AI. I Introduction Modern artificial intelligence (AI), such as machine learning (ML) technologies, are becoming increasingly integrated into many infrastructures, including smart transportation systems and healthcare infrastructures. In healthcare, they have shown the potential to help healthcare infrastructure in patient scheduling [ 1 , 2 ] , pathological analysis [ 3 ] , and care management [ 4 ] . While there are significant benefits, there are concerns regarding zero-day vulnerabilities and the expanded attack surface. Penetration testing is a valuable ethical hacking method for uncovering vulnerabilities in increasingly complex infrastructures and devising remediation strategies. As these infrastructures become more complex, with millions of interconnected devices, scalability emerges as a critical challenge. It is essential to develop a distributed, modular, and automated approach that addresses device-level testing needs while considering global influences through interconnectivity. Another challenge stems from the dynamic nature of networked devices and their vulnerabilities. There is a growing need for adaptive and automated approaches to continuously update the vulnerability landscape, ensuring that threats are exhaustively identified, risks accurately assessed, and remediation measures properly applied. The third challenge arises from the integration of AI capabilities into the infrastructure. The emergence of adversarial AI/ML introduces new and evolving threat vectors, which are designed to evade detection and testing. There is a need for the development of automated and strategic approaches that can intelligently outmaneuver their evolving nature through continuous knowledge acquisition and learning. To this end, we establish a game-theoretic and neuro-symbolic framework for automated distributed adaptive penetration testing (ADAPT). Fig. 1: The framework of the ADAPT: The upper half illustrates an online automated adaptation of penetration testing. It integrates game-theoretic and neuro-symbolic frameworks, consisting of five distinct building blocks (to be introduced in Section III). The lower half depicts an example of AI-enabled healthcare infrastructure. This AI-enabled infrastructure presents an expanded attack surface due to interconnectivity and zero-day vulnerabilities. To address the challenges in penetration testing within AI-enabled healthcare infrastructure networks, ADAPT consolidates the game-theoretic framework and the neuro-symbolic framework, shown in the Figure 1 . The game-theoretic and neuro-symbolic framework consists of five building blocks. The macro-game and micro-game blocks serve as representations of the given system. Game-theoretic strategies are updated based on the selected attack models through neural learning in the online learning blocks. Different attack models are represented using game trees, which encode relevant attack and defense actions selected from the knowledge. This knowledge contains vulnerabilities of the health infrastructure that are shared among multiple stakeholders in the medical system. When new paths or vulnerabilities are discovered through exploration (e.g., automated fuzzing techniques [ 5 ] ) and penetration testing, the knowledge base is generated and updated accordingly. ADAPT helps medical systems evaluate their AI-enabled network for scalability, the impact of reachability, and the exhaustiveness of risk identification, and protects the confidentiality, integrity, and availability of the AI model. The purpose of it is to ensure preparedness against continuously evolving malicious threats such as ransomware and zero-day attacks on healthcare infrastructures. II Related Works Traditional manual penetration testing performed by skilled IT professionals is time-consuming, resource-intensive, and prone to human error [ 6 ] . Current automated penetration testing methods, despite advancements in efficiency, are becoming increasingly non-standard, complex, and resource-intensive. Reinforcement learning (RL) or Markov Decision Process (MDP) based methods [ 7 , 8 ] suffer from the curse of dimensionality, as they define the state space as the collection of all known information for each machine on the network. Partially Observable Markov Decision Process (POMDP) methods [ 9 ] face scalability issues, making it unfeasible to model and solve for large networks. As state-of-the-art technology, AI models present relatively higher risks compared to traditional methods [ 10 ] . Several studies have demonstrated that AI models can be easily subjected to malicious data-poisoning attacks in not only regression tasks [ 11 ] but also image classification [ 12 ] and robotics control [ 13 ] . In addition to directly degrading the ML model, evidence also points to various other types of attacks, such as DDoS attacks [ 14 ] and bypassing attacks [ 15 ] . These findings underscore the significant threat posed by attackers and a wide range of vulnerabilities for the AI-enabled system. III ADAPT Framework and Methodologies This section, we present the ADAPT framework introduced in Figure 1. It consists of a meta-game framework and a neuro-symbolic framework. III-A Meta-game-based Automated Penetration Testing We propose a meta-security game over a network graph where the macro strategic game represents strategic attack activities between nodes, while the micro tactic game details tactic-level attack procedures on each local node. Let the directed graph \mathcal{G}=\langle\mathcal{V},\mathcal{E}\rangle represent the target network topology, where \mathcal{V} is a set of nodes (e.g., server, database, device), and \mathcal{E}\subseteq\mathcal{V}\times\mathcal{V} is a set of directed edges representing connections (e.g., SSH, RDP, cloud services) from node u to node v . Self-loops are allowed as they indicate continued exploration of the same node. Let v^{0}\in\mathcal{V} be the initial foothold in the system. As an ethical attacker, the penetration tester aims to explore available information, exploit discovered vulnerabilities, and influence critical assets inside the healthcare infrastructure network. Micro Tactic Games: To model the interactions between the attacker and the defender at each local node, we use extensive-form game tree to explicitly and visually represent the sequential moves, possible outcomes, and information available at each decision point. We assume that all players have perfect recall; i.e., the player remembers every piece of information that he knows from the past, including his moves, the other player’s moves, or chance moves. The structure of the game tree is inspired by the intrusion kill chain [ 16 ] , a concept that outlines the structure of intrusions. This model guides analysis to inform actionable security intelligence. For each node v\in\mathcal{V} in the network, the Micro Tactic Game (MTG) is defined as \Gamma^{v}=\langle\mathcal{N}\cup\{c\},\mathcal{H}^{v},P,\{\mathcal{A}^{v}_{i}\}_{i\in\mathcal{N}\cup c},\sigma^{v}_{c},\{u^{v}_{i}\}_{i\in\mathcal{N}},\mathcal{Z}^{v}\rangle . Here, \mathcal{N}=\{a,d\} represents the players, the attacker (a) and the defender (d), while c represents system randomness with fixed policy \sigma^{v}_{c} . Each vertex h\in\mathcal{H}^{v} in the game tree represents a sequence of actions, referred to