Network- and Device-Level Cyber Deception for Contested Environments Using RL and LLMs

Abhijeet Sahu, Shuva Paul, and Richard Macwan · 2026

Read Network- and Device-Level Cyber Deception for Contested Environments Using RL and LLMs by Abhijeet Sahu, Shuva Paul, and Richard Macwan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17272.txt.

Introduction

Sahu, Paul, and Macwan review AI based cyber deception for contested networks, with a focus on language models joined with reinforcement learning. Classic deception tools, like honeypots and address randomization, are costly to build and need much human care. The authors survey network level and device level methods. They ask how language models and reinforcement learning can learn sharper, cheaper deception strategies. They also check how such strategies fare against stealthy attacks on operational technology systems in the literature.

Catalog record

CREATORAbhijeet Sahu, Shuva Paul, and Richard Macwan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43861
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17272

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Network- and Device-Level Cyber Deception for Contested Environments Using RL and LLMs Abhijeet Sahu, Shuva Paul, and Richard Macwan Abstract Cyber deception assists in increasing the attacker’s budget in reconnaissance or any early phases of threat intrusions. In the past, numerous methods of cyber deception have been adopted, such as IP address randomization, the creation of honeypots and honeynets mimicking an actual set of services, and networks deployed within an enterprise or operational technology (OT) network. These types of strategies follow naive approaches of recreating services that are expensive and that need a lot of human intervention. The advent of cloud services and other automations of containerized applications, such as Kubernetes, makes cyber defense easier. Yet, there remains a lot of potential to improve the accuracy of these deception strategies and to make them cost-effective using artificial intelligence (AI)-based solutions by making the deception more dynamic. Hence, in this work, we review various AI-based solutions in building network- and device-level cyber deception methods in contested environments. Specifically, we focus on leveraging the fusion of large language models (LLMs) and reinforcement learning (RL) in optimally learning these cyber deception strategies and validating the efficacy of such strategies in some stealthy attacks against OT systems in the literature. I Introduction Cyberattacks are becoming increasingly evasive against traditional prevention and detection mechanisms, including endpoint detection and response platforms, firewalls, and intrusion detection systems. A fundamental challenge in cybersecurity defense is the inherent asymmetry between attackers and defenders [ 13 ] . Adversaries can conduct reconnaissance, probing, and lateral movement over extended periods, whereas defenders are required to detect and respond within minutes or seconds. This imbalance is particularly critical in operational technology (OT) environments, where delayed response can translate into physical system disruption. Cyber deception has emerged as a complementary defense paradigm designed to address this asymmetry [ 7 ] . Instead of merely detecting malicious activity, deception techniques intentionally manipulate an adversary’s perception by introducing misinformation, decoy assets, and controlled misrepresentations of system state [ 15 ] . By increasing attacker uncertainty and resource expenditure, deception shifts the cost balance in favor of the defender. Deception mechanisms are broadly categorized as: (1) mutations , involving dynamic changes to configurations such as IP addresses and routing paths, and (2) misrepresentations , involving fabricated services or altered responses that mislead reconnaissance efforts [ 1 , 10 ] . In practice, effective deception must adapt to attacker behavior across multiple stages, including reconnaissance, man-in-the-middle (MITM) positioning, and malicious command injection. Static deception artifacts are often detectable by skilled adversaries through timing analysis, protocol inconsistencies, or behavioral fingerprinting. Reinforcement learning (RL) provides a principled framework for adaptive decision-making in adversarial environments [ 25 ] . RL has been successfully applied to intrusion detection, automated response, network traffic optimization, and adaptive authentication [ 2 , 3 , 8 ] . However, its application to cyber deception—particularly in OT systems—remains underexplored. Existing works primarily focus on simulation-based routing policies or low-interaction honeypots, without incorporating protocol-aware host emulation or evaluation against stronger adversary models. While RL can optimize network-level deception strategies such as rerouting or traffic shaping, modeling host-level deception as a Markov decision process (MDP) [ 22 ] is infeasible due to the high-dimensional and stateful nature of industrial control system (ICS) protocols. In particular, Distributed Network Protocol 3 (DNP3) outstations must preserve timing semantics, master–outstation state consistency, unsolicited messaging behavior, and command validation logic. Capturing such behavior with classical state abstractions is prohibitively complex. To address this limitation, we integrate large language models (LLMs) as protocol-aware host-level deception agents capable of generating context-consistent DNP3 responses. Unlike prior LLM-based SSH or HTTP honeypots, our approach incorporates OT-specific timing constraints, state transitions, and command semantics. Importantly, deception quality is not evaluated solely through token-similarity or perplexity metrics. Instead, we incorporate bounded and normalized reward engineering, attacker task success rate, deception engagement duration, and human realism scoring to rigorously assess effectiveness. We formalize a composite cyber-physical reward function that is explicitly bounded to prevent degenerate routing policies or reward hacking. Furthermore, we define a staged adversary capability model that includes reconnaissance probing, MITM manipulation of DNP3 traffic, and malicious command injection. This enables evaluation under stronger and more realistic attacker assumptions than prior simulation-only studies. The primary contributions of this work are: 1. A formally defined single- and multi-agent RL framework for adaptive network-level deception with bounded composite reward design. 2. The first protocol-aware LLM-driven honeypot for DNP3 outstations that preserves ICS timing and state semantics. 3. A composite RL–LLM architecture enabling coordinated network and host level deception. 4. Computational overhead analysis and deployment considerations for real-time OT environments. The remainder of this paper is organized as follows. Section II reviews prior work in RL-driven deception and LLM-based honeypots and clarifies the novelty of our OT-focused approach. Section III formalizes the contested environment and adversary model. Section IV details the normalized reward formulation and RL–LLM integration. Section V evaluates the efficacy of the single- and multi-agent RL approach along with the LLM-assisted host-based deception strategy within the RL environment. II Background This section reviews prior work relevant to network- and host-level deception, operational technology (OT) protocol vulnerabilities, and learning-based adaptive deception. In contrast to existing work that treats network deception and host emulation independently, our work explicitly models their joint interaction under a formal decision-theoretic framework. II-A DNP3 and OT Threat Landscape Distributed Network Protocol 3 (DNP3) [ 6 ] is widely deployed in supervisory control and data acquisition (SCADA) systems for monitoring and control of substations, remote terminal units (RTUs), and intelligent electronic devices (IEDs). DNP3 follows a master–outstation architecture and supports both point-to-point and multi-drop topologies. A critical security limitation of legacy DNP3 deployments is that the protocol was originally designed without encryption or authentication. Although DNP3 Secure Authentication and TLS-based variants have been proposed, large-scale deployment remains limited due to legacy device constraints, certificate management overhead, and strict real-time latency requirements [ 31 ] . Consequently, many operational environments continue to expose clear-text DNP3 traffic. This creates several attack surfaces such as Reconnaissance through traffic inspection and polling analysis, Man-in-the-middle (MITM) manipulation of payload while DNP3 master and outstation communications, unauthorized command injections/ replay attacks, fingerprinting RTU OS details through DNP3 responses. In this work, we assume an adversary has achieved initial foothold and operates as a MITM between a DNP3 master and an RTU. This assumption reflects realistic post-compromise scenarios observed in OT environments. Our objective is not intrusion detection alone, but strategic deception under partial compromise conditions. II-B Objective of Cyber Deception in Critical Infrastructure Cyber deception seeks to manipulate attacker perception by presenting controlled misinformation, decoy services, or altered environmental signals. Unlike passive defenses, deception aims to alter attacker decision trajectories. Mathematically, deception would introduce a controlled perturbation \delta into the attacker’s belief state b_{t} , such that: b_{t+1}=f(b_{t},o_{t}+\delta), where o_{t} represents attacker observations. The defender’s objective would be to maximize: \mathbb{E}\left[C_{attack}-C_{defense}\right], where C_{attack} is attacker cost and C_{defense} is operational overhead. In critical infrastructure such as electric grids, deception must satisfy additional constraints such as avoid detectable anomalies in timing or protocol behavior, avoid interference with real-time operational control, maximize high-fidelity attacker telemetry. Unlike traditional IT honeypots, OT deception must preserve deterministic timing

Read the complete text