Guarding Against Malicious Biased Threats (GAMBiT) Experiments: Revealing Cognitive Bias in Human-Subjects Red-Team Cyber Range Operations Journal: Data in Brief

Brandon Beltz, Jim Doty, Yvonne Fonken, Nikolos Gurney, Brett Israelsen, Nathan Lau, Stacy Marsella, Rachelle Thomas, Stoney Trent, Peggy Wu, Ya-Ting Yang, Quanyan Zhu · 2025

Read Guarding Against Malicious Biased Threats (GAMBiT) Experiments: Revealing Cognitive Bias in Human-Subjects Red-Team Cyber Range Operations Journal: Data in Brief by Brandon Beltz, Jim Doty, Yvonne Fonken, Nikolos Gurney, Brett Israelsen, Nathan Lau, Stacy Marsella, Rachelle Thomas, Stoney Trent, Peggy Wu, Ya-Ting Yang, Quanyan Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20963.txt.

Introduction

Brandon Beltz and co-authors released three datasets in 2025 from experiments where skilled hackers attacked a fake company network. The project, GAMBiT, studies how thinking biases shape attacker choices. Each run placed about twenty attackers in a two-day, self-paced operation on a training range.

The release captures far more than network traffic. It holds background surveys, mind measures, working notes, typed commands, keystroke logs, and the alarms raised by a guard system. Attackers started from the same virtual machine and chased goals such as finding targets and stealing data. Cleaned logs and labels ride along with the raw files. The authors offer the data for work on modeling attackers and testing bias-aware defenses.

Catalog record

CREATORBrandon Beltz, Jim Doty, Yvonne Fonken, Nikolos Gurney, Brett Israelsen, Nathan Lau, Stacy Marsella, Rachelle Thomas, Stoney Trent, Peggy Wu, Ya-Ting Yang, Quanyan Zhu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20963

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Guarding Against Malicious Biased Threats (GAMBiT) Experiments: Revealing Cognitive Bias in Human-Subjects Red-Team Cyber Range Operations Journal: Data in Brief Brandon Beltz, Jim Doty, Yvonne Fonken, Nikolos Gurney, Brett Israelsen, Nathan Lau, Stacy Marsella, Rachelle Thomas, Stoney Trent, Peggy Wu, Ya-Ting Yang, Quanyan Zhu Abstract We present three large-scale human-subjects red-team cyber range datasets from the Guarding Against Malicious Biased Threats (GAMBiT) project. Across Experiments 1–3 (July 2024–March 2025), 19–20 skilled attackers per experiment conducted two 8-hour days of self-paced operations in a simulated enterprise network (SimSpace Cyber Force Platform) while we captured multi-modal data: self-reports (background, demographics, psychometrics), operational notes, terminal histories, keylogs, network packet captures (PCAP), and NIDS alerts (Suricata). Each participant began from a standardized Kali Linux VM and pursued realistic objectives (e.g., target discovery and data exfiltration) under controlled constraints. Derivative curated logs and labels are included. The combined release supports research on attacker behavior modeling, bias-aware analytics, and method benchmarking. Data are available via IEEE Dataport entries for Experiments 1–3. Specifications Table Subject Computer Networks and Communications; Cybersecurity; Human-Subjects Cyber Operations Specific subject area Attacker behavior modeling; intrusion tactics; cognitive biases in cyber operations; network & host activity data Type of data Questionnaires (CSV/JSON); PCAP files; NIDS alerts (Suricata); host keylogs; Bash/Zsh histories; CherryTree operator notes; curated/clean logs How data were acquired Live cyber range exercises on the SimSpace Cyber Force Platform with a standardized Kali Linux start box; hourly and end-of-day surveys; host and network sensors (keylogger, shell history, PCAP, Suricata) Data format Raw and processed (ZIP archives); derivative curated logs Parameters for data collection Two 8-hour sessions per participant; identical starting access; consistent IP addressing per participant range; restricted no-strike subnets; periodic survey prompts Description of data collection Self-paced red-team engagements with intermittent intelligence “triggers”; participants documented intended/applied techniques and reasoning; telemetry captured at network choke points and endpoints; synchronized via platform logging Data source location United States (EST/EDT) Data accessibility IEEE Dataport: Exp. 1: https://ieee-dataport.org/documents/guarding-against-malicious-biased-threats-gambit-experiment-1 Exp. 2: https://ieee-dataport.org/documents/guarding-against-malicious-biased-threats-gambit-experiment-2 Exp. 3: https://ieee-dataport.org/documents/guarding-against-malicious-biased-threats-gambit-experiment-3 Note: large PCAP files are available only for Experiment 1; PCAP files for other experiments can be provided upon request. 1. First-of-kind, multi-modal HSR red-team telemetry: The dataset provides a uniquely comprehensive capture of human-subject red-team (HSR) exercises in a realistic enterprise cyber range. It synchronizes host-level telemetry (e.g., keystroke logs, shell histories, and operating system event traces), network-level data (full packet captures, intrusion detection system alerts, and NetFlow summaries), and human-factors data (psychometric assessments, targeted surveys, operational notes, and self-reports) collected under standardized, repeatable scenarios. This multi-modal alignment enables fine-grained correlation of attacker actions with cognitive and decision-making processes. 2. Bias-aware behavior modeling: The experiments are explicitly designed to elicit and measure specific cognitive biases, loss aversion, base rate neglect, availability heuristic, confirmation bias, and sunk-cost fallacy, through carefully designed cyber ’triggers’ embedded in the network environment. These triggers, grounded in cognitive science and behavioral economics, provide controlled manipulations to evaluate how biases influence tactical choices, persistence on suboptimal attack paths, and susceptibility to deception. The dataset thus supports the development, training, and validation of bias-sensitive analytics, classifiers, and adaptive defenses. 3. Benchmarking realism: The experimental environment consists of an enterprise-like network topology with approximately 40 virtual machines per participant range, populated with realistic services, user activity, and operational traffic. Each participant is provisioned with a standardized Kali “start box” for attack execution, along with realistic boundary conditions such as protected “no-strike” network segments. This fidelity allows the data set to serve as a benchmark for evaluating the ecological validity of cyber defense analytics and to compare performance between research teams, algorithms, and operational contexts. 4. Reusability and broad applicability: Beyond raw telemetry, the dataset includes curated derivatives such as “clean logs,” labeled artifacts, and structured annotations of attacker–trigger encounters. These resources facilitate rapid onboarding into machine learning pipelines, reduce preprocessing burdens, and enable reproducibility studies. The data set is well suited for a range of applications including training and evaluation of intrusion detection systems, development of cognitive vulnerability sensors, educational exercises, and prototyping of adaptive, human-aware cyber defenses. 1 Data Description 1.1 Experimental Context and Motivation The Guarding Against Malicious Biased Threats (GAMBiT) project was established to advance the empirical study of how cognitive biases influence adversary decision-making during realistic, operational-style cyber intrusions [ 8 , 7 ] . Although attacker behavior has been widely examined through theoretical models and simulated environments, there is a notable lack of high-fidelity, human-in-the-loop datasets that capture both detailed operational telemetry and the cognitive states underlying tactical choices. This absence limits the ability of researchers to link observed behaviors directly to the psychological mechanisms that drive them. GAMBiT addresses this gap through a repeated measures red-team exercise format conducted in a fully instrumented, enterprise-grade cyber range. Within these exercises, controlled manipulations, referred to as cognitive-bias triggers , are embedded into realistic attack scenarios. These triggers are designed to induce measurable deviations from optimal or rational strategies and can be systematically attributed to specific heuristics and biases such as loss aversion, base-rate neglect [ 2 ] , confirmation and availability bias [ 18 ] , and sunk-cost persistence [ 16 ] . The methodology integrates principles from cyber operations, experimental psychology, and human factors engineering, creating an empirical bridge between cognitive science theory and operational cybersecurity practice [ 10 ] . The experimental design supports two complementary analytic modes. In within-condition studies, temporal patterns of bias activation and resolution are examined over the course of a single scenario, revealing how biases emerge, persist and dissipate during ongoing operations. In cross-condition comparisons, trigger-present and trigger-absent runs are contrasted to isolate the causal impact of cognitive stimuli on attacker workflows, tool selection, and mission success rates. This dual perspective enables both a detailed characterization of bias manifestation in operational contexts and an assessment of its measurable influence on performance. From a practical standpoint, the GAMBiT dataset is intended to support the development of bias-aware cyber defense strategies, targeted training interventions, and decision-support systems that account for human cognitive tendencies [ 1 , 6 , 5 , 22 , 20 ] . The high temporal and semantic granularity of both behavioral and cognitive data makes it uniquely well-suited for machine learning applications, behavioral modeling, and theory-driven human factors research [ 9 , 14 ] . Furthermore, the scenario-controlled and repeatable structure of the experiments provides a robust basis for replication, ablation studies, and integration into larger-scale adversarial modeling frameworks. 1.2 Release Overview The GAMBiT data set comprises three sequential human-subject red-team experiments: HSR1, HSR2, and HSR3 performed in an enterprise-grade cyber range designed for high ecological validity. Each experiment followed tightly controlled, repeatable procedures to enable rigorous measurement of attacker decision-making under varying cognitive-bias conditions. While all phases shared a common network architecture, standardized operational workflow, and synchronized multi-modal data capture framework, they differed in trigger deployment, scenario refinements, and instrumentation depth. These controlled variations were deliberately introduced to distinguish scenario-driven effects from those attributable to cognitive biases, enabling both within-phase and cross-phase behavioral analyses. Table 2 summarizes the schedule, participant counts, and total data volume for each dataset release. Experiment Dates (EST/EDT) Participants Data Size GAMBiT Exp. 1 (HSR1) 2024-07-23 – 2024-09-14 19 722.8 GB GAMBiT Exp. 2 (HSR2) 2024-11-09 – 2025-01-29 20 2.1 TB GAMBiT

Read the complete text