A Human Study of Cognitive Biases in Web Application Security Conference: Hot Topics in the Science of Security ; April 2025; virtual ISBN: 978-1-4503-XXXX-X/18/06 CCS: Security and privacy Usability in security and privacy CCS: Security and privacy Social aspects of security and privacy CCS: Applie

Yuwei Yang, Skyler Grandel, Daniel Balasubramanian, Yu Huang, Kevin Leach · 2025

Read A Human Study of Cognitive Biases in Web Application Security Conference: Hot Topics in the Science of Security ; April 2025; virtual ISBN: 978-1-4503-XXXX-X/18/06 CCS: Security and privacy Usability in security and privacy CCS: Security and privacy Social aspects of security and privacy CCS: Applie by Yuwei Yang, Skyler Grandel, Daniel Balasubramanian, Yu Huang, Kevin Leach (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12018.txt.

Introduction

Yuwei Yang and co-authors plant mind traps in a web hacking game to see if bias can blunt attackers, in a study from two thousand twenty-five. Players hunted flags in a flawed web app built for the test. Two biases were targeted: settling after a first find, and fear of loss.

Many players showed the settling bias, and it cost them clear success. Biased players found a quarter fewer flags than clean players on average. Both number and story data back the read. The team frames bias as a tool for training and defense design. Readers in security teaching get proof that minds, not just code, guard the gate.

Catalog record

CREATORYuwei Yang, Skyler Grandel, Daniel Balasubramanian, Yu Huang, Kevin Leach
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12018

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Human Study of Cognitive Biases in Web Application Security Conference: Hot Topics in the Science of Security ; April 2025; virtual ISBN: 978-1-4503-XXXX-X/18/06 CCS: Security and privacy Usability in security and privacy CCS: Security and privacy Social aspects of security and privacy CCS: Applied computing Interactive learning environments Yuwei Yang, Skyler Grandel, Daniel Balasubramanian, Yu Huang, Kevin Leach Abstract . Cybersecurity training has become a crucial part of computer science education and industrial onboarding. Capture the Flag (CTF) competitions have emerged as a valuable, gamified approach for developing and refining the skills of cybersecurity and software engineering professionals. However, while CTFs provide a controlled environment for tackling real-world challenges, the participants’ decision-making and problem-solving processes remain under explored. Recognizing that psychology may play a role in a cyber attacker’s behavior, we investigate how cognitive biases could be used to improve CTF education and security. In this paper, we present an approach to control cognitive biases, specifically Satisfaction of Search and Loss Aversion, to influence and potentially hinder attackers’ effectiveness against web application vulnerabilities in a CTF-style challenge. We employ a rigorous quantitative and qualitative analysis through a controlled human study of CTF tasks. CTF exercises are widely-used in cybersecurity education and research to simulate real-world attack scenarios and help participants develop critical skills by solving security challenges in controlled environments. In our study, participants interact with a web application containing deliberately embedded vulnerabilities while being subjected to tasks designed to trigger cognitive biases. Our study reveals that many participants exhibit the Satisfaction of Search bias and that this bias has a significant effect on their success. On average, participants found 25% fewer flags compared to those who did not exhibit this bias. Our findings provide valuable insights into how cognitive biases can be strategically employed to enhance cybersecurity outcomes, education, and measurements through the lens of CTF challenges. 1. Introduction Computer systems continually face threats from unauthorized access attempts ( Razzaq et al. 2013 ) , leading to costly hacking campaigns ( Cashell et al. 2004 ) . In response to these threats, it has become essential to train cybersecurity professionals to effectively defend against such attacks ( Švábenskỳ et al. 2021 ) . In this context, cybersecurity education has become a critical part of academic curricula for computer science, and Capture the Flag (CTF) competitions have emerged as an engaging, gamified approach for students to practice and refine their skills ( McDaniel et al. 2016 ) . We are particularly interested in exploring how cognitive processes, such as decision-making and problem-solving, affect CTF performance, and whether these insights can help improve participants’ skills and outcomes in such competitions. The Tularosa Study highlighted how crucial defensive deception is in changing the attacker’s decision-making process, which increases a CTF player’s workload and decreases a defender’s ( Ferguson-Walter et al. 2018 ) . However, the exploration of specific cognitive biases in this context remains under explored. Cognitive biases are systematic patterns of deviation from normal or rational judgment, which can significantly shape decision-making processes ( Haselton et al. 2015 ) . By leveraging cognitive biases, we hypothesize that defenders can potentially strategically alter an CTF player’s perception of the system, thereby affecting their behavior and performance ( Barach et al. 2021 ; Gächter et al. 2022 ) . In this paper, we pursue three main objectives: (1) designing instrumentation to evaluate CTF player’s preferences and vulnerability discovery, (2) examining the influence of cognitive biases on how participants attempt to compromise a web application, and (3) assessing changes in participant affective states as a result of inducing cognitive biases in a CTF setting. Specifically, we investigate the effects of Loss Aversion (LA) and Satisfaction of Search (SoS) on these individuals’ actions. These biases are well-understood in other domains, such as economics ( Novemsky and Kahneman 2005 ) and radiology ( Berbaum et al. 1990 ) , but their application in the realm of computer security has not been adequately explored. Loss Aversion refers to the tendency to prefer avoiding losses over acquiring equivalent gains ( Novemsky and Kahneman 2005 ; Tversky and Kahneman 1991 ; Kahneman and Tversky 1984 ) . LA has recently been cited as a significant factor influencing human decision-making in cybersecurity contexts ( The Intelligence Advanced Research Projects Activity (2021) IARPA ) . This makes it a valuable bias to exploit in cybersecurity defenses, as the fear of losing progress or rewards can potentially deter participants from continuing their efforts. Satisfaction of Search is a common cognitive bias where individuals cease their search for solutions once a satisfactory one is found, often leading to missed or overlooked opportunities ( Fleck et al. 2010 ; Barach et al. 2021 ) . This bias is particularly relevant in cybersecurity, as participants may prematurely stop their attacks if they falsely believe they have achieved their goal. In this context, SoS could be exploited using honeypots ( Franco et al. 2021 ; Selvaraj et al. 2016 ) to distract or measure attackers. By incorporating SoS into our experimental design, we aim to understand how creating a false sense of satisfaction can influence participants to abandon their efforts early. To determine the manner and extent that CTF players are affected by these biases, we conducted a controlled experiment with human participants acting as attackers in an instrumented environment. The study procedure is shown in Figure 1 . The detailed process is discussed in Study Design 3 . Figure 1 . Study Procedure. Participants first completed an information sheet and pre-survey, then were randomly assigned to either the Loss Aversion (LA) or Satisfaction of Search (SoS) task. After finishing their first task and an intermediate survey, they completed the second task. All participants finished both tasks and a post-survey, followed by a debrief form. Although participants were told that the compensation is performance based, they were all ultimately compensated $50 regardless of performance. Through rigorous quantitative and qualitative analysis of the surveys (pre, interim, and post-surveys) and performance measurements (key logging data, number of completed tasks, and number of explored flags) from 17 participants, we observed the following key findings: (1) Satisfaction of Search significantly decreases participants’ attacking performance; (2) Satisfaction of Search notably alters participants’ emotional states; (3) Loss Aversion does not significantly impact participants’ decisions to continue with security decision-making tasks; (4) Participants tend to explore the same type of vulnerability repeatedly. The main contributions of this paper are as follows: \bullet An IRB-approved controlled experiment to investigate the impact of cognitive biases on human participants. \bullet A framework that integrates cognitive biases into Capture the Flag tasks, simulating realistic scenarios relevant to web security. \bullet An analysis of cognitive biases’ influence on participants’ performance and affective status. \bullet An investigation of participants’ cognitive patterns and exploring preferences when attacking a web application. \bullet A discussion and set of suggestions for the implications of cognitive biases on CTF education and cyber defense. 2. Background and Related Work In the field of cybersecurity, understanding and mitigating the vulnerabilities of web applications is crucial due to their widespread use and importance in modern information systems ( Li and Xue 2011 ) . 2.1. Vulnerabilities In this paper, we subject human participants to a set

Read the complete text