What is Human in Judgment? Testing Automation Bias and Algorithm Aversion Among United States Military Academy Cadets

2026

Read What is Human in Judgment? Testing Automation Bias and Algorithm Aversion Among United States Military Academy Cadets (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04333.txt.

Introduction

Kahn, Horowitz and Samotin compare automation bias, over-trusting algorithmic advice, and algorithm aversion, distrusting it too soon, in West Point cadets versus the public. In a survey experiment, 236 cadets and a similar public sample did a target task. They then got advice from an algorithm or a human analyst and could revise their call. Cadets showed less cognitive distortion than the public, with better calibrated trust in algorithmic support. The authors read this as evidence that military education and AI exposure shape trust in wartime decisions.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61419
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.04333

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What is Human in Judgment? Testing Automation Bias and Algorithm Aversion Among United States Military Academy Cadets Abstract Human judgment has always been central to conflict and escalation, but how will a world of artificial intelligence (AI) change the role of humans in war? As militaries increasingly adopt AI-enabled decision-support systems (DSS), including the United States in the war against Iran, concerns about automation bias—over-reliance on algorithmic recommendations—and algorithm aversion—premature distrust of automated outputs—raise fears that relying on AI too much could increase the risk of error, miscalculation, and accidents. Yet existing evidence on how militaries actually interact with AI remains limited. We test theories about the susceptibility of militaries to automation bias by comparing the results from a survey experiment conducted with 236 cadets at the United States Military Academy at West Point to a demographically similar cross-national public sample. Respondents completed a target identification task and then received advice from either an algorithm or a human analyst and had the opportunity to re-assess their initial identification, allowing direct measurement of automation bias and algorithm aversion. Contrary to prominent concerns, we find that West Point cadets are less prone to cognitive distortion than members of the general public, displaying better calibrated trust in algorithmic decision support systems. While the findings are limited, they suggest that military education and exposure to AI can meaningfully shape how AI influences international politics in matters of war and peace. Keywords: artificial intelligence, military decision-making, conflict escalation 1 Introduction International relations theories of war and peace are underpinned by an understanding of human agency and the way human judgment informs decisions about conflict and escalation. Artificial intelligence (AI) could meaningfully alter traditional decision-making pathways for leaders and militaries in ways that impact politics. Understanding how AI will shape how human decision-making is therefore essential to accurately assessing the future of politics and conflict. The theoretical need to grasp how AI will shape decision-making is especially acute given that militaries worldwide are developing and fielding AI solutions from the boardroom to battlefield, integrating algorithms into areas including predictive maintenance, logistics, disaster relief, nuclear command and control, automatic target recognition in weapons systems, and robotics ( 23 ; 37 ; 65 ; 41 ; 66 ; 21 ) . As militaries integrate AI technologies, they will, for the foreseeable future, still require commanders and operators to exercise human judgment. While militaries such as the United States have national policies to ensure human oversight of the use of force ( 10 ; 71 ; 18 ) , they are also leveraging AI Decision Support Systems (AI DSS) to speed up targeting processes by delivering information to commanders faster, as the US is in its war against Iran ( 45 ) . Theories of cognitive bias unique to automated systems—automation bias and algorithm aversion—suggest, however, that military users may over-rely on or prematurely distrust automated outputs in ways that increase the risk of accidents or mistakes, which, in crisis or combat contexts, can have life-or-death consequences ( 11 ; 84 ) . There is therefore a strong need to assess how and when militaries are at risk of introducing bias through AI decision-support tools. 1 1 1 If this is the case, then further aspects of decision-making—including at lower levels of command than international relations theories typically examine—should be taken into account when modeling the outcomes of future crises or wars. The combination of increasing autonomy, pervasive computerization, and the opaque, often black-box nature of modern AI systems makes automation bias a prominent concern across both civilian and military domains ( 12 ; 5 ; 16 ) . However, there is almost no behavioral research on automation bias in military contexts, making it ripe for analysis. This article compares findings from a survey experiment conducted in May 2025 of 236 cadets at the United States Military Academy at West Point (USMA), with those from a cross-national survey experiment of 702 members of the general public across 9 countries, including the United States ( 26 ) . The experiment measures respondents’ decision-making in response to assistance from an algorithm or a human analyst during a theoretical military target identification task. By comparing future military officers with members of the public similarly situated in age and education, we can gain analytical leverage on the extent to which automation bias and algorithm aversion are concerns for the military. The results show that, contrary to the fear that AI DSS in the military domain will necessarily increase the rate of accidents and miscalculation, the rising generation of Army officers, at least in the United States, is more appropriately calibrated to the upsides and risks of AI than demographically similar members of the general public. The results suggest the training current West Point cadets receive in warfighting and high-consequence decision-making, including decision-making with AI, makes appropriate use more likely, though we cannot definitively prove that within the confines of this paper. In what follows, we lay out the background and theory, including the interest in AI DSS among militaries, discuss cognitive factors that influence human-algorithm interaction, present the research design and findings, and conclude by assessing the impact for international politics and future research. 2 Automation Bias, International Politics, and AI Decision Support Systems International relations theories of war and peace rely on the notion of human decision-making. Whether considering escalation risk and the potential for conflict spirals or the use of military power, decisions by leaders, diplomats, military officers, and others drive continuity and change in world politics ( 30 ; 4 ) . Existing research shows how many factors influence use of force decision-making, including institutional constraints ( 70 ; 48 ) , group psychology ( 28 ; 22 ; 35 ) , cognitive biases and rationality ( 77 ; 64 ) , educational and personal background ( 3 ) , and even emotions ( 83 ; 46 ) . However, the environment in which decision-makers—particularly military decision-makers in technical fields, such as target assessment—operate is changing as AI-driven technologies are introduced ( 68 ) . This raises the question of how human judgment over the use of force functions as AI and automated systems increasingly shape the battlefield and decision environments. AI DSS are a key potential use case for militaries applying AI on the battlefield. AI DSS consist of “a class of algorithms that provide calculations to solve complex problems or improve task performance, and can suggest solutions that can either be accepted or rejected by a human expert” ( 15 ) . AI DSS are already being used across sectors, from medicine to aviation. In military contexts, these systems are designed to leverage advances in sensing, data fusion, and machine learning to support human commanders in navigating complex battlefields ( 78 ; 8 ) . Most military AI DSS are still in the research and development phases, but some are now being fielded. Military AI DSS can currently assist with tasks including situational awareness, pattern detection and prediction, course-of-action generation, enabling functions such as identifying friendly and adversary forces, routing forces, allocating logistics, collecting intelligence, and prioritizing medical care ( 15 ; 54 ) . In Israel’s operations in Gaza, the Israeli Defense Force has controversially used AI

Read the complete text