The End of Human Judgment in the Kill Chain? Relocating Initiative and Interpretation with Agentic AI
Jovana Davidovic · 2026
Read The End of Human Judgment in the Kill Chain? Relocating Initiative and Interpretation with Agentic AI by Jovana Davidovic (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06300.txt.
Introduction
Davidovic argues that language-model combat agents undermine the human judgment and control rules require. Their traits, initiative, interpretation, goal-directedness, and dynamic memory, shift choices away from humans in intelligence analysis, data fusion, and battle management, leaving human control weak where agents operate. That displacement clashes with human judgment and control requirements in GGE-CCW and REAIM frameworks. The paper concludes that data fusion and battle management cannot be justifiably used in lethal contexts now or soon, and proposes two responses for the international governance community.
Catalog record
| CREATOR | Jovana Davidovic |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57140 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06300
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The End of Human Judgment in the Kill Chain? Relocating Initiative and Interpretation with Agentic AI Jovana Davidovic Abstract Large language model-based agents are increasingly being integrated into core battlefield functions, including intelligence analysis, data fusion, and battlefield management. This paper argues that the very features that make such agents operationally attractive, namely their capacity for initiative, interpretation, their goal-directedness, and dynamic memory, are the same features that render context-appropriate human judgment and control substantively ineffectual in those parts of the kill chain where agents operate. Drawing on specific use cases, the paper argues that by relocating initiative and interpretation, LLM-based agents displace human decision-making in ways that makes their use incompatible with the requirement of human judgment and control which is central to existing governance frameworks, like those proposed by the GGE-CCW and REAIM. The paper concludes that a subset of agentic AI applications, particularly those deployed for data fusion and battle management in lethal contexts, cannot be used justifiably on the battlefield under current and foreseeable conditions, and proposes two ways for the international governance community to respond to this challenge. Introduction AI agents are increasingly promoted as force multipliers in military operations, especially for intelligence analysis, data fusion, and battle management. This paper examines specific such use cases and argues that, in lethal contexts, some forms of agentic AI, specifically, LLM-based agents, are not compatible with the requirement of context-appropriate human judgment and control and present significant risks that make it unlikely that such tools can be used justifiably on the battlefield for the foreseeable future [22, 7]. Drawing on specific examples of proposed and emerging military applications, the paper argues that the very features that make LLM-based agentic AI operationally attractive (features like initiative, interpretation, goal oriented-ness, and dynamic memory) also undermine meaningful human engagement. In these types of agents, human involvement is increasingly displaced, creating distinctive ethical risks that go beyond those posed by earlier AI-enabled tools. The main claim in this paper is that while some agentic AI applications may remain compatible with human control, there is a subset of agentic systems which are fundamentally unsuitable for use in the kill chain. By reallocating initiative and interpretive authority to the system itself, these agents reconfigure the human role in ways that make their ethical deployment in lethal settings unattainable, if context-appropriate human judgment and control is necessary for ethical deployment. The paper is organized in six sections. In the next section (section II), I discuss a specific use case, which focuses on data fusion on the battlefield. While it is unclear how far use cases such as this one have gotten in practice, I provide a number of reasons to believe that LLM-based agents are going to be increasingly used by militaries for these types of capabilities. In this section, I also say a little bit about what LLM-based agents are and what types of agents I have in mind in this paper. In section III, I identify four features that make such agents attractive for exact capabilities discussed in section II, namely data fusion, intelligence analysis, and battlefield management. These four features include initiative, interpretation, goal-oriented behavior, and dynamic memory. I discuss and describe these features and show why they make LLM-based agents attractive for the above capabilities. In section IV, I argue that these four features are the exact features that make the LLM-based agents particularly risky and I argue that these four features which enable agents to outperform ordinary AI (with respect to some capabilities and in some parts of the kill chain) render human judgment in those parts of the kill chain substantively ineffectual (or not-effectual enough to do the work we need human judgment to do). Additionally, in this section, I stress that all the key policy conversations about governance of AI-enabled weapons systems and autonomous weapons systems (namely the CCW and REAIM processes) have been calling for human judgment in the deployment of a weapon system (or pre-deployment). I argue that the use of agents of the above type (for data fusion) render human judgment in that part of the kill chain ineffectual and thus incompatible with those policy proposals. In section V, I examine potential objections to my argument, and finally in section VI, I consider two ways forward for the international governance and policy community. Specifically, I consider a potential ban on the use of LLM-based agents for data fusion and battlefield management, and after rejecting it as unrealistic, I turn to what I consider to be the next best strategy for mitigating the significant risks that these agents pose in these capabilities on the battlefield. II. LLM-agents on the battlefield Speed is one of the primary drivers of success on the battlefield. A central bottleneck that puts an upper limit on speed on the battlefield is data processing, analysis, and fusion. Data on the battlefield comes in from a variety of sources—sensor data (e.g. video or IR feed from a drone), geospatial data, human intelligence, signal intelligence (e.g. intercepted communications), etc. With an increase in the number of ISR drones, satellite data, and ability to intercept and process online communications, the sheer volume of data presents a serious problem for gathering useful and actionable data on the battlefield. AI has been widely used for a long time now for solving just such a problem. Consider for example, Anduril’s Lattice for Command and Control (C2) [1]. Anduril describes it as an “AI-powered battle-management platform built to accelerate complex kill chains,” by integrating “thousands of sensors and effectors to turn data into decisions at scales and speeds beyond human capacity.” [1] In short, Lattice acts like a central brain or operating system which connects different sensors and devices (e.g. drones, cameras, radar, surveillance towers) into one unified picture. By fusing that data together, it allows the operator a unified single pane view of what’s happening. Centrally, for our purposes, Lattice C2 engages in data translation and normalization and “it breaks down traditional data silos by integrating and normalizing heterogenous data in real-time, serving as a translator that can speak the unique language of each service, platform, robot, etc.” [1] Lattice uses AI to identify and filter out the noise and to highlight what is important, by “intelligently and automatically classifying, evaluating, and prioritizing data to get the right data to the right persons at the right time in limited bandwidth scenarios.” [1] Lattice C2 can also recommend actions, for example to deploy a drone to collect further information in cases where incoming data is degraded or confidence levels are low. Finally, as a C2 system Lattice can turn decisions into actions tasking any assets it is connected to including manned, unmanned, or even autonomous tools and weapon systems [1]. While Lattice uses AI and deep learning models, it is not clear, and there is no public evidence to think, that it uses an LLM-based agent or agents at its heart. In general, it is unclear how far use cases such as this one have gotten, however there are really good reasons to think that LLM-based agents are going to be increasingly used by militaries for the above types of capabilities. In what follows I will say much