Military AI Cyber Agents (MAICAs) Constitute a Global Threat to Critical Infrastructure
Timothy R. Dubber, Seth Lazar · 2025
Read Military AI Cyber Agents (MAICAs) Constitute a Global Threat to Critical Infrastructure by Timothy R. Dubber, Seth Lazar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12094.txt.
Introduction
Autonomous AI agents that attack computer systems could move from lab idea to military weapon, and two scholars argue the danger is global. Timothy Dubber and Seth Lazar contend in 2025 that such military AI cyber agents open a credible path to catastrophic harm. Their paper first lays out why building them is technically feasible with current trends.
Geopolitics and the shape of cyberspace then do the rest: attack tools spread fast, defense lags, and critical infrastructure from power to hospitals sits exposed. The authors propose three lines of response: political restraint, defensive AI, and analogue fallbacks that keep vital systems running without networks. They frame the paper as a warning to act before the weapons mature.
Catalog record
| CREATOR | Timothy R. Dubber, Seth Lazar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-12094
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Military AI Cyber Agents (MAICAs) Constitute a Global Threat to Critical Infrastructure Timothy R. Dubber, Seth Lazar Abstract This paper argues that autonomous AI cyber-weapons—Military-AI Cyber Agents (MAICAs)—create a credible pathway to catastrophic risk. It sets out the technical feasibility of MAICAs, explains why geopolitics and the nature of cyberspace make MAICAs a catastrophic risk, and proposes political, defensive-AI and analogue-resilience measures to blunt the threat. 1 Introduction AI risk advocates and military AI ethicists alike have paid too little attention to the loss-of-control risks posed by Military AI Cyber Agents (MAICAs): fully autonomous AI agents that plan and execute cyber operations. Nation-states must forestall risks associated with MAICAs’ inevitable development by: 1. taking counter-proliferation steps to avoid MAICAs falling into the hands of rogue actors; 2. conducting defensive research to develop the counter-AI capabilities necessary to degrade a rogue-MAICA; and 3. investing in critical infrastructure resilience and analogue redundancy to limit the damage of a rogue MAICA. 2 The risk of AI powered cyberwarfare is underappreciated In this paper, we argue that MAICAs represent a credible path to catastrophic risk, which we define as "events of low or unknown probability that if they occur inflict enormous losses often having a large non-monetary component." ( Posner 2008 ) . 1 1 1 “The Indian Ocean tsunami of 2004 is at the lower level of the catastrophic-risk scale of destruction; examples from higher levels including large asteroid strikes, pandemics and global warming” ( Posner 2008 ) The catastrophic risks associated with MAICAs have been underestimated by the two camps of researchers best placed to consider them: AI safety researchers and military AI ethicists. 2.1 AI safety researchers give vague accounts of loss-of-control AI safety researchers have highlighted the potential risk of a loss-of-control scenario. But such risk is mostly articulated in comparatively vague and a priori terms. Yudkowsky 2012 argues that the core risk in a loss-of-control scenario is that an Artificial Superintelligence (ASI)—if not explicitly designed to align with human values—will relentlessly optimise for its own goals independent of human welfare, because intelligence does not imply benevolence. Without precise control over its objectives and self-modification processes, such an ASI could pursue outcomes catastrophically indifferent to our survival. Bostrom 2014 builds upon this loss-of-control scenario, arguing that ASIs would be uncontrollable post-creation, able to outsmart any containment. Bostrom posits that this risk demands robust control measures prior to superintelligence. In contrast, Kulveit et al. 2025 have argued that “gradual disempowerment” is a more likely scenario: even without sudden leaps in AI capabilities or overt hostility, incremental advancements in AI would steadily erode human influence over key societal systems—such as the economy, culture, and governance. As AI systems increasingly outperform humans in various roles, these systems may become less reliant on human input, undermining the mechanisms that align societal outcomes with human values. The problem with such approaches is that they focus on demonstrating that catastrophic-to-existential outcomes are conceivable, not on furnishing action-relevant guidance. By compounding conditional probabilities and they neither offer a robust, evidence-based model for concrete risk conversion, leading to a conclusion that—absent an abrupt, unanticipated takeoff—we could afford to wait for clearer empirical signs before mounting a response to any AI related catastrophic risk. Recent taxonomy efforts of AI risk exemplify this gap, for instance Hendrycks et al. 2023 catalogue ways in which human misuse could lead to harm but offer only a high-level conjecture—deception by an ASI—for genuine loss-of-control. Bengio et al. 2025 likewise warn that misaligned objectives in an ASI agent could clash with human interests, yet the operational mechanism by which such an agent would translate misalignment into large-scale damage remains unspecified. When it comes to the potential of such superintelligent systems in cyberspace, both Hendrycks et al. 2023 and Bengio et al. 2025 identify the potential of AI to use cyber as a vector for pursuing its objectives and causing harm. Dean 2025 also presents the potential of such superintelligent models “self-exfiltrating”: gaining unauthorised control over their own computing resource and escaping into the wild. But the common thread between all these arguments is that the risk emits primarily from the nature of a misaligned ASI, rather than the unique domain characteristics of cyberspace and the potential of currently existing AI capabilities. 2.2 Military AI ethicists focus on physical lethal autonomous weapons On the other hand, military AI ethicists have narrowly focused on physical Lethal Autonomous Weapon Systems (LAWS), emphasising the risk of algorithmic decision making and dehumanisation, but not placing enough emphasis on loss-of-control risks. For instance, Sparrow 2007 argues that deploying LAWS is unethical because they create a responsibility gap: if no human can be justly held accountable for their lethal actions, and the machines themselves aren’t moral agents, then their use violates fundamental requirements of moral responsibility in warfare. In contrast, Arkin 2009 attempts to present an architecture that would ensure LAWS would be more reliable ethical agents than human combatants. And Scharre 2019 attempts to strike a middle ground, noting that the “distancing” provided by LAWS may change the relationship we have to killing, but is equivocal on whether this could be a positive or negative development. The result of this ethical discourse has been a sustained concern with “killer robots.” The International Committee of the Red Cross ( ICRC 2021 ) United Nations ( Heyns 2013 ) and Human Rights Watch ( Stauffer 2025 ) have all conducted surveys of or produced position papers on LAWS, finding that lethal autonomy raises compliance and accountability concerns. However, these investigations tend to focus on the moral hazard posed by militaries using such systems in combat (that is, the temptation to use force more readily that arises from lowering the risk associated with initiating combat), rather than any catastrophic risks that could emerge from military AI systems. There is a one concrete strand of scholarship examining potential catastrophic risk emerging from military AI: the integration of AI into platforms equipped with strategic weapons—for example, nuclear command-and-control ( Johnson 2020 ) or bioweapons ( Nelson and Rose 2023 ) . Public statements by nuclear-armed states now indicate a shared preference to keep AI outside launch authority ( Renshaw and Hunnicutt 2024 ) , suggesting that the highest-impact scenarios are politically disfavoured. At the minimum the catastrophic potential of rogue-AI controlling strategic weapons is well understood—which is unsurprising considering that nation-states have been discussing dead hand automation for nuclear weapons since the 1980s ( Steinbruner 1981 ) . The common thread of these investigations is their focus on physical platforms. Even if humans lose control over LAWS, the physical platform remains dependent on logistics chains—fuel, ammunition, maintenance—and can only do so much damage before running out of the sustainment necessary to continue violence ( Nohel et al. 2025 ) . Consequently, a single rogue platform is more like an industrial accident than a catastrophic loss-of-control scenario. Even in the case of strategic weapons platforms, physical controls and human overrides can be implemented to mitigate physical harm. 2.3 Both sides underappreciate the risk in cyberspace The logistical constraints that limit the destructive capacity of physical autonomous weapons do not apply in cyberspace. As Scharre 2019 notes, software agents can replicate, manoeuvre, and strike without the need