Defending Against Intelligent Attackers at Large Scales
Andrew J. Lohn · 2025
Read Defending Against Intelligent Attackers at Large Scales by Andrew J. Lohn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18577.txt.
Introduction
Andrew Lohn models how defense scales against intelligent, independent cyber attackers, in a 2025 paper. Today's mass attacks, like worms and botnets, tend to fail or succeed as a block. AI agents could change that pattern. Each attempt might differ creatively from the last. Attackers might also learn from each try. Lohn asks what that means for defenders at large scale.
The math delivers a hopeful asymmetry. Small gains in the number or quality of defenses offset huge growth in attack counts. Even exponential speedups for attackers can be compensated. Independent attempts, it turns out, mostly waste effort against layered defenses. Each defense layer multiplies the attacker's burden. The result reframes AI-era security planning. Investment in modest defense improvements may beat fears of runaway attack scale, the analysis suggests.
Catalog record
| CREATOR | Andrew J. Lohn |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-18577
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Defending Against Intelligent Attackers at Large Scales Andrew J. Lohn Abstract We investigate the scale of attack and defense mathematically in the context of AI’s possible effect on cybersecurity. For a given target today, highly scaled cyber attacks such as from worms or botnets typically all fail or all succeed. Here, we consider the effect of scale if those attack agents were intelligent and creative enough to act independently such that each attack attempt was different from the others or such that attackers could learn from their successes and failures. We find that small increases in the number or quality of defenses can compensate for exponential increases in the number of independent attacks and for exponential speedups. K eywords AI \cdot Security \cdot Safety 1 Introduction 1.1 The Scale of Cyber Attack and Defense Despite automation in offensive cyber such as with botnets or worms, and in defensive cyber such as with malware scanners, anomaly detectors, and packet filters, both attack and defense are still largely human-directed. As AI promises to increase the speed and scale of both offense and defense, the obvious question is which side benefits more. [ 1 , 2 , 3 ] Will AI substantially increase the scale or speed of cyber attack or defense. The challenge is not simply scale or speed. Worms, bots, and shared malware all scale extremely well but are not very independent. [ 4 ] If an attack agent tries the same attack technique, a target’s defenses will typically hold against all of the attack attempts if they hold against one. That is somewhat less true in attacks such as DDoS, where the victim is not being penetrated or manipulated, just overwhelmed. [ 5 ] But even for DDoS, there are layers of filters and defenses. [ 6 ] For other types of intrusions, the attack attempts would need to be more varied or independent to overcome a defense that does not fold initially. AI promises to provide that originality while also promising to scale the number of those independent attack attempts. [ 7 ] Defenders already face a variety of creative human attackers and do not rely on a single defense. In some cases, such as an exposed web service where a SQL injection or heartbleed attack interfaces directly, there may be fewer lines of defense. [ 8 ] Examples of defenses in that case may be a web app firewall or input validation. For more enterprise defenses such as those that protect corporate intellectual property or critical infrastructure, there are many possible defenses, vendors, and products that can be used. There are passwords, firewalls, antivirus, anomaly detection, intrusion detection, restricted permissions, etc. AI promises to increase the number of products and services that defenders can purchase or that they can effectively monitor. And AI assistance may allow defenders to harden those defenses such as by setting more aggressive thresholds for alerts if AI can make inspecting false positives less onerous. 1.2 Defense in Depth Defense in depth can be developed according to at least two different strategies. [ 9 ] A Blockade strategy is where a sufficient number of defenses are built that attackers are unable to penentrate them all even if those defenses are individually weak. An alternative strategy does not require any of the defenses to hold. The Delay strategy uses each defense to slow the attack enough that defenders can discover and remove attackers before all defenses are overcome. That delay can be considered in terms of how many seconds or months does a defense slow attackers or in terms of how many attempts do attackers need in order to breach their target. We have previously developed simple mathematical representations of these two strategies. [ 9 ] Here we evaluate the effect of scaling up the number of attacks and defenses. We also develop a combine approach for the first time where a delay strategy is defined by number of attempts instead of time. Using these models, we hope to gain an intuition for how increasing the number of attacks and defenses will change the likelihood of success for attackers or defenders. That intuition is not meant to be a final answer for whether AI will offensively or defensively bias cyber operations. It is meant to provide a starting point for understanding the scaling dynamics and provide a framing for debate about those dynamics. Hopefully, it will illustrate the fundamental pressures that attackers and defenders will face with increasing scale and clarify the decisions each can make to either alleviate or increase those pressures. 2 Blockade Strategies for Defense in Depth Drawing from our previous work on defense in depth, equation 1 describes the likelihood, L , of at least one attacker success where all individual defenses are overcome. For this blockade strategy, the probability that an individual defense fails or is irrelevant is denoted by p , the number of individual defenses is n , and the number of attack attempts is N . A higher p is worse for defenders and requires a larger n to compensate. Hardness of individual defenses, or the probability that an individual defense will be effective, is (1-p) . We treat each defense as having the same value for p as in an average. This is the conservative assumption because the weakest overall defense occurs when each individual defense has the same value of p as follows from the arithmetic mean-geometric mean inequality. In the extreme, a two-defense system with p=0 and p=1 have an average p=0.5 but are certain to hold for every attack. L=1-(1-p^{n})^{N} (1) AI might allow defenders to implement or monitor more defenses, increasing n in equation 1 . AI may also make existing defenses more effective. If AI can help investigate more alerts, then defenders can set more aggressive alert thresholds, increasing p . Alternatively, AI might invent better attack tactics than humans and increase p . 2.1 Number of Attacks One quantity of interest is how many additional defenses are needed to compensate for an increased number of attacks. We rearrange equation 1 to calculate the number of attacks required to overcome the defenses. N=\frac{ln(1-L)}{ln(1-p^{n})} (2) Equation 2 can be simplified with a few approximations that are valid when both L and p^{n} are small. We approximate that ln(1-L)\approx-L and that ln(1-p^{n})\approx-p^{n} in equation 3 . N\approx\frac{L}{p^{n}} (3) Equation 3 indicates that the number of attacks needed to compensate for an increasing number of defenses grows exponentially. It suggests that as attack and defense scale, small increases in the number of independent defenses can repel exponentially increasing numbers of independent attacks. That could be important from a cyber perspective because defenses may be difficult to scale to large numbers while maintaining productivity. [ 10 ] It may be difficult to implement many defenses if each defense interferes somewhat with usability or productivity such as by slowing digital processes, annoying users, or adding expense. Figure 1 shows the exponential increase in number of attacks that is needed to keep the probability of no breaches constant. For parts a-c, the probability of at least one successful attack was held at 0.001. With just five attackers and ten defenses, that corresponds to individual defenses that fail