Resilient Biosecurity in the Era of AI-Enabled Bioweapons

Jonathan Feldman, Tal Feldman · 2025

Read Resilient Biosecurity in the Era of AI-Enabled Bioweapons by Jonathan Feldman, Tal Feldman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02610.txt.

Introduction

Jonathan Feldman and Tal Feldman present a 2025 biosecurity paper warning that AI protein design has outrun the filters meant to catch dangerous outputs. Generative biology can create novel proteins for medicine, but the same tools could aid synthetic bioweapons.

Current defences lean on prediction tools that flag risky protein interactions. The authors tested three leading interaction predictors on known viral-host pairs, including hepatitis B and SARS-CoV-2. Despite training exposure to those viruses, the tools missed many confirmed interactions. None caught any of four proven SARS-CoV-2 mutant binders. The authors argue screening alone cannot carry biosecurity. They call for response-oriented infrastructure: fast experimental validation, adaptable biomanufacturing, and regulation that moves at AI speed.

Catalog record

CREATORJonathan Feldman, Tal Feldman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-02610

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Resilient Biosecurity in the Era of AI-Enabled Bioweapons Jonathan Feldman, Tal Feldman Abstract Recent advances in generative biology have enabled the design of novel proteins, creating significant opportunities for drug discovery while also introducing new risks, including the potential development of synthetic bioweapons. Existing biosafety measures primarily rely on inference-time filters such as sequence alignment and protein–protein interaction (PPI) prediction to detect dangerous outputs. In this study, we evaluate the performance of three leading PPI prediction tools: AlphaFold 3, AF3Complex, and SpatialPPIv2. These models were tested on well-characterized viral–host interactions, such as those involving Hepatitis B and SARS-CoV-2. Despite being trained on many of the same viruses, the models fail to detect a substantial number of known interactions. Strikingly, none of the tools successfully identify any of the four experimentally validated SARS-CoV-2 mutants with confirmed binding. These findings suggest that current predictive filters are inadequate for reliably flagging even known biological threats and are even more unlikely to detect novel ones. We argue for a shift toward response-oriented infrastructure, including rapid experimental validation, adaptable biomanufacturing, and regulatory frameworks capable of operating at the speed of AI-driven developments. K eywords Biosecurity \cdot Government \cdot Foundation Models \cdot National Security \cdot Law \cdot Regulation 1 Introduction In recent years, the convergence of generative AI and molecular biology has produced powerful new systems capable of designing proteins with remarkable precision. Protein language models (PLMs), along with structural predictors and design tools like RFdiffusion, are revolutionizing medicine by enabling rapid therapeutic development—from novel enzymes and vaccines to antibody candidates tailored for specific diseases [ 1 , 2 , 3 , 4 , 5 ] . These systems are accelerating biomedical innovation, shrinking experimental timelines, and expanding the reach of drug design to previously intractable targets [ 6 , 7 ] . Yet this same capability introduces an unprecedented dual-use dilemma. The tools now used to craft life-saving biologics can, in the wrong hands, be repurposed to generate pathogens with enhanced infectivity, immune evasion, or toxicity [ 8 ] . PLMs can simulate the evolutionary trajectory of viral proteins, suggesting mutations that make them more transmissible or harder to neutralize [ 9 , 10 , 11 ] . Structure-aware design tools can validate these outputs in silico and propose new scaffolds to support them [ 6 , 12 ] . This design-and-validation loop—which mirrors workflows already used in therapeutic biotech—lowers the barrier to creating synthetic threats, some of which may be novel enough to evade detection altogether [ 8 ] . In response to this growing concern, the AI and biosecurity communities have proposed technical countermeasures [ 13 ] . These include inference-time filtering to block dangerous outputs, red-teaming to test models for misuse, and sequence screening to flag potentially pathogenic molecules [ 8 , 13 , 14 ] . However, these methods rest on a problematic assumption: that we can reliably identify harmful proteins computationally. This assumption breaks down under scrutiny. Whether a protein is benign or harmful depends on factors that remain opaque to even the most advanced models—its tertiary structure, cellular context, binding specificity, and immunogenicity [ 8 , 14 , 15 ] . Most of these properties cannot be inferred from sequence alone. In fact, as we demonstrate in this paper’s technical section, existing models for protein–protein interaction (PPI) prediction fail especially badly when applied to viral proteins. They lack the data diversity, contextual understanding, and biological realism to generalize beyond narrow, overrepresented domains. This limitation creates blind spots that could be exploited by malicious actors or simply overlooked in good-faith deployments. If computational filters are not fully reliable then only experiments can provide definitive safety assurance. Yet experimental validation methods, such as binding assays, toxicity screens, and infection models, are too slow, costly, and resource-intensive to scale with model outputs [ 16 , 17 ] . In theory, flagged sequences could be tested in the lab. In practice, we lack the infrastructure to vet more than a tiny fraction [ 8 , 18 ] . That leaves us with a dangerous asymmetry: generative models can produce threats at scale, but our ability to verify them lags far behind. Worse, even dramatic advances in our ability to predict pathogenicity from sequence data will not guarantee security. Open-source models, fine-tuned on public data, are available worldwide. The barriers to misuse are falling: DNA synthesis services are increasingly accessible, foundational laboratory tools are widely distributed, and the necessary expertise is no longer confined to state-sponsored programs [ 8 , 12 , 19 , 20 , 21 ] . Nation-states and non-state actors with sufficient resources can run models privately, circumvent safety mechanisms, and synthesize outputs with little oversight. In this threat landscape, technical success in sequence classification does not guarantee security. We cannot rely on preemptive filters alone. The implication is stark: current defense strategies—focused on prediction, prevention, and perimeter control—are structurally mismatched to the nature of the threat. No matter how refined our red-teaming becomes, no matter how many inference-time filters we deploy, we cannot guarantee safety when our core tools lack ground truth and when potential adversaries are unconstrained. What is needed instead is a shift: from a paradigm of containment to one of resilience. Rather than attempting to intercept every potentially dangerous output at generation time, we must build systems capable of responding to threats after they emerge—faster than those threats can spread. This means developing AI-native infrastructure for therapeutic response: models trained to design safe, stable, and manufacturable countermeasures on demand; high-throughput simulation and validation tools that can screen thousands of candidates in parallel; and a nationwide biomanufacturing pipeline that can pivot from peacetime research to emergency deployment within days. Crucially, this is not merely a technical aspiration—it is a national security imperative. We must prepare for a world in which synthetic pathogens may be generated and released faster than traditional public health systems can detect or contain them. In such a world, resilience is the only viable defense. Speed—not restraint—becomes the battlefield. This paper is structured as follows: In the next section, we show that current machine learning models for predicting viral protein interactions, especially those relying on large-scale sequence and structure modeling, fail to generalize well. This is particularly evident in low-data and high-divergence scenarios. These shortcomings highlight the limitations of current safety frameworks and underscore the urgent need to shift research focus towards response-driven capabilities. We then propose a resilience-based framework that addresses gaps in existing biosecurity efforts. Ultimately, our goal is not to eliminate generative biology, but to guide it—ensuring that the tools being developed today are aligned with the future needs that will arise. 2 Limitations of Current Inference-Time Filtering Approaches The task of identifying potentially pathogenic proteins, especially those that may be synthetically engineered or genetically modified, for inference-time filtering requires robust, reliable tools. In the context of biosecurity, these tools must be able to predict whether a given protein sequence or structure could be harmful to humans. Currently, the two primary methodologies used to predict pathogenicity are sequence similarity comparisons and PPI prediction mechanisms [ 14 , 22 , 23 , 24 ] . While these tools have proven useful, both are fundamentally limited in their applicability and accuracy, especially when it

Read the complete text