Systems Security Foundations for Agentic Computing
Mihai Christodorescu 1 , Earlence Fernandes 2 , Ashish Hooda 1 , Somesh Jha 1,3 , Johann Rehberger 4 , Khawaja Shams 1 · 2025
Read Systems Security Foundations for Agentic Computing by Mihai Christodorescu 1 , Earlence Fernandes 2 , Ashish Hooda 1 , Somesh Jha 1,3 , Johann Rehberger 4 , Khawaja Shams 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01295.txt.
Introduction
Mihai Christodorescu and co-authors set out the safety needs for AI agents. Agents are programs that plan and act on their own. They use tools, read files, and send messages. A safe model alone does not make a safe full system.
The authors look at the whole system, not just the model. They list short-term and long-term research tasks for agent safety and privacy. Each task asks how an agent can be tricked, leak data, or cause harm. Their plan gives builders a shared map for tests, guards, and design rules that cover real use.
Catalog record
| CREATOR | Mihai Christodorescu 1 , Earlence Fernandes 2 , Ashish Hooda 1 , Somesh Jha 1,3 , Johann Rehberger 4 , Khawaja Shams 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-01295
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Systems Security Foundations for Agentic Computing Mihai Christodorescu 1 , Earlence Fernandes 2 , Ashish Hooda 1 , Somesh Jha 1,3 , Johann Rehberger 4 , Khawaja Shams 1 Abstract August 10, 2026 This paper articulates short- and long-term research problems in AI agent security and privacy, using the lens of computer systems security. This approach examines end-to-end security properties of entire systems, rather than AI models in isolation. While we recognize that hardening a single model is useful, it is important to realize that it is often insufficient. By way of an analogy, creating a model that is always helpful and harmless is akin to creating software that is always helpful and harmless. The collective experience of decades of cybersecurity research and practice shows that this is insufficient. Rather, constructing an informed and realistic attacker model before building a system, applying hard-earned lessons from software security, and continuous improvement of security posture is a tried-and-tested approach to securing real computer systems. A key goal is to examine where research challenges arise when applying traditional security principles in the context of AI agents. A secondary goal of this report is to distill these ideas for AI and ML practitioners and researchers. We discuss the challenges of applying security principles to agentic computing, present 11 case studies of real attacks on agentic systems, and define a series of new research problems specific to the security of agentic systems. I Introduction The IEEE Secure Generative AI Agents 2025 workshop (SAGAI; co-located with the IEEE Symposium on Security and Privacy) set out to explore how computer-security research and practice can help inform and advance agentic computing security. This report captures those discussions and distills key lessons, open research problems and recommendations on how the two fields can co-operate to build a foundation for secure agentic computing. Agentic computing is when AI models interact with computer systems and services on behalf of human users by calling tools in a loop [ 49 ] . The user specifies a task in natural language and the AI model is usually a large language/vision model but can be other types as well. The set of computer systems that can be operated by an agent include desktop interfaces, terminals, web browsers, mobile operating systems. Furthermore, agents can use arbitrary tools defined through various standards (e.g., REST or MCP [ 22 ] ). Current efforts at securing agentic systems primary rely on model hardening approaches, often described as AI alignment [ 8 , 47 , 24 ] . Fundamentally, this involves training a model to resist attacks by exposing it to various exemplars. From a computer security perspective, this is equivalent to writing software that is always helpful, harmless and resistant to attacks. The past 50 years of research and practice in computer security has empirically shown this to be an insufficient strategy. While a single program’s robustness should certainly be increased (e.g., computer security does this using formal methods approaches for certain kinds of programs or by writing software using languages (e.g. Rust) that are immune to certain classes of attacks), it has proven to be very difficult to scale to all types of computer programs. This has necessitated a systems approach that applies security defense techniques at various layers of abstraction of a computer system (i.e., hardware, firmware, hypervisors, operating systems, user-space frameworks, applications, network). The essence of this approach is to create deterministic guardrails at different layers of abstraction that increase the exploitation burden on the attacker while minimizing performance and functionality impact. The situation with AI is worse. Models are not traditional computer programs that are immediately amenable to traditional computer-security techniques that increase their robustness. They are also vulnerable to inference-time attacks that allow attackers to control outputs in arbitrary ways [ 53 , 15 , 44 , 16 ] . Furthermore, the collective experience of the community between the two “waves” of adversarial machine learning research is that training models to resist attacks is insufficient: attackers always find workarounds [ 23 , 2 , 25 ] . Additionally, in the LLM-era of this research, attackers are not sophisticated and rely on English-language skills to trick AI systems into pursuing malicious tasks [ 16 , 26 , 35 , 30 , 36 ] . Therefore, to make foundational and practical progress, the fields of computer security and AI agent safety/security need to co-operate. Summary of Findings. Computer security relies on a range of security design principles to guide the exploration and implementation of deterministic guardrails [ 38 , 1 ] . Applying those principles to agentic systems encounters several technical challenges that we explain and explore in this report based on discussions during the workshop. Each of these challenges also pose interesting research challenges. (1) Probabilistic TCB. A classic principle is creating a trusted computing base (TCB) to enforce a security invariant (e.g., to reduce the risk of memory corruption vulnerabilities, the hardware provides a deterministic feature that prevents code execution only from certain memory regions). Applying this to an agentic system is difficult because the model itself is a major part of the TCB, but it is fundamentally probabilistic. If you train the model to recognize that certain token sequences are non-executable, that property is enforced with some probability that is conditional on the input to the model rather than being a deterministic property. In other words, the challenge is to build provable defenses from probabilistic TCB assumptions. (2) Dynamic Security Policies. A security policy governs the privilege of an untrusted program and is typically created by a developer or inferred based on code analysis. Applying this to an agentic system is difficult for two reasons: (a) there is no developer; only the end-user who specifies a natural language task and (b) there is no program to analyze; rather, the AI model “computes” many programs. Predicting or synthesizing a security policy given the natural language task is challenging because the task can be under-specified and using the agent’s entire context window for precise predictions is tricky because of the presence of untrusted external content. (3) Fuzzy Security Boundary. Deterministic guardrails in computer security should be applied at the correct level of abstraction that provides the right amount of information to enforce the guardrail. For example, Android permissions are enforced at the interface between an application and the protected system services. Applying these principles to an agentic system is difficult because there aren’t any abstraction layers–typically the model just outputs a tool call with optional reasoning traces. Sometimes, these tool calls are too low-level to write and enforce reasonable security policies. For example, web agents perform UI-level manipulations making it difficult and brittle to write and enforce guardrails at the level of clicks and keystrokes. This is an instance of a well-known classic security problem of a semantic gap [ 19 , 13 , 42 ] . (4) Prompt Injections \cong Dynamic Code Loading. Prompt injections are a key security problem to solve in agentic systems, but are sometimes necessary for functionality. For example, tool documentation does affect an agent’s behavior (by definition because the agent has to learn how to use the tool!). The challenge here is defining when prompt injections are harmful