Agent-Sentry : Bounding LLM Agents via Execution Provenance
Rohan Sequeira, Stavros Damianakis, Umar Iqbal, Konstantinos Psounis · 2026
Read Agent-Sentry : Bounding LLM Agents via Execution Provenance by Rohan Sequeira, Stavros Damianakis, Umar Iqbal, Konstantinos Psounis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22868.txt.
Introduction
Sequeira and co-authors present Agent Sentry, a runtime defense for language model agents. Agent acts can stray from user intent, by error or by attack. The system learns a bound on normal execution from past clean runs. Three checks layer together: a structural classifier over action sequences, an allowlist check on sensitive values, and a language model judge for hard cases. Tests on AgentDojo and AgentDyn block most successful injections. Benign runs pass at a high rate too. The agent and its tools need no changes.
Catalog record
| CREATOR | Rohan Sequeira, Stavros Damianakis, Umar Iqbal, Konstantinos Psounis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92600 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22868
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Agent-Sentry : Bounding LLM Agents via Execution Provenance Rohan Sequeira, Stavros Damianakis, Umar Iqbal, Konstantinos Psounis Abstract Agentic computing systems, which autonomously spawn new functionalities based on natural language instructions, are becoming increasingly prevalent. While immensely capable, these systems raise serious security, privacy, and safety concerns. Fundamentally, the full set of functionalities offered by these systems, combined with their probabilistic execution flows, is not known beforehand. Given this lack of characterization, it is non-trivial to validate whether a system has successfully carried out the user’s intended task or instead executed irrelevant actions, potentially as a consequence of compromise. In this paper, we propose Agent-Sentry , a framework that attempts to bound agentic systems to address this problem. Our key insight is that agentic systems are designed for specific use cases and therefore need not expose unbounded or unspecified functionalities. Once bounded, these systems become easier to scrutinize. Agent-Sentry operationalizes this insight by uncovering frequent functionalities offered by an agentic system, along with their execution traces, to construct behavioral bounds. It then learns a policy from these traces and blocks tool calls that deviate from learned behaviors or that misalign with user intent. Our evaluation shows that Agent-Sentry helps prevent over 90% of attacks that attempt to trigger out-of-bounds executions, while preserving up to 98% of system utility. 1 Introduction Agentic systems (aka AI agents) are becoming increasingly prevalent, as they are deployed to autonomously perform tasks across domains such as finance, healthcare, and software development [ 15 , 14 , 24 , 27 ] . These agents follow an LLM-enabled computing paradigm, in which the system relies on (a single or more) machine learning models (typically LLMs), to interpret and resolve user queries expressed in natural language. In these systems, a query resolution entails an LLM predicting the interactions required between the system modules, system integrations (e.g., apps), and the user, as well as a set of natural language-based instructions to seamlessly enable these interactions [ 29 ] . Consequently, unlike conventional computing systems, agentic systems do not require explicit developer support to provide new functionalities. While there are obvious benefits to this execution paradigm, there are serious security, privacy, and safety risks to consider. Fundamentally, the key issue is that neither the full set of functionalities offered by these systems, nor the precise execution flows of functionalities are known beforehand, which makes it challenging to reason about the security properties of the system. While comprehensive characterization of conventional computing systems remains an open problem, it is significantly exacerbated in agentic systems. Our goal in this paper is to enable developing agentic systems, that provide strong security properties, while supporting their emergent functionalities. Our key idea is that in practice agentic systems are designed to provide specific use cases and thus need not have unbounded functionalities. Consequently, if the system functionalities can be trimmed down to a smaller set, it provides for an easier validation. Specifically, the system may exhibit regularities for functionalities, such as recurring patterns in tool usage, control flow structure, and data dependencies for common tasks [ 7 , 25 ] . These regularities thus form an envelope of executions for behaviors, which offer a path to bounding behavior without stripping agents of the flexibility that makes them useful at runtime. We present Agent-Sentry , a system that enforces safe execution of LLM-based agents by learning and reasoning over their observed behavior. Rather than relying on manually specified policies, Agent-Sentry constructs functionality graphs from prior benign and adversarial executions that capture recurring execution flows which comprises of control flow structures and data provenance. At runtime, Agent-Sentry compares proposed actions and their preceding execution context against these functionality graphs to detect behaviors associated with misuse or outside previously observed legitimate use. To resolve cases where classifying based on execution flows alone is insufficient, Agent-Sentry incorporates a lightweight intent-alignment check that verifies whether a proposed action is consistent with the user’s original request, using only trusted inputs and remaining robust to injected instructions. To evaluate our approach, we introduce Agent-Sentry benchmark, a dataset designed to study agent behavior under both benign use and adversarial use, specifically indirect prompt injection attacks. The dataset is used to learn the impact of functionality graph coverage and to analyze how different parts of the system contribute. To enable comparison with prior work, we also evaluate Agent-Sentry on the AgentDojo benchmark [ 7 ] , which exercises agents in realistic multi-step tasks involving tool use and untrusted information. Together, these evaluations allow us to measure whether Agent-Sentry can block unintended actions while preserving normal agent behavior more efficiently. Specifically, Agent-Sentry helps prevent over 90% of attacks while preserving up to 95% of system utility under the Agent-Sentry benchmark, and over 96% of attacks while preserving up to 98% of system utility under the AgentDojo benchmark. In summary, this paper makes the following contributions: 1. We propose functionality graphs as a representation of agent behavior that captures recurring execution flows such as control flow structures and data provenance. 2. We introduce an enforcement mechanism that detects unintended agent behavior by comparing runtime execution against observed patterns, without requiring manually engineered policies. 3. We present a trusted intent-alignment check that resolves behaviorally ambiguous cases while remaining robust to indirect prompt injection. 4. We introduce Agent-Sentry Bench and provide an empirical evaluation showing that Agent-Sentry blocks unintended actions while preserving benign agent behavior. 2 Motivation 2.1 Agentic Computing Paradigm LLMs have introduced a new agentic computing paradigm , in which the system primarily relies on ML models to resolve user queries expressed in natural language. This execution paradigm is tremendously powerful as it allows spawning complicated new functionalities simply via natural language instructions, instead of requiring a software engineer to program new functionalities, as it is the case in conventional computing systems. For example, given a query that instructs an email agent to “download attachments from recent emails and upload them to a cloud storage service”, the agent at runtime will orchestrate an execution flow (i.e., calling a series of functions and passing parameters), which may involve authenticating with the email service, reading recent emails, parsing attachments, authenticating with the cloud storage service, and uploading the attachments. 2.2 Inherent Security Issues While there are obvious benefits to the agentic computing paradigm and its reshaping the computing stack at all levels, there are serious security, privacy, and safety risks to consider. A key characteristic of agentic systems that makes it challenging to provide strong security properties is that the agentic execution paradigm in inherently unbounded . Specifically, given access to a set of functions/tools, an AI agent can orchestrate those function calls in all possible combinations, making it challenging to characterize the system. Towards achieving strong security properties in a system, it is crucial that the system execution with respect to the combination of a set of possible inputs in a set of possible states, is well understood, which is not the case in agentic systems. For example, given a query to an email agent to “summarize recent emails”, the execution flow taken by the system is not known beforehand nor is full set of functionalities that the email agent may provide based on the user query. Consequently,