Securing the Agent: Vendor-Neutral, Multitenant Enterprise Retrieval and Tool Use CCS: Computing methodologies Machine learning CCS: Information systems Data management systems Conference: ACM Conference on AI and Agentic Systems; May 26–29, 2026; San Jose, CA, USA ACM Conference on AI and Agentic Systems (ACM CAIS ’26), May 26–29, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813145 ISBN: 979-8-4007-2415-2/26/05
Francisco Javier Arceo, Varsha Prasad Narsing · 2026
Read Securing the Agent: Vendor-Neutral, Multitenant Enterprise Retrieval and Tool Use CCS: Computing methodologies Machine learning CCS: Information systems Data management systems Conference: ACM Conference on AI and Agentic Systems; May 26–29, 2026; San Jose, CA, USA ACM Conference on AI and Agentic Systems (ACM CAIS ’26), May 26–29, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813145 ISBN: 979-8-4007-2415-2/26/05 by Francisco Javier Arceo, Varsha Prasad Narsing (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05287.txt.
Introduction
Francisco Javier Arceo and Varsha Prasad Narsing argue that company retrieval systems have a security flaw at their core: they rank files by relevance, not by permission. In multi-tenant companies, a query can therefore surface another tenant's secret data simply because it scores highest. Agentic systems widen the hole through tool-based disclosure, context build-up across turns, and client-side control tricks.
The authors pin down this relevance-permission gap and propose a layered isolation design in response. Policy-aware intake, search-time gating, and shared inference are joined, with server-side control backing tool permission, state separation, and policy. The design targets vendor-neutral, multi-tenant deployments under legal and cost pressure.
Catalog record
| CREATOR | Francisco Javier Arceo, Varsha Prasad Narsing |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05287
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Securing the Agent: Vendor-Neutral, Multitenant Enterprise Retrieval and Tool Use CCS: Computing methodologies Machine learning CCS: Information systems Data management systems Conference: ACM Conference on AI and Agentic Systems; May 26–29, 2026; San Jose, CA, USA ACM Conference on AI and Agentic Systems (ACM CAIS ’26), May 26–29, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813145 ISBN: 979-8-4007-2415-2/26/05 Francisco Javier Arceo, Varsha Prasad Narsing Abstract . Retrieval-Augmented Generation (RAG) and agentic AI systems are increasingly prevalent in enterprise AI deployments. However, real enterprise environments introduce challenges largely absent from academic treatments and consumer-facing APIs: multiple tenants with heterogeneous data, strict access-control requirements, regulatory compliance, and cost pressures that demand shared infrastructure. A fundamental problem underlies existing RAG architectures in these settings: retrieval systems rank documents by relevance---whether through semantic similarity, keyword matching, or hybrid approaches---not by authorization, so a query from one tenant can surface another tenant’s confidential data simply because it scores highest. We formalize this gap and analyze additional shortcomings---including tool-mediated disclosure, context accumulation across turns, and client-side orchestration bypass---that arise when agentic systems conflate relevance with authorization. To address these challenges, we introduce a layered isolation architecture combining policy-aware ingestion, retrieval-time gating, and shared inference, enforced through server-side agentic orchestration. This approach centralizes security-critical operations---tool execution authorization, state isolation, and policy enforcement---on the server, creating natural enforcement points for multitenant isolation while allowing client-side frameworks to retain control over agent composition and latency-sensitive operations. We validate the proposed architecture through an open-source implementation in OGX 1 1 1 OGX (Open GenAI Stack), formerly known as Llama Stack ( 19 ) . The project is available at https://github.com/ogx-ai/ogx ; the Kubernetes Operator at https://github.com/ogx-ai/ogx-k8s-operator . ( 24 ) , a vendor-neutral framework that implements an OpenAI-compatible, open-source Responses API with server-side multi-turn orchestration. We evaluate it empirically and show that ABAC gating eliminates cross-tenant leakage while introducing negligible overhead. 1. Introduction Enterprise adoption of agentic AI introduces security challenges that existing architectures do not address. We motivate the problem, formalize it, and summarize our contributions. 1.1. Motivation Enterprise adoption of generative AI has evolved beyond simple prompt-response interactions toward agentic systems—AI applications that autonomously reason, use tools, retrieve information, and execute multi-step workflows to accomplish complex tasks ( 38 ; 32 ; 13 ) . This evolution reflects a fundamental shift: rather than treating large language models (LLMs) as sophisticated text generators, organizations now deploy them as reasoning engines capable of taking actions in the world. An API-first paradigm is emerging to unify multi-turn inference, tool use, and retrieval behind a single endpoint. OpenAI’s Responses API is one prominent example, providing a unified interface for chat-style inference, tool invocation, retrieval, and stateful workflows ( 29 ) , while open-source frameworks increasingly expose OpenAI-compatible endpoints to decouple applications from any single provider. However, real-world enterprise deployments differ sharply from the assumptions embedded in consumer-facing APIs and many academic prototypes, exhibiting characteristics that demand specialized architectural consideration: • Multiple tenants: distinct business units, customers, or partners served from shared infrastructure, with strict isolation requirements. • Heterogeneous data: document collections vary in format, sensitivity classification, and access requirements. • Strict access control: regulatory frameworks require fine-grained governance with auditable access patterns. • Operational control: visibility into agent behavior, tool execution sequences, and data access patterns is required for debugging and compliance, consistent with lessons from production ML engineering ( 1 ) . • Vendor independence: lock-in to a single AI provider creates business risk; enterprises require on-prem and hybrid options. Naïve approaches to addressing these requirements replicate the entire agentic stack per tenant: separate vector stores, dedicated inference endpoints, and isolated tool configurations. This strategy incurs substantial costs—infrastructure scales linearly with tenants rather than with actual usage—and creates operational fragmentation that amplifies common ML systems maintenance risks ( 33 ) . 1.2. Problem statement This paper addresses a fundamental tension in enterprise agentic AI deployment: Autonomous agents require flexible tool access and multi-turn reasoning capabilities, yet enterprise environments demand strict tenant isolation and policy enforcement—requirements that existing agentic architectures cannot simultaneously satisfy. Standard agentic AI deployments exhibit security assumptions incompatible with enterprise multitenancy: (1) Client-side orchestration: the application manages the inference \rightarrow tool \rightarrow inference loop, distributing security-critical logic to potentially untrusted clients and increasing operational complexity ( 1 ) . (2) Homogeneous data access: retrieval stacks assume uniform access to a corpus; retrieval methods (whether dense, sparse, or hybrid) optimize relevance ranking rather than authorization ( 14 ) . (3) Implicit trust boundaries: tool execution is often treated as a capability extension without systematic verification of who may invoke tools or consume tool outputs, despite the centrality of tool use in modern agent designs ( 38 ; 32 ; 13 ) . (4) Stateless isolation: requests are treated independently, ignoring how conversation state and cached tool results can leak across boundaries; such hidden couplings are a classic source of ML systems fragility ( 33 ) . In multitenant settings, these assumptions create serious vulnerabilities. A document highly similar to a query may belong to a different tenant. A tool call may access resources outside the user’s authorization scope. Conversation history may accumulate context that crosses security boundaries. This paper focuses on agentic RAG—the intersection of retrieval-augmented generation and autonomous tool use—as the primary case study, since retrieval is where the relevance-authorization gap is most acute. However, the layered isolation architecture and server-side enforcement patterns we propose are general and extend to other agentic capabilities including inference, tool execution, code generation, and multi-step workflows. 1.3. Contributions This paper makes the following contributions: (1) We formalize the relevance-authorization gap in multitenant RAG, showing why relevance ranking alone is insufficient to enforce isolation without explicit authorization predicates ( 14 ; 12 ) , and provide empirical evidence that ungated retrieval leaks cross-tenant data in 98–100% of probes. (2) We propose a layered isolation architecture combining policy-aware ingestion, retrieval-time gating, and shared inference, with server-side orchestration as the enforcement layer for the agentic control loop. (3) We validate the architecture through a six-experiment evaluation measuring security (cross-tenant leakage, prompt injection resilience), systems performance (latency overhead, throughput scaling), and retrieval quality across a 2 \times 2 configuration matrix crossing orchestration mode with retrieval gating. (4) We implement the architecture in OGX ( 24 ) , an open-source, vendor-neutral framework providing OpenAI-compatible APIs with pluggable providers for inference, vector stores, and tools, deployable on Kubernetes via a dedicated operator ( 25 ) . 2. Background We trace the evolution of LLM application architectures to show how each phase introduced new capabilities but also inherited the security gaps of prior phases. 2.1. The evolution of LLM application architectures LLM application architectures have evolved through distinct phases, each introducing new capabilities and security considerations. The Completions APIs exposed simple prompt \rightarrow text interfaces with perimeter-oriented security. Retrieval-augmented generation (RAG) ( 18 ) introduced retrieval and new attack surfaces such as retrieval manipulation and context poisoning, building on foundational work on prompt injection vulnerabilities ( 37 ) . Dense retrieval and learned retrievers (e.g., DPR ( 14 ) and retrieval-augmented pretraining such as REALM ( 10 ) ) established the core technical basis for modern RAG. Retrieval infrastructure evolved to support multiple search modalities: dense vector search across diverse vector