Agent-First Tool APIs: Rethinking Enterprise Service Interfaces for LLM-Native Execution

Kai Pan, Rong Hou · 2026

Read Agent-First Tool APIs: Rethinking Enterprise Service Interfaces for LLM-Native Execution by Kai Pan, Rong Hou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10555.txt.

Introduction

Kai Pan and Rong Hou redesign enterprise tool APIs for AI agents. Language model agents now run enterprise software, yet the APIs they invoke still target human interfaces. Traditional CRUD APIs expect callers to know exact parameters, return raw data, and lack rules for self-run execution. Their 2026 paper presents the Agent-First Tool API paradigm.

The paradigm treats tool APIs as goal protocols, not form endpoints. It introduces three parts. First, a Six-Verb Semantic Protocol structures each tool call as a reasoning loop. Second, a Normalized Tool Contract adds confidence scores, evidence sources, and next actions to each response. Third, a dual-layer governance pipeline combines capability and object permissions with live risk step-up and approval workflows. Tested in a live SaaS system with 85 tools across 6 domains, Agent-First APIs reduce unclear-goal failures, enable error fixes, and enforce strong access control without control layers.

Catalog record

CREATORKai Pan, Rong Hou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10555

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Agent-First Tool APIs: Rethinking Enterprise Service Interfaces for LLM-Native Execution Kai Pan, Rong Hou Abstract Large Language Model (LLM) agents are rapidly becoming first-class operators of enterprise software systems, yet the APIs they invoke remain designed for human-driven UIs. Traditional CRUD interfaces assume callers know exact parameters, return raw data without decision-support metadata, and lack built-in governance for autonomous execution. This mismatch forces agent developers into brittle prompt engineering and ad-hoc error handling. We present the Agent-First Tool API design paradigm, which reconceives tool interfaces as goal-achievement protocols rather than form-submission endpoints. Our approach introduces three core contributions: (1) a Six-Verb Semantic Protocol ( semantic_search , resolve_candidates , preview_action , execute_action , verify_result , recover_from_error ) that structures every tool invocation as a multi-phase reasoning loop; (2) a Normalized Tool Contract (NTC) that augments every response with confidence scores, evidential provenance, and suggested next actions; (3) a dual-layer governance pipeline combining capability-based and object-scoped permissions with dynamic risk escalation and built-in approval workflows. We validate the paradigm in a production SaaS system spanning 85 tools across 6 business domains. Comparative analysis demonstrates that Agent-First APIs reduce ambiguity-induced failures, enable structured error recovery, and enforce enterprise-grade access control without external orchestration layers—capabilities absent from conventional CRUD interfaces. I Introduction The advent of tool-augmented Large Language Models [ 1 , 2 , 3 ] has catalyzed a fundamental shift in enterprise software architecture. Instead of human operators navigating graphical interfaces, LLM-based planners now select, parameterize, and invoke backend services autonomously. This transition surfaces a critical design mismatch: the APIs these agents call were built for a different consumer. Traditional CRUD (Create, Read, Update, Delete) APIs embody five assumptions that collapse when the caller is an LLM planner rather than a human-controlled frontend: Assumption 1: The caller knows exact parameters. CRUD endpoints expect precise identifiers—a store ID, a user UUID, a category code. An LLM agent, however, starts with a natural-language goal (“find the downtown branch that opened last month”) and must resolve it to identifiers through search and disambiguation. Assumption 2: Responses are renderable data. REST APIs return JSON payloads designed for UI rendering. An agent does not render; it reasons . It needs confidence scores, evidential provenance, and actionable next-step suggestions—metadata absent from conventional responses. Assumption 3: One request suffices. CRUD assumes a single round-trip per user action. Agents operate in multi-turn reasoning loops where each tool call produces observations that inform subsequent planning decisions [ 9 , 10 ] . Assumption 4: Permissions equal user permissions. Traditional access control binds to the authenticated user. When an agent acts on behalf of a user, a second permission layer is needed: what is this tool allowed to do , independent of the user’s UI-level entitlements. Assumption 5: Errors are HTTP status codes. A 400 Bad Request tells a human developer what went wrong. An agent needs structured failure descriptions—candidate alternatives, suggested corrections, and recovery strategies it can execute without human intervention. These mismatches are not superficial; they reflect a paradigm gap. Existing work on function calling [ 6 , 7 ] , tool selection [ 2 , 3 , 15 ] , and agentic frameworks [ 11 , 12 , 13 ] addresses orchestration above the tool boundary but leaves the tool interface itself as a black box conforming to legacy CRUD conventions. This paper proposes the Agent-First Tool API paradigm, which treats the tool interface as a first-class design artifact optimized for LLM-native consumption. Our contributions are: 1. A Six-Verb Semantic Protocol that decomposes every tool interaction into search, disambiguation, preview, execution, verification, and recovery phases, providing the structured reasoning scaffolding that agents require. 2. A Normalized Tool Contract (NTC) response specification that augments every tool output with confidence, evidence, result references, and next-action suggestions, enabling agents to make informed planning decisions. 3. A dual-layer governance pipeline that combines capability-based permissions with four-level object-scoped isolation (tenant \to brand \to store \to user) and dynamic risk escalation with built-in approval workflows. 4. A production validation across 85 tools in 6 business domains within a multi-tenant SaaS system, with quantitative analysis and case studies demonstrating the paradigm’s effectiveness. We emphasize that our contribution is orthogonal to transport-layer standards such as MCP [ 8 ] . MCP standardizes how tools are discovered and invoked; we address what tools should expose and how responses should support autonomous decision-making. The two layers are complementary: Agent-First tools can be deployed as MCP servers, combining transport interoperability with semantic reliability. II Background and Related Work II-A Function Calling Standards OpenAI’s function calling API [ 6 ] and Anthropic’s tool use protocol [ 7 ] standardize how LLMs declare available tools via JSON Schema and receive structured invocation requests. These efforts focus on the declaration and invocation format of tools but prescribe nothing about execution governance, response semantics, or multi-phase interaction patterns. II-B Tool-Augmented LLMs Toolformer [ 1 ] demonstrated that LLMs can learn to insert API calls into their generation process. Gorilla [ 2 ] trained models to generate accurate API calls from documentation. ToolBench [ 3 ] and API-Bank [ 4 ] constructed benchmarks for tool selection and sequencing. TaskMatrix.AI [ 5 ] proposed connecting foundation models with millions of APIs. These works address which tool to call and how to call it but assume the tool interface is fixed and CRUD-shaped. II-C Agentic Frameworks LangChain [ 11 ] , AutoGPT [ 12 ] , CrewAI [ 13 ] , and MetaGPT [ 14 ] provide orchestration layers for multi-step agent execution. The ReAct paradigm [ 9 ] interleaves reasoning and acting; MRKL [ 10 ] routes to expert modules. These frameworks define the planning loop above the tool layer but treat individual tools as atomic functions with unstructured returns. II-D API Gateway and Access Control API gateways such as Kong [ 16 ] and Envoy [ 17 ] provide rate limiting, authentication, and routing. OAuth 2.0 [ 18 ] and RBAC [ 19 ] define access control models. However, these operate at the transport or identity layer and have no awareness of agent-specific semantics such as tool risk levels, multi-turn context, or approval-gated execution. II-E Multi-Agent Communication Protocols Recent work on multi-agent systems has introduced communication protocols such as Google’s Agent-to-Agent (A2A) protocol [ 25 ] and various inter-agent messaging standards. These protocols address how agents coordinate with each other but do not prescribe how individual agents should interact with the underlying tool layer. Our work is orthogonal: it defines the agent-to-tool interface, which any multi-agent protocol can build upon. II-F Model Context Protocol The Model Context Protocol (MCP) [ 8 ] has emerged as a de facto standard for tool discovery and invocation transport in AI agent ecosystems. MCP standardizes how agents discover available tools (via tools/list ) and invoke them (via tools/call over JSON-RPC), providing a universal “plug shape” analogous to TCP/IP in networking. However, MCP is deliberately agnostic to tool semantics. It treats tools as black boxes: a traditional CRUD endpoint and an Agent-First tool are indistinguishable at the MCP transport layer. Critically, the five architectural mismatches identified in Section I persist entirely within MCP-compliant systems when the underlying tools follow conventional CRUD design: • MCP’s input schema still requires exact parameter values

Read the complete text