Beyond Autonomy: A Dynamic Tiered AgentRunner Framework for Governable and Resilient Enterprise AI Execution
Kai Pan, Rong Hou [email protected] · 2026
Read Beyond Autonomy: A Dynamic Tiered AgentRunner Framework for Governable and Resilient Enterprise AI Execution by Kai Pan, Rong Hou [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10223.txt.
Introduction
Kai Pan and Rong Hou argue that business AI agents fail less from too little freedom than from too little oversight. Their 2026 paper presents Dynamic Tiered AgentRunner, an execution protocol drawn from a live multi-tenant software platform. It aims to keep powerful language-model agents governable, auditable, and affordable in company settings.
Three mechanisms do the work. Risk-adaptive tiering matches review effort and computing budget to each task. Separation of powers splits proposing, reviewing, executing, and verifying across independent processes. A verifier-recovery loop treats failure as a normal state to learn from. On the live platform the system reached 88.9 percent task success with only 0.5 percent unreviewed risky errors. Latency fell by 46.8 percent and inference cost by 58.2 percent against an always-full pipeline.
Catalog record
| CREATOR | Kai Pan, Rong Hou [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10223
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Autonomy: A Dynamic Tiered AgentRunner Framework for Governable and Resilient Enterprise AI Execution Kai Pan, Rong Hou [email protected] Abstract The prevailing paradigm in LLM-based agent research pursues ever-greater autonomy. Yet in enterprise environments, the critical bottleneck is not insufficient autonomy but insufficient governability : high-risk write operations proceed without independent review, complex multi-step tasks lack verification mechanisms, and indiscriminate computational expenditure renders deployment economically unviable. We present Dynamic Tiered AgentRunner , a controlled execution protocol distilled from a production multi-tenant SaaS platform. The framework operationalizes three core mechanisms: (1) Risk-Adaptive Tiering that dynamically allocates computational budget and review intensity across Light, Standard, and Full execution modes based on a task’s risk-complexity profile—achieving Pareto-optimal safety-efficiency trade-offs; (2) Separation of Powers that physically isolates proposal (Worker), review (Critic), execution (ToolGateway), and verification (Verifier) into independent, non-colluding processes—no single agent can simultaneously propose and approve an action; and (3) a Verifier-Recovery closed loop that embraces failure as a first-class execution state, enabling systematic self-healing and organizational learning through retrospection. Deployed and battle-tested in a real-world multi-tenant enterprise operations platform, the framework achieves 88.9% task success rate with 0.5% unreviewed risk execution errors—matching always-full pipeline safety while reducing latency by 46.8% and inference cost by 58.2%. We argue that governability is not the antithesis of autonomy, but its prerequisite. 1 Introduction “Enterprise AI does not suffer from a lack of autonomy, but from a lack of governability.” The past two years have witnessed an explosion of LLM-based autonomous agent frameworks [ 1 , 2 , 3 , 4 ] . These systems pursue a compelling vision: AI agents that decompose complex goals, invoke tools, and iterate toward solutions with minimal human intervention. Yet a growing body of deployment evidence reveals a fundamental tension—the very autonomy that makes these agents powerful also renders them ungovernable in enterprise contexts. From Autonomy to Governability. We observe a paradigm mismatch between the research community’s pursuit of maximal autonomy and the enterprise’s need for controlled, auditable, and economically sustainable execution. In production environments, three categories of failure dominate: • Privilege Escalation. An autonomous agent tasked with “updating store schedules” hallucinates a broader scope and modifies cross-brand configurations, affecting hundreds of locations without authorization. • Cascading Failure. A multi-step agent encounters a partial tool failure but continues executing downstream operations on corrupted state, propagating errors across business objects. • Cost Explosion. A static multi-agent pipeline applies full Critic-Verifier-Recovery overhead to every task—including simple read queries—multiplying inference costs by 3\text{--}5\times without proportional safety gains. These are not edge cases but structural consequences of architectures that treat governance as an afterthought. The autonomous agent paradigm (AutoGPT [ 1 ] , BabyAGI [ 2 ] ) provides zero governance. Multi-agent frameworks (AutoGen [ 3 ] , CrewAI [ 5 ] , LangGraph [ 6 ] ) introduce role decomposition but enforce only soft constraints —an agent “should” check permissions, but nothing physically prevents bypass. Traditional workflow engines (Temporal [ 16 ] , Airflow [ 18 ] ) provide hard execution guarantees but cannot accommodate LLM reasoning. The AgentRunner Paradigm. We propose a fundamental reframing: enterprise multi-agent systems should be designed not as autonomous collectives pursuing individual goals, but as governed execution ensembles —controlled agent groups collaborating around a single business objective under explicit constitutional constraints. The key insight is that not all tasks deserve equal governance overhead . A simple information query and a cross-brand batch mutation have fundamentally different risk profiles and should receive proportionally different levels of scrutiny. This insight leads to our framework: Dynamic Tiered AgentRunner —a risk-adaptive, multi-role execution architecture that dynamically adjusts governance intensity to match task risk, enforces physical separation between proposal and execution, and builds resilience through systematic failure handling. Contributions. This paper makes four contributions: • A Risk-Adaptive Tiering mechanism that achieves Pareto-optimal trade-off between safety and efficiency, routing 55% of production tasks through a minimal-overhead Light path while reserving full governance for the 15% that genuinely require it. • A Separation of Powers architecture with physically isolated execution boundaries—the ToolGateway acts as a hard constitutional constraint, not a prompt-level suggestion. • Resilience-by-Design through a Verifier-Recovery closed loop that treats failure as a first-class state, achieving 67% automated recovery rate on initially-failed tasks. • Production deployment evidence from a real-world multi-tenant SaaS platform, demonstrating that the framework transforms AI governance from a “prompt engineering hope” into a “system architecture guarantee.” 2 The Governability Gap in Multi-Agent Systems Existing multi-agent frameworks excel at orchestration but fundamentally lack governance . We define the governability gap as the absence of system-level mechanisms that prevent, detect, and recover from agent misbehavior independent of the underlying LLM’s alignment. 2.1 Soft Constraints Are Not Governance AutoGen [ 3 ] provides flexible multi-agent conversation patterns with customizable termination conditions. CrewAI [ 5 ] formalizes role-based task decomposition with configurable delegation. LangGraph [ 6 ] enables graph-based agent orchestration with conditional routing. MetaGPT [ 4 ] and ChatDev [ 7 ] demonstrate impressive role-playing for software engineering. These are excellent orchestration tools. But they operate under a critical assumption: agents are well-behaved by construction . Their “constraints” are prompt-level instructions (“You are a careful reviewer…”) or conversation-level patterns (“Agent B reviews Agent A’s output”). Nothing in their architecture physically prevents a Worker agent from bypassing review and directly invoking a destructive tool. The constraint lives in the prompt, not in the execution boundary. 2.2 Three Enterprise Disasters We formalize three disaster categories that soft-constraint frameworks cannot prevent: Disaster 1: Privilege Escalation. An agent instructed to “update training materials for Brand A” generates tool calls that modify Brand B’s resources. In prompt-constrained systems, scope enforcement depends on the LLM correctly interpreting boundary instructions—a fundamentally unreliable mechanism given hallucination rates. Disaster 2: Cascading Failure. An agent executing a multi-step plan encounters a tool failure at step 3 of 7. Without a verification mechanism, it proceeds with steps 4–7 operating on incomplete or corrupted state. The downstream damage far exceeds the original failure. Disaster 3: Cost Explosion. A static multi-agent pipeline applies identical overhead to every task. When 55% of production tasks are simple read queries, the 3\text{--}5\times cost multiplier of full pipeline execution renders the system economically unviable at scale. 2.3 Position of This Work Traditional workflow systems (Temporal [ 16 ] , Prefect [ 17 ] , Airflow [ 18 ] ) solve durability and retry but cannot accommodate non-deterministic LLM reasoning. Agent safety research (Constitutional AI [ 14 ] , ToolEmu [ 19 ] , R-Judge [ 20 ] ) evaluates safety at the individual call level but does not provide system-level execution governance. Reflexion [ 11 ] and LATS [ 12 ] introduce self-reflection but within single-agent loops without separation of powers. AgentRunner provides a model-agnostic governance layer : regardless of which LLM serves as Worker or Critic, the ToolGateway’s hard constraints, the Checkpoint’s durability guarantees, and the tier routing logic remain invariant. The governance does not degrade when models change. 3 Core Principles We formalize three design principles that distinguish AgentRunner from prior multi-agent architectures. 3.1 Principle 1: Risk-Adaptive Tiering Not every task deserves three rounds of GPT-4 review. We operationalize this observation through a tier function that selects the minimal governance intensity sufficient for a task’s risk profile: \tau(T)=\arg\min_{t\in\{L,S,F\}}\textit{Cost}(t)\quad\text{s.t.}\quad\textit{Safety}(t)\geq\textit{Risk}(T)