AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystem ISBN: 978-1-4503-XXXX-X/2018/06
Rui Liu, Tao Zhe, Dongjie Wang, Zijun Yao, Kunpeng Liu, Yanjie Fu, Huan Liu, Jian Pei · 2026
Read AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystem ISBN: 978-1-4503-XXXX-X/2018/06 by Rui Liu, Tao Zhe, Dongjie Wang, Zijun Yao, Kunpeng Liu, Yanjie Fu, Huan Liu, Jian Pei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08938.txt.
Introduction
Rui Liu and colleagues propose an agent operating system to replace application silos. Current agents run as ordinary apps on systems built for screen or text interfaces, fragmenting interaction, permissions, and context. Their AgentOS centers on a natural-language portal with a Kernel that interprets intent, breaks down tasks, and coordinates agents, while apps become composable skills modules.
Catalog record
| CREATOR | Rui Liu, Tao Zhe, Dongjie Wang, Zijun Yao, Kunpeng Liu, Yanjie Fu, Huan Liu, Jian Pei |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24574 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08938
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystem ISBN: 978-1-4503-XXXX-X/2018/06 Rui Liu, Tao Zhe, Dongjie Wang, Zijun Yao, Kunpeng Liu, Yanjie Fu, Huan Liu, Jian Pei Abstract . The rapid emergence of open-source, locally hosted intelligent agents marks a critical inflection point in human-computer interaction. Systems such as OpenClaw demonstrate that Large Language Model (LLM)-based agents can autonomously operate local computing environments, orchestrate workflows, and integrate external tools. However, within the current paradigm, these agents remain conventional applications running on legacy operating systems originally designed for Graphical User Interfaces (GUIs) or Command Line Interfaces (CLIs). This architectural mismatch leads to fragmented interaction models, poorly structured permission management (often described as "Shadow AI"), and severe context fragmentation. This paper proposes a new paradigm: a Personal Agent Operating System (AgentOS). In AgentOS, traditional GUI desktops are replaced by a Natural User Interface (NUI) centered on a unified natural language or voice portal. The system core becomes an Agent Kernel that interprets user intent, decomposes tasks, and coordinates multiple agents, while traditional applications evolve into modular Skills-as-Modules enabling users to compose software through natural language rules. We argue that realizing AgentOS fundamentally becomes a Knowledge Discovery and Data Mining (KDD) problem. The Agent Kernel must operate as a real-time engine for intent mining and knowledge discovery. Viewed through this lens, the operating system becomes a continuous data mining pipeline involving sequential pattern mining for workflow automation, recommender systems for skill retrieval, and dynamically evolving personal knowledge graphs. These challenges define a new research agenda for the KDD community in building the next generation of intelligent computing systems. 1. Introduction: The OpenClaw Moment and the End of the GUI 1.1. The Eruption of Local Autonomous Agents In early 2026, the computing landscape experienced a rapid shift driven by locally deployed autonomous agents, exemplified by OpenClaw (formerly Moltbot and Clawdbot). As an open-source, locally self-hosted AI assistant, OpenClaw quickly gained attention within the developer community, accumulating over 100,000 GitHub stars within weeks. It demonstrated a new paradigm of human–computer interaction: an AI agent capable of directly operating personal computing environments on behalf of users ( 29 ; 20 ; 26 ) . By integrating messaging gateways (e.g., WhatsApp, Telegram, iMessage, and Slack) with the Model Context Protocol (MCP), OpenClaw functions as a persistent background agent capable of reading and writing files, executing terminal commands, managing calendars, and browsing the web ( 18 ; 1 ) . Developers often describe it as “Claude with hands,” highlighting that it is not merely a conversational interface but a continuously running agent interacting directly with the operating system. Through an autonomous agentic loop , it maintains long-term memory and executes long-horizon tasks with minimal supervision ( 15 ) . Meanwhile, proprietary systems—such as Anthropic’s Claude Code Remote Control and Perplexity Computer—illustrate growing demand for scheduled task execution, deep contextual integration, and remote AI orchestration in enterprise and developer workflows. However, the rapid adoption of such agents exposes a fundamental limitation of modern computing architectures: they still operate as user-space processes on legacy operating systems (e.g., Windows, macOS, and Linux) designed for human-driven graphical interfaces and isolated application silos rather than continuously operating autonomous agents. Figure 1. Paradigm Shift from GUI-Based Operating Systems to AgentOS with Multi-Agent Orchestration and Natural Language Interface. 1.2. The "Shadow AI" Crisis and the "Screen-as-Interface" Bottleneck Forcing autonomous agents to operate within legacy operating systems creates a phenomenon analogous to “Shadow IT,” which we term Shadow AI . Because these systems lack semantic understanding of agent actions, agents rely on brittle interaction workarounds. Consequently, many mobile and desktop agents operate under a “Screen-as-Interface” paradigm, using visual scraping (pixels-to-text) or simulated GUI interactions (e.g., mouse clicks and keystrokes) to perform tasks ( 17 ) . This GUI-centric interaction model is fundamentally ill-suited for autonomous agents for several reasons: • Loss of Semantic Information: GUIs are designed for human visual interpretation, presenting visual outputs while obscuring underlying structured data and metadata. Agents that “read” the screen therefore lose semantic context, often leading to reasoning errors ( 5 ; 36 ) . • Fragile Execution Paths: Interface layouts frequently change. When applications update their interfaces, agents relying on visual markers or fixed screen coordinates may fail catastrophically ( 37 ) . • Runaway Security and Permissions: Legacy operating systems manage permissions at the application level (e.g., file system access). Once an autonomous agent receives such permissions, the system cannot reliably distinguish legitimate actions from malicious behaviors (e.g., indirect prompt injection leading to data exfiltration) ( 23 ; 3 ) . 1.3. Paradigm Shift: From GUI to Natural User Interfaces Historical trends in computing indicate a transition from graphical user interfaces (GUIs) toward natural user interfaces (NUIs). Traditional operating systems are largely passive, responding to explicit user commands through deterministic program logic. Future computing environments, however, require proactive and probabilistic systems capable of inferring user intent from ambiguous and multimodal interactions ( 24 ) . Addressing the growing mismatch between intelligent software and legacy system architectures therefore requires a clean-slate architectural redesign. In this paradigm, the traditional operating system kernel is encapsulated beneath a new intelligent layer—the Agent Kernel —which becomes the primary interface between users and the system, transforming the computer from isolated applications into a unified natural language–driven computational platform. 2. Vision: The Architectural Reconstruction of AgentOS AgentOS represents a structural rethinking of the computing environment ( 19 ) . Rather than operating as an application on top of an existing system, AgentOS redefines the operating system itself. Under this paradigm, traditional GUI-driven desktop environments and isolated application layers are replaced by an agent-centric architecture. The Agent Kernel acts as the primary system interface, translating natural language intent into deterministic actions executed by sandboxed, user-defined skill modules. Figure 2. Layered Architecture of AgentOS: Single Port Interface, Agent Kernel, and Legacy Infrastructure Abstraction. Architecture Layer Legacy OS AgentOS Human–Computer Interface (HCI) GUI / Desktop Window Manager Single Natural Language Port (Voice / Text) Application Layer Isolated Third-Party Applications (Apps) User-Defined Skill Modules (Skills) Core Management Engine Process Scheduling, Memory Management Intent Parser, Multi-Agent Coordinator, LLM Resource Scheduler Underlying Interaction System Calls (Syscalls), POSIX Model Context Protocol (MCP), Semantic API Hardware Abstraction Physical Hardware Drivers Legacy OS Kernel (Invisible Infrastructure) Table 1. Comparison between Legacy OS and AgentOS architectures. 2.1. The Single Port: The Death of the Desktop A defining user-facing characteristic of AgentOS is the replacement of the traditional desktop metaphor with a unified interaction gateway referred to as the Single Port ( 9 ; 41 ) . Conventional interface elements such as icons, menus, taskbars, and window management become secondary interaction mechanisms rather than the primary interface. In the default state, the system remains in a minimalist standby mode, exposing a persistent multimodal interface that accepts voice, text, and contextual signals. Users interact with the system primarily through natural language instructions. Visual interfaces are generated only when necessary—for example, when resolving ambiguous instructions or presenting inherently visual outputs such as charts, maps, or videos. By centralizing interaction into a single semantic interface, AgentOS significantly reduces the cognitive overhead associated with navigating across multiple applications and interface contexts. 2.2. Agent Kernel Architecture: From Process Scheduling to Intent Orchestration At the core of AgentOS lies the Agent