Gradientsys: A Multi-Agent LLM Scheduler with ReAct Orchestration
Xinyuan Song, Zeyu Wang, Siyi Wu, Tianyu Shi, Lynn Ai · 2025
Read Gradientsys: A Multi-Agent LLM Scheduler with ReAct Orchestration by Xinyuan Song, Zeyu Wang, Siyi Wu, Tianyu Shi, Lynn Ai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06520.txt.
Introduction
Xinyuan Song and co-authors build a scheduler that runs teams of AI agents in this 2025 paper. Their system, Gradientsys, uses a language model as the dispatcher. It hands tasks to specialist agents, like document parsers, web searchers, and interface drivers, and runs many at once.
A planning loop in the ReAct style lets the scheduler rethink as results arrive. Agents' capacity limits are respected, and failures trigger retries or fresh plans. A live feed streams each agent's acts and reasoning to watchers. The design mixes timed and untimed work in one frame. It targets firms that need many agents to cooperate openly.
Catalog record
| CREATOR | Xinyuan Song, Zeyu Wang, Siyi Wu, Tianyu Shi, Lynn Ai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06520
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Gradientsys: A Multi-Agent LLM Scheduler with ReAct Orchestration Xinyuan Song, Zeyu Wang, Siyi Wu, Tianyu Shi, Lynn Ai Abstract We present Gradientsys , a next-generation multi-agent scheduling framework that coordinates diverse specialized AI agents using a typed Model-Context Protocol (MCP) and a ReAct-based dynamic planning loop. At its core, Gradientsys employs an LLM-powered scheduler for intelligent one-to-many task dispatch, enabling parallel execution of heterogeneous agents such as PDF parsers, web search modules, GUI controllers, and web builders. The framework supports hybrid synchronous/asynchronous execution, respects agent capacity constraints, and incorporates a robust retry-and-replan mechanism to handle failures gracefully. To promote transparency and trust, Gradientsys includes an observability layer streaming real-time agent activity and intermediate reasoning via Server-Sent Events (SSE). We offer an architectural overview and evaluate Gradientsys against existing frameworks in terms of extensibility, scheduling topology, tool reusability, parallelism, and observability. Experiments on the GAIA general-assistant benchmark show that Gradientsys achieves higher task success rates with reduced latency and lower API costs compared to a MinionS-style baseline, demonstrating the strength of its LLM-driven multi-agent orchestration. 1 Introduction Large Language Models (LLMs) augmented with tool use have enabled AI agents that can perform complex, multi-step tasks beyond basic question-answering [ 19 ] . By combining reasoning with actions (e.g. using tools or APIs), these agents can retrieve information, process documents, and interact with external environments to solve real-world problems. Recent benchmarks like GAIA target [ 17 ] such General AI Assistants, requiring abilities like multi-hop reasoning, web browsing, and tool-use in real scenarios. However, existing agent frameworks face limitations in scheduling and orchestration. Early systems like AutoGPT [ 18 ] run a single agent loop sequentially, lacking true parallelism or modular reuse of specialized sub-agents. Other frameworks (e.g. Manas [ 10 ] , TaskWeaver [ 11 ] ) allow multiple agents or plugins, but often rely on static workflows or code-generation, and may not fully exploit dynamic LLM reasoning for on-the-fly planning. We present Gradientsys , a multi-agent scheduling system that addresses these gaps by leveraging an LLM planner using the ReAct paradigm [ 24 ] to dynamically orchestrate a Gradientsys of tools. Gradientsys’s core is an LLM-based scheduler that maintains a registry of available agents (tools) described in a standardized way via the Model Context Protocol (MCP) [ 8 , 1 ] . At runtime, the scheduler reasons about a given task, selects appropriate tools, and can dispatch multiple tool calls in parallel (one-to-many) when beneficial. It manages each agent’s capacity (to avoid overload) and handles failures by retrying or replanning alternate strategies. To the user, Gradientsys provides improved observability: as the LLM planner reasons and agents perform work, the system streams intermediate steps and partial results live via Server-Sent Events (SSE) [ 22 ] , increasing transparency and debuggability. Figure 1: Gradientsys architecture overview. The LLM Scheduler (center) employs a ReAct-based planner to coordinate with a registry of registered tools. It supports concurrent dispatch of actions to multiple agents (e.g., Agent A, Agent B), aggregates results via a summarization agent, and returns the final output. Dashed lines denote registry queries, while dotted lines represent observability event streams. Gradientsys’s design brings several key contributions: • Dynamic LLM-Driven Planning: We integrate the ReAct framework into the scheduler, allowing the LLM to generate interleaved reasoning traces and tool actions for adaptive task decomposition and real-time exception handling. • Parallel Multi-Agent Orchestration: The scheduler supports concurrent invocation of multiple agents when tasks can be parallelized (e.g., processing document chunks), unlike prior sequential frameworks. A typed MCP interface ensures seamless integration of heterogeneous tools with minimal custom code. • Tool Registry and Extensibility: Gradientsys provides a registry where tools register via a URL, a textual capability description, maximum parallelism, and optional cost metadata. This enables runtime hot-plugging of tools, with the LLM planner discovering and using them automatically. The standardized MCP-inspired interface improves reusability across tasks and LLM backends. • Hybrid Sync/Async Execution: The system supports a flexible mix of synchronous and asynchronous execution. The LLM planner can issue blocking calls for immediate results or launch asynchronous tasks while continuing reasoning. A threadpool-based dispatcher manages parallel agent calls while respecting each agent’s capacity. • Observability and Control: Planning traces and agent actions are streamed via SSE, enhancing transparency, debugging, and trust, and enabling real-time intervention if needed. The system is privacy-aware, sending each tool only the minimal necessary context to protect sensitive data. • Improved Performance on GAIA Benchmark: Gradientsys achieves higher accuracy and reduced latency and cost on the GAIA general-assistant benchmark compared to a MinionS-style baseline, demonstrating the effectiveness of its scheduling. 2 System Architecture Overview Gradientsys is built around a centralized LLM Scheduler that orchestrates a pool of modular, specialized tool agents. Figure 1 illustrates the high-level workflow. Upon receiving a user query (optionally with documents), the Scheduler initiates an iterative ReAct reasoning loop. It first queries the Tool Registry (Step 1) to discover available agents and their metadata. Based on this, it selects and dispatches appropriate tools, invoking multiple agents in parallel when subtasks are independent (Step 2). Each agent (e.g., PDF parsers, web search modules, GUI controllers) performs its subtask and returns results asynchronously (Step 3). The Scheduler aggregates outputs, optionally delegating fusion to an Aggregator or Summarizer agent (Step 4), and returns the final result to the user (Step 5). Throughout, an Observability Module streams live updates—reasoning traces, tool invocations, intermediate results—via Server-Sent Events (SSE), enabling real-time monitoring and feedback. A key strength of Gradientsys’s architecture is its integration with the Model-Context Protocol (MCP), a typed HTTP interface standard for connecting LLMs to tools. Each agent conforms to an MCP-compatible schema, enabling uniform, composable tool invocation. The Tool Registry forms the system’s metadata backbone. Each tool is described by an endpoint, brief description, and optionally a type signature specifying I/O. Metadata includes max_parallel (max concurrent calls) and cost_per_1k tokens (e.g., API cost). The scheduler uses this for planning and load management, preventing overload. Tools can be registered or removed at runtime, with the LLM context updated accordingly. Gradientsys uses a hybrid sync/async dispatcher. When multiple tool actions are issued in a ReAct iteration (e.g., “Call AgentA with X and AgentB with Y”), they run concurrently via thread pools or coroutines. If a tool exceeds its concurrency limit, calls are queued or rerouted. Sync tasks block reasoning; async tasks allow overlap, reducing latency. Central to orchestration is the ReAct loop, where the LLM alternates between thoughts (natural language) and actions (structured tool calls). Actions are parsed, executed, and results fed back into context. A scratchpad stores reasoning steps, allowing the LLM to track progress, avoid redundancy, and handle failures. Observability is a core concern. At each planning and execution step—e.g., “Invoking Tool T with input X ,” “Tool T returned output Y ”—structured events are streamed via SSE to clients. This real-time transparency improves debugging and trust. Unlike frameworks like AutoGPT, which emit static logs post hoc, Gradientsys allows users to observe and intervene during execution. 3 System Features and Implementation Details Gradientsys’s system-level features include streaming feedback via server-sent events (SSE) [ 3 ] , privacy-aware data dispatching [ 20 ] , threadpool-based concurrency [ 5 ] , robust error handling with timeouts, and integration pathways with other agent