Alpha Berkeley: A Scalable Framework for the Orchestration of Agentic Systems

Thorsten Hellert, João Montenegro, Antonin Sulc · 2025

Read Alpha Berkeley: A Scalable Framework for the Orchestration of Agentic Systems by Thorsten Hellert, João Montenegro, Antonin Sulc (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15066.txt.

Introduction

Thorsten Hellert, João Montenegro, and Antonin Sulc present Osprey, a framework that lets language-model agents help run big scientific machines without giving them free rein. Control rooms must turn an operator's intent into exact hardware actions while safety rules stay absolute. Osprey answers in four parts.

An orchestrator drafts the full execution plan, dependencies included, for human review before any hardware moves. A coordination layer keeps data flows and types in order and trims huge data sets on its own. A classifier picks only the tools a task needs, keeping prompts lean as facilities grow. Connectors let the same setup ride on different control systems. The team shows a teaching assistant and a live deployment at the Advanced Light Source, where the system works across hundreds of thousands of control channels.

Catalog record

CREATORThorsten Hellert, João Montenegro, Antonin Sulc
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15066

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Alpha Berkeley: A Scalable Framework for the Orchestration of Agentic Systems Thorsten Hellert, João Montenegro, Antonin Sulc Abstract Coordinating workflows across heterogeneous control systems remains a central challenge in safety-critical environments such as scientific facilities, industrial plants, and energy infrastructures. Language-model–driven agents offer a natural interface for these tasks, but existing approaches often lack scalability, reliability, and human oversight. We introduce the Alpha Berkeley Framework, a production-ready architecture for scalable agentic systems that integrate conversational context with robust tool orchestration. The framework features dynamic capability classification to select only relevant tools per task, a plan-first orchestration model that generates execution plans with explicit dependencies and optional human approval, context-aware task extraction that combines dialogue history with external memory and domain resources, and production-ready execution environments with checkpointing, artifact management, and modular deployment. We demonstrate its versatility through two case studies: a tutorial-style wind farm monitoring example and a deployment at the Advanced Light Source particle accelerator. These results establish Alpha Berkeley as a reliable and transparent framework for agentic systems in high-stakes domains. Figure 1: Overview of the Alpha Berkeley Framework workflow. Multi-turn conversational input and external data sources are first processed into a structured task. Relevant capabilities are dynamically classified on a turn-by-turn basis, and the selected tools are passed to the execution planner. The planner generates a complete, inspectable execution plan with explicit dependencies, which is then carried out by the agent with context tracking and artifact management. I Introduction Coordinating large-scale, safety-critical systems, such as smart electrical grids Rajaperumal and Columbus 2025 , industrial chemical processes Boskabadi et al. 2025 , and scientific facilities such as particle accelerators Sulc et al. 2024 , remains a central challenge in modern engineering. These environments integrate legacy and modern control systems that generate vast amounts of diverse data. Operators must act on this information under tight time constraints (for example, during accelerator fault recovery or power-grid disturbances) Yigit et al. 2025 yet retrieving, interpreting, and coordinating across systems remains cumbersome. Critical expertise is often preserved only as tacit human experience, scattered across institutional memory rather than codified in software. This tension between the need for flexibility and the rigidity of existing software architectures limits the ability to respond effectively to evolving operational demands and unexpected events. Agentic AI Sapkota et al. 2025 , Language Model (LM) powered agents that orchestrate multi-step workflows through tool use, memory, and planning, offers a compelling opportunity to address these challenges. By providing a natural interface to data sources and control systems, LMs allow operators to express intent in high-level terms while delegating the orchestration of complex workflows to agents. In familiar domains such as web search Song et al. 2025 or travel planning Chen et al. 2024 , LMs already demonstrate this capability, as their training reflects widespread usage patterns and benchmark tasks. By contrast, in highly specialized domains such as particle accelerators, materials science beamlines, or other expert-driven facilities, much of the relevant expertise is absent from training corpora and cannot be inferred from general usage data. Instead, the knowledge is fragmented, highly context-dependent, and often confined to experts. Leveraging agentic AI in these environments therefore requires not only robust tool integration but also architectures capable of surfacing, formalizing, and operationalizing tacit human knowledge, while maintaining human-in-the-loop mechanisms to ensure safety and trust in high-stakes contexts. In this paper, we introduce the Alpha Berkeley Framework Alpha Berkeley Developers 2025 , a production-ready architecture for building scalable agentic systems in complex scientific and industrial environments. Built on LangGraph LangGraph developers 2025 for its underlying graph-based orchestration substrate, our framework is distinguished by four characteristics: • Scalability through dynamic capability classification: On every interaction, the framework evaluates the current task and classifies available tools for relevance on a per-capability basis. This turn-by-turn filtering mitigates prompt explosion, prevents unnecessary tool loading, and allows the system to effectively generate a tailored “agent” for each prompt. As a result, the framework scales across large and growing tool inventories without overwhelming the language model. • Plan-first orchestration with human oversight: Unlike reactive agents that operate step-by-step, our framework generates complete execution plans upfront, with explicit input–output dependencies and error handling. Plans are presented to the user through integrated inspection and editing tools, enabling convenient approval and modification before execution begins. • Conversational awareness with external integration: The system incorporates multi-turn conversational context together with external resources, such as personal memory, databases, and APIs that are ensuring grounded, context-rich task extraction. • Production-ready adaptability: Designed for real deployments, the framework provides modular execution environments, artifact management, checkpointing, and diverse interfaces, including CLI, Open WebUI, and containerized services. Together, these contributions move beyond proof-of-concept demonstrations toward a framework that is both flexible enough to adapt to new domains and robust enough for use in safety-critical operations. We illustrate the framework with two examples: a tutorial-style mock-up in a wind farm scenario, and a real-world deployment in the Advanced Light Source (ALS) control room. These case studies show both how the framework operates in practice and how it can be applied in complex, high-stakes environments. II Background and Related Work II.1 Agentic Systems and Tool Use The foundations of agentic language models and multi-agent systems build on the classic definition of agents as entities that perceive their environment and act upon it, with rational agents aiming to maximize performance measures Russell and Norvig 2020 . Extending this principle, multi-agent systems introduce shared environments in which agents may cooperate or compete. Early frameworks such as ReAct unified reasoning and acting in iterative loops for tool-based tasks Yao et al. 2023 , while AutoGen extended this paradigm toward multi-agent conversation orchestration, enabling specialized agents to collaborate on complex objectives Wu et al. 2023 . Scaling tool use in LMs has since become a central concern. Toolformer demonstrated that LMs can be trained to make self-supervised API calls Schick et al. 2023 , while more recent work such as RAG-MCP addresses prompt bloat in tool selection by leveraging retrieval-augmented generation to select only relevant capabilities at inference time Gan and Sun 2025 . Beyond single-turn execution, memory and retrieval play an equally important role. Retrieval-Augmented Generation (RAG) integrates external knowledge into LM reasoning Lewis et al. 2021 , but remains subject to context window limitations, such as the “Lost in the Middle” phenomenon Liu et al. 2023 . To overcome this, memory-augmented agents like MemGPT Packer et al. 2023 and subsequent surveys Wang et al. 2024 have highlighted methods for extending long-context reasoning. Other work formalizes agent memory as a first-class capability, emphasizing the ability to retain past interactions to inform future steps Sapkota et al. 2025 . Recent examples include SciBORG Muhoberac et al. 2025 , a modular agentic framework for scientific tasks that employs FSA-based memory and context awareness to provide reliable execution and interpretable state transitions. Parallel efforts in task-oriented dialogue also offer complementary insights into grounded task extraction and intent modeling Qin et al. 2023 . In summary, while prior work has advanced scaling of tool use and memory, these systems often still face challenges of prompt growth and domain grounding at inference time. We address these limitations in Section III.1 and Section III.2 , where we introduce per-capability classification and

Read the complete text