HASHIRU: Hierarchical Agent System for Hybrid Intelligent Resource Utilization 1 These authors contributed equally to this work.

Kunal Pai 1, Parth Shah 1, Harshil Patel · 2025

Read HASHIRU: Hierarchical Agent System for Hybrid Intelligent Resource Utilization 1 These authors contributed equally to this work. by Kunal Pai 1, Parth Shah 1, Harshil Patel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04255.txt.

Introduction

Kunal Pai, Parth Shah, and Harshil Patel present HASHIRU in 2025, a system of AI agents led by a chief agent. Agent teams are growing fast, but many frameworks waste resources, use one model type, and cannot make their own tools. HASHIRU was built to fix those gaps.

The chief hires and fires worker agents based on task need and cost, favoring small local models and calling large ones only when needed. A cost model keeps teams stable, and the system can build its own API tools and store memory. Tests cover paper review, safety checks, and hard reasoning. The design aims at flexible help at lower cost.

Catalog record

CREATORKunal Pai 1, Parth Shah 1, Harshil Patel
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-04255

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HASHIRU: Hierarchical Agent System for Hybrid Intelligent Resource Utilization 1 These authors contributed equally to this work. Kunal Pai 1, Parth Shah 1, Harshil Patel Abstract Rapid Large Language Model (LLM) advancements are fueling autonomous Multi-Agent System (MAS) development. However, current frameworks often lack flexibility, resource awareness, model diversity, and autonomous tool creation. This paper introduces HASHIRU (Hierarchical Agent System for Hybrid Intelligent Resource Utilization), a novel MAS framework enhancing flexibility, resource efficiency, and adaptability. HASHIRU features a “CEO” agent dynamically managing specialized “employee” agents, instantiated based on task needs and resource constraints (cost, memory). Its hybrid intelligence prioritizes smaller, local LLMs (often via Ollama) while flexibly using external APIs and larger models when necessary. An economic model with hiring/firing costs promotes team stability and efficient resource allocation. The system also includes autonomous API tool creation and a memory function. Evaluations on tasks like academic paper review (58% success), safety assessments (100% on a JailbreakBench subset), and complex reasoning (outperforming Gemini 2.0 Flash on GSM8K: 96% vs. 61%; JEEBench: 80% vs. 68.3%; SVAMP: 92% vs. 84%) demonstrate HASHIRU’s capabilities. Case studies illustrate its self-improvement via autonomous cost model generation, tool integration, and budget management. HASHIRU offers a promising approach for more robust, efficient, and adaptable MAS through dynamic hierarchical control, resource-aware hybrid intelligence, and autonomous functional extension. Source code and benchmarks are available at HASHIRU and HASHIRUBench , and a live demo is available upon request. I Introduction Rapid Large Language Model (LLM) advancements are reshaping AI, enabling complex language understanding, generation, reasoning, and planning [ 6 , 13 , 55 ] . This progress fuels the development of autonomous Multi-Agent Systems (MAS) where collaborative teams tackle problems beyond individual agent capabilities [ 14 , 70 ] . Collaborative MAS show potential in scientific discovery [ 4 ] , software engineering [ 52 ] , data analysis, and decision-making [ 67 ] . The increasing complexity of tasks, evidenced by benchmarks requiring advanced reasoning (e.g., GSM8K [ 10 ] , SVAMP [ 49 ] ), coding [ 8 , 46 ] , and graduate-level knowledge [ 51 ] , necessitates agentic systems that effectively coordinate diverse cognitive resources [ 69 ] . Despite this potential, contemporary agentic frameworks exhibit limitations: rigidity due to predefined roles hindering adaptation [ 74 ] ; resource obliviousness , lacking mechanisms to optimize computational resources (API costs, memory, CPU), leading to inefficiency, especially with costly proprietary LLMs [ 48 ] ; model homogeneity , defaulting to a single powerful LLM and missing efficiency gains from diverse, smaller, or local models [ 76 ] ; and limited autonomous tool creation and integration , restricting dynamic self-improvement [ 64 , 73 , 47 ] . To address these challenges, we introduce HASHIRU (Hierarchical Agent System for Hybrid Intelligent Resource Utilization) , a novel MAS framework enhancing flexibility, resource efficiency, and adaptability. HASHIRU uses a hierarchical structure with a “CEO” agent dynamically managing specialized “employee” agents, instantiated on demand. Its hybrid intelligence strategically prioritizes smaller, local LLMs (e.g., 3B–7B, often via Ollama [ 40 ] ) for cost-effectiveness, flexibly integrating external APIs and larger models when justified by task complexity and resource availability under CEO management. The primary contributions are: 1. A novel MAS architecture with hierarchical control and dynamic, resource-aware agent lifecycle management (hiring/firing) governed by budget constraints (cost, memory) and an economic model discouraging excessive churn. 2. A hybrid intelligence model prioritizing cost-effective, local LLMs while adaptively incorporating external APIs and larger models, optimizing the efficiency-capability trade-off. 3. Integrated autonomous API tool creation for dynamic functional extension. 4. An economic model (hiring/invocation fees) promoting efficient resource allocation and usage based on task needs and system constraints. This paper details HASHIRU’s design. Section II discusses related work. Section III elaborates on the architecture. Section IV presents case studies demonstrating self-improvement capabilities. Section V describes the experimental setup and evaluation metrics. Section VI reports results, and Section VII concludes with limitations and future work. II Background and Related Work Intelligent agent concepts have evolved from early symbolic AI [ 57 , 59 ] to LLM-dominated frameworks leveraging models for reasoning, planning, and interaction [ 65 , 72 ] . HASHIRU builds on this, addressing current limitations. Agent Architectures: MAS architectures vary, including flat, federated, and hierarchical [ 14 , 25 ] . Hierarchical models offer clear control and task decomposition but risk bottlenecks and rigidity [ 15 , 16 ] . HASHIRU uses a CEO-Employee hierarchy for centralized coordination but distinguishes itself through dynamic team composition . Unlike systems with static hierarchies or predefined roles (e.g., CrewAI [ 11 ] , ChatDev [ 52 ] ), HASHIRU’s CEO dynamically manages the employee pool based on runtime needs and resource constraints. Dynamic Agent Lifecycle Management: Dynamic MAS composition is crucial for complex environments [ 36 ] . Agent creation/deletion triggers often relate to task structure or environmental changes. HASHIRU introduces a specific mechanism where the CEO makes hiring and firing decisions based on a cost-benefit analysis considering agent performance, operational costs (API fees, inferred compute), memory footprint (tracked explicitly as a percentage of available resources), and concurrency limits. HASHIRU also incorporates an economic model with explicit “starting bonus” (hiring) and “invocation” (usage) costs. This economic friction aims to prevent excessive initialization or usage for marginal gains and promote team stability, a nuance often missing in simpler dynamic strategies. Resource Management and Agent Economies: Resource awareness is critical for scalable MAS. Economic research explores mechanisms like market-based auctions or contract nets for allocation [ 9 ] . HASHIRU implements a more centralized, budget-constrained resource management model . The CEO operates within defined limits for financial cost and memory usage (as a percentage of total allocated). This direct management, particularly focusing on memory percentage, suggests practicality for deployment on local or edge devices with finite resources, contrasting with cloud systems assuming elastic resources [ 48 ] . Frameworks like AutoGen [ 71 ] and LangGraph [ 30 ] typically rely on implicit cost tracking without explicit multi-dimensional budgeting and control. Hybrid Intelligence and Heterogeneous Models: Leveraging diverse LLMs with varying capabilities, costs, latencies, and self-evolution is an emerging trend [ 76 , 32 ] . Techniques like model routing select optimal models for sub-tasks. HASHIRU embraces model heterogeneity with a strategic focus: prioritizing smaller (3B–7B), locally-run models via Ollama integration [ 40 ] . This emphasizes cost-efficiency, low latency, and potential privacy over systems defaulting to large proprietary cloud APIs (e.g., GPT-4 [ 42 ] , Claude 3 [ 1 ] ). While integrating external APIs (potentially larger models), HASHIRU’s default stance represents a distinct capability vs. efficiency balance. Tool Use and Autonomous Tool Creation: Tool use (APIs, functions) is fundamental for modern agents [ 73 , 41 ] . Most systems use predefined tools. HASHIRU advances this with integrated, autonomous API tool creation . When needed functionality is missing, the CEO can commission the generation (potentially via a specialized agent) and deployment of a new API tool within the HASHIRU ecosystem. This self-extension capability differentiates HASHIRU from systems limited to static toolsets, moving towards greater autonomy and adaptability [ 64 , 48 ] . In summary, HASHIRU integrates hierarchical control, dynamic MAS, resource management, and tool use. Its novelty lies

Read the complete text