MinionsLLM: a Task-adaptive Framework For The Training and Control of Multi-Agent Systems Through Natural Language
Andres Garcia Rincon, Eliseo Ferrante · 2025
Read MinionsLLM: a Task-adaptive Framework For The Training and Control of Multi-Agent Systems Through Natural Language by Andres Garcia Rincon, Eliseo Ferrante (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08283.txt.
Introduction
Andres Garcia Rincon and Eliseo Ferrante let users command robot teams in plain words in a 2025 paper. Their framework wires large language models to behavior trees and formal grammars, so multi-agent systems in any user-defined world can be trained and steered through natural language.
Standard interfaces define worlds, agents, and basic actions. Two synthetic data recipes fine-tune the model for valid syntax and on-task meaning. Tested on a model family at three sizes, the better recipe lifts valid outputs above ninety percent and task scores by a third. Small models gain most, hinting that compact local models can run such teams. All resources are open source.
Catalog record
| CREATOR | Andres Garcia Rincon, Eliseo Ferrante |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08283
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MinionsLLM: a Task-adaptive Framework For The Training and Control of Multi-Agent Systems Through Natural Language Andres Garcia Rincon, Eliseo Ferrante Abstract This paper presents MinionsLLM , a novel framework that integrates Large Language Models (LLMs) with Behavior Trees (BTs) and Formal Grammars to enable natural language control of multi-agent systems within arbitrary, user-defined environments. MinionsLLM provides standardized interfaces for defining environments, agents, and behavioral primitives, and introduces two synthetic dataset generation methods (Method A and Method B) to fine-tune LLMs for improved syntactic validity and semantic task relevance. We validate our approach using Google’s Gemma 3 model family at three parameter scales (1B, 4B, and 12B) and demonstrate substantial gains: Method B increases syntactic validity to 92.6% and achieves a mean task performance improvement of 33% over baseline. Notably, our experiments show that smaller models benefit most from fine-tuning, suggesting promising directions for deploying compact, locally hosted LLMs in resource-constrained multi-agent control scenarios. The framework and all resources are released open-source to support reproducibility and future research. 1 Introduction In nature, collective behaviors have proved effective in increasing the capabilities of individuals, from homogeneous schools of fish swarming to protect from predators, to heterogenous ant colonies with specialized roles such as workers and fighters [ 12 ] . The field of swarm robotics engages in the recreation of such capabilities but faces a major challenge: while we can observe the emergent swarm behavior, it is unclear which rules the individual should follow so that it successfully emerges [ 4 ] . Some methods describe a set of primitive behaviors for the individual, such as actions to interact with the environment or conditional checks for environmental or internal conditions, and evolve a combined representation of them to achieve collective behaviors that adhere to syntactic rules defined through Formal Grammars [ 2 ] . Other methods define the action space for the agent and the reward structure for the desired task to induce the emergence of the desired behavior through repeated interaction with the environment [ 14 ] . Nevertheless, the exploration of combining Formal Grammars (FGs) and repeated environment interaction for the control of robotic agents for environment-specific tasks remains an open field. The translation of a desired task as described by a human operator to the low-level implementation presents a significant challenge in itself. Natural Language Processing (NLP) has long been studied as a tool to overcome it. Different frameworks have achieved different levels of success by using N-tuples, a form of Agent Communication Language using shared protocols with content expressing actions or intentions [ 15 ] , or by using a bidirectional natural language communication pertinent to the robot and the tasks at hand with the user using task-specific controlled natural languages [ 10 ] . Nevertheless, these frameworks rely on predetermined communication structures that require operators to be informed and trained on them to use them, defeating the goal of facilitating swarm control for inexperienced users through Natural Language. Large Language Models (LLMs) have emerged as one of the strongest tools in Human-Robot Interaction (HRI), demonstrating great potential in processing natural language tasks into actionable commands for agents and robots. Some frameworks focus on the direct synthesis of controllers through code generation by the LLMs [ 13 ] , but this approach results in a framework that depends on a specific coding language, language version, and even library releases, as a simple change in the syntax of any of these components would dramatically affect the ability of the LLM to synthetize such controllers succesfully. Other frameworks intelligently employ the usage of more abstract representations for robotic controllers, like Behavior Trees [ 18 ] . However, such frameworks heavily rely on the usage of traditional LLM service providers like OpenAI for continuous on-task prompting, which creates a dependency on massive, state-of-the-art models for API calls and continuous access to the internet. Therefore, a field of increasing interest is in enabling the deployment of such frameworks through open-source, smaller models that can be run locally with consumer-accessible hardware. Additionally, LLMs require a degree of training in order to have a reliable task-specific performance. Frameworks like [ 6 ] choose to collect and hand-curate examples to build a general dataset, but this leads back to the problem of task-specific controller development by relying on experts’ discretion, who might not know a priori a controller implementation for such a task. Other frameworks instead choose to create a semi-synthetic dataset of BTs [ 9 ] , while very promising, the entire system design remains task-specific, and evaluation relied on several experts for different aspects of task solving. Therefore, an ongoing challenge in the field of LLMs for robot control is finding or generating datasets relevant to the user’s use case, or the submersion of agents in an arbitrary environment where an LLM can use as a learning playground for training or dataset generation. 2 The MinionsLLM Framework Therefore, the contribution of our paper is twofold. First, we present MinionsLLM , to the best of our knowledge, the first LLM-based framework that enables the training and control of swarm systems for arbitrary sets of environments and agents solely through configurational changes. Second, a novel grammar-based method for dataset generation tailored to the configured agent and environment. Our framework aims to achieve this by addressing several challenges that relate to the following concepts, which will be explained in further detail in the Methodology section: Figure 1: MinionsLLM Framework Overview. User setups framework following top path. User follows bottom path to improve training method with simulation feedback Standardized Agent and Environment Definition: The MinionsLLM framework provides a standardized way to define the agent and environment for the user’s use case, enabling the streamlined setup of our framework according to the requirements and limitations of the task at hand, as explained in 3.4 Agent Control: Behavior Trees (BTs), further explained in Section 3.1 , enable the control of agents programmatically according to the conditions the agent is subjected to. By harnessing BTs, the MinionsLLM framework is able to abstract the low-level control of agents and robots from the LLM, which achieves two valuable feats. First, the LLM can focus on learning the proper usage of primitives instead of wasting capabilities on their implementation. Second, our framework can control any arbitrary agent, since the nodes that define the primitives can connect to anything from agents in a simulated environment, to even physical robots through frameworks like ROS [ 8 ] . Syntactic Structure: For commands to be executable by an agent, they need to respect the syntax of the language used for communication. Formal Grammars (FGs) have historically provided a way to define the production rules of a language to form valid structures. The MinionsLLM framework defines a standardized and dynamic way to define a FG to enforce the syntax of the BTs used to control such an agent to achieve tasks within such an environment. We further explain FGs in Section 3.2 Semantic Relevance: For any task to be achieved, the BTs not only need to be syntactically valid, but the combination of the agent primitive behaviors defined as nodes in the BT should form a structure with meaning within the environment. When related to language, a