DR. WELL: Dynamic Reasoning and Learning with Symbolic World Model for Embodied LLM-Based Multi-Agent Collaboration
Narjes Nourzad, Hanqing Yang, Shiyu Chen, Carlee Joe-Wong · 2025
Read DR. WELL: Dynamic Reasoning and Learning with Symbolic World Model for Embodied LLM-Based Multi-Agent Collaboration by Narjes Nourzad, Hanqing Yang, Shiyu Chen, Carlee Joe-Wong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04646.txt.
Introduction
Narjes Nourzad leads four authors with DR. WELL, a framework for embodied multi-agent teamwork. Robot teams must plan together with partial views and limited communication. Planning raw trajectories fails easily, since small timing slips cascade into conflicts.
Symbolic planning raises the level of abstraction and gives agents a shared action vocabulary. DR. WELL runs a two-phase negotiation: agents propose roles with reasons, then commit jointly. Consensus and environment limits shape the final allocation. Each agent then plans and acts on its own symbolic share, which keeps coordination stable while work proceeds.
Catalog record
| CREATOR | Narjes Nourzad, Hanqing Yang, Shiyu Chen, Carlee Joe-Wong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04646
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DR. WELL: Dynamic Reasoning and Learning with Symbolic World Model for Embodied LLM-Based Multi-Agent Collaboration Narjes Nourzad, Hanqing Yang, Shiyu Chen, Carlee Joe-Wong Abstract Cooperative multi-agent planning requires agents to make joint decisions with partial information and limited communication. Coordination at the trajectory level often fails, as small deviations in timing or movement cascade into conflicts. Symbolic planning mitigates this challenge by raising the level of abstraction and providing a minimal vocabulary of actions that enable synchronization and collective progress. We present DR. WELL, a decentralized neurosymbolic framework for cooperative multi-agent planning. Cooperation unfolds through a two-phase negotiation protocol: agents first propose candidate roles with reasoning and then commit to a joint allocation under consensus and environment constraints. After commitment, each agent independently generates and executes a symbolic plan for its role without revealing detailed trajectories. Plans are grounded in execution outcomes via a shared world model that encodes the current state and is updated as agents act. By reasoning over symbolic plans rather than raw trajectories, DR. WELL avoids brittle step-level alignment and enables higher-level operations that are reusable, synchronizable, and interpretable. Experiments on cooperative block-push tasks show that agents adapt across episodes, with the dynamic world model capturing reusable patterns and improving task completion rates and efficiency. Experiments on cooperative block-push tasks show that our dynamic world model improves task completion and efficiency through negotiation and self-refinement, trading a time overhead for evolving, more efficient collaboration strategies. The project is open-sourced at: https://narjesno.github.io/DR.WELL/ . \workshoptitle Bridging Language, Agent, and World Models for Reasoning and Planning (LAW) 1 Introduction Cooperation lies at the heart of many multi-agent problems. Whether autonomous vehicles are coordinating at intersections ( 19 ) or distributed sensor networks are monitoring large environments ( 12 ) , success depends on dividing tasks and aligning agents’ intentions toward shared objectives. Despite advances in both single- and multi-agent reinforcement learning (MARL), achieving generalizable cooperative behavior beyond narrow training scenarios remains difficult to model effectively ( 5 ; 14 ; 24 ) . Recent work has introduced large language models (LLMs) into multi-agent reinforcement learning to improve flexibility and generalization ( 22 ; 10 ; 2 ; 20 ) . For cooperation, LLMs can translate group objectives into role-specific subgoals, describe coordination requirements, and adapt allocations as conditions change ( 15 ) . In embodied settings with decentralized execution, however, agents face additional challenges since they must coordinate under partial observability, limited bandwidth, and asynchronous timing without centralized control. In these conditions, directly binding agent policies to raw LLM outputs has proven fragile, since behaviors depend heavily on prompt phrasing and often fail to generalize when the number of agents or environment conditions change ( 16 ) . LLMs are therefore better used in combination with structured representations, which can provide stability and consistency in cooperative planning. One natural choice is to equip agents with a shared vocabulary of concepts that complements LLM guidance. This design reduces reliance on fragile prompting while allowing coordination to emerge through composing and exchanging these symbolic structures, rather than through a single joint policy, thereby improving generalization ( 23 ; 4 ) . Figure 1 : Workflow of DR. WELL framework. In Step 1, an agent enters the communication room with other idle agents to begin negotiation and exits with a single commitment. For instance, in a block pushing environment, the commitment may be represented by a block ID, which the agent then tries to move to the goal zone. It then reasons and generates a plan to accomplish the committed task. In Step 2, the agent refines the plan using the world model, which pushes the plan toward a more effective form. Once revised, the controller validates plans. Interaction with the environment occurs by decomposing symbolic actions into their primitive form, while the environment simultaneously updates the agent’s understanding as other agents execute their own plans. This view follows the neurosymbolic perspective, which integrates neural methods for processing high-dimensional sensory data with symbolic reasoning for interpretability, verifiability, and compositional structure ( 3 ) . Concept libraries enable agents to plan, generalize, and reuse knowledge across tasks ( 11 ) , separating high-level reasoning from low-level control and supporting efficient acquisition and composition of new concepts ( 13 ; 7 ) . Such modularity facilitates continual learning and transfer, allowing concepts learned in one domain to be reused in another ( 1 ; 9 ) . Building on this view, we envision future agents that plan symbolically and learn from feedback grounded in environmental interaction, progressively refining their conceptual understanding of the world. In this paper, we propose DR. WELL ( D ynamic R easoning and Learning with Symbolic W orld Model for E mbodied LL M-Based Multi-Agent Collaboration), a decentralized neurosymbolic planning framework that enables LLM-based agents to collaborate on completing a set of interdependent tasks through a dynamic world model. Task allocation is achieved through a structured two-phase negotiation protocol. In the proposal stage, each agent suggests a candidate task and provides a brief rationale. In the commitment stage, they converge on a joint allocation under consensus and quorum constraints. Communication is limited to these rounds, in contrast to prior “free talk” approaches ( 18 ; 8 ) , so agents synchronize only when idle. After commitment, each agent drafts a plan from scratch with its LLM embodiment, a neural module that interprets context and generates candidate actions. The plan is then refined using a shared symbolic world model that encodes both a description of the current environment and a graph of past events and experience. This representation aligns agents’ reasoning without requiring disclosure of private plans. The final plan is expressed as a sequence of symbolic actions drawn from a compact vocabulary, mediated by a controller that checks preconditions locally while the environment confirms effects. As agents act, the outcomes are written back into the world model, enabling future planning to draw on both the current state and accumulated experience. This design preserves decentralization, limits communication to essential points of synchronization, and provides interpretability because agents justify their choices during negotiation and carry out plans composed of explicit symbolic actions. Our main contributions are as follows: • We introduce a two-phase negotiation protocol that enables decentralized task allocation and role commitment under structured communication. • We develop a dynamic symbolic world model that accumulates shared experience, captures reusable plan prototypes, and guides self-refinement of agent plans. • We demonstrate that integrating symbolic reasoning with embodied LLM planning improves coordination efficiency and success rate in cooperative multi-agent environments. Section 2 presents the methodology of DR. WELL, including the negotiation protocol, symbolic planning mechanism, and the structure of the dynamic world model. Section 3 describes the experimental setup and the Cooperative Push Block environment used for evaluation, along with the symbolic action vocabulary. Section 4 reports the experimental results, comparing DR. WELL with baseline agents and analyzing the evolution of the world model across episodes. Finally, Section 5 concludes the paper and discusses future directions for extending the framework. 2 Methodology We now detail our neuro-symbolic framework, which is designed to make coordination more tractable through symbolic abstraction and more scalable through decentralized, LLM-embodied agents. Agents operate in a fully observable environment