CGoT: A Novel Inference Mechanism for Embodied Multi-Agent Systems Using Composable Graphs of Thoughts

Yixiao Nie, Yang Zhang, Yingjie Jin, Zhepeng Wang, Xiu Li, Xiang Li* · 2025

Read CGoT: A Novel Inference Mechanism for Embodied Multi-Agent Systems Using Composable Graphs of Thoughts by Yixiao Nie, Yang Zhang, Yingjie Jin, Zhepeng Wang, Xiu Li, Xiang Li* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22235.txt.

Introduction

Yixiao Nie, Yang Zhang, Yingjie Jin, Zhepeng Wang, Xiu Li, and Xiang Li design a team-up between self-driving vehicles and service robots. Two autonomous cars ferry service robots around an office park. The robots carry out a series of tasks there. A large language model helps coordinate the work.

Their inference mechanism is called CGoT. An agent carries its reasoning as composable graphs of thoughts. These are structured diagrams of partial conclusions. They can be assembled, shared, and extended, rather than forming one chain of words. The study tests whether weaving language models into the loop raises efficiency. It also tests the cooperative machinery between the machines. The work is offered as an architecture for embodied multi-agent systems. Cars and robots must divide labor in the physical world there.

Catalog record

CREATORYixiao Nie, Yang Zhang, Yingjie Jin, Zhepeng Wang, Xiu Li, Xiang Li*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22235

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CGoT: A Novel Inference Mechanism for Embodied Multi-Agent Systems Using Composable Graphs of Thoughts Yixiao Nie, Yang Zhang, Yingjie Jin, Zhepeng Wang, Xiu Li, Xiang Li* Abstract The integration of self-driving cars and service robots is becoming increasingly prevalent across a wide array of fields, playing a crucial and expanding role in both industrial applications and everyday life. In parallel, the rapid advancements in Large Language Models (LLMs) have garnered substantial attention and interest within the research community. This paper introduces a novel vehicle-robot system that leverages the strengths of both autonomous vehicles and service robots. In our proposed system, two autonomous ego-vehicles transports service robots to locations within an office park, where they perform a series of tasks. The study explores the feasibility and potential benefits of incorporating LLMs into this system, with the aim of enhancing operational efficiency and maximizing the potential of the cooperative mechanisms between the vehicles and the robots. This paper proposes a novel inference mechanism which is called CGOT toward this type of system where an agent can carry another agent. Experimental results are presented to validate the performance of the proposed method. I Introduction Autonomous ego-vehicles have been increasingly applied across various domains [ 1 ] . For instance, they serve as daily vehicles for families [ 2 ] , while in public transportation, they are deployed as self-driving taxis and buses, contributing to reduced labor costs and enhanced safety [ 3 ] . In industrial settings, ego-vehicles are employed to transport goods, thereby improving production efficiency [ 4 ] . Concurrently, significant research has focused on advancing autonomous driving technologies to address the complexities of dynamic driving environments and road conditions. These efforts encompass critical areas such as visual perception [ 5 , 1 ] and motion planning [ 6 ] , which are essential for the reliable operation of self-driving systems [ 7 ] . Most current studies view autonomous vehicles as independent systems confined to transport functions. In contrast, this paper proposes a different perspective: the ego-vehicle acts as a mobile platform carrying service robots that extend its capabilities. Upon reaching a target location, the vehicle deploys the robots to perform tasks such as package delivery and retrieves them after completion. It then proceeds to the next site, repeating the cycle. This paradigm enhances the system’s versatility by enabling diverse missions, improves efficiency through parallel operations, and extends the effective working range by allowing robots to act beyond the vehicle’s immediate surroundings. Simultaneously, Large Language Models (LLMs) have garnered significant attention since their rapid development began in recent years. Following the release of GPT-3.5, numerous LLMs have been introduced and integrated into various task scenarios, demonstrating their versatility across multiple domains. Among these applications, embodied agents stand out as a particularly promising area of research. Various approaches have been explored to enhance the performance of LLM-based systems, with recent studies indicating that while LLMs may not solve all planning-related challenges, appropriate modifications to system design can substantially improve their problem-solving capabilities. In this work, we propose a delivery assistance system for a workplace park that incorporates multiple agents, each with distinct features and capabilities tailored to specific tasks in different areas of the park. For instance, while the ego-vehicle is designed for extended operational range and duration, the mobile robots are smaller and more agile, enabling them to perform complex maneuvers and access hard-to-reach locations. We have also integrated LLMs into the system to assist the agents in constructing graphs that represents the inferences of the agents during the task processing. II Related Work II-A Ego-vehicles and Service Robots Several existing works have explored systems that facilitate cooperation between robots. For example, Lee et al. proposed a system where UAVs guide ground robots with limited visibility [ 8 ] ; Xu et al. focused on the docking systems for Autonomous Underwater Vehicles (AUVs) [ 9 ] , where the docking station remains stationary. The field of traditional robotic mobile control has matured significantly, with path planning algorithms like A* [ 10 ] , Dijkstra’s [ 11 ] , and Minimum Spanning Tree [ 12 ] playing crucial roles. Finite state machines have also been used to dictate robot actions in various states. Additionally, the fusion of data from sensors such as laser rangefinders, cameras, and inertial measurement units has improved robots’ perception and localization capabilities [ 13 , 14 ] . While these conventional methods are effective in static environments, modern mobile robots in complex and dynamic settings often combine these techniques with advanced methods like machine learning and deep learning to enhance planning and control. Machine learning-based approaches in motion planning and control are categorized into three types: end-to-end learning systems that map perceptual inputs to motion commands [ 15 , 16 , 17 ] , methods that enhance specific subsystems like global or local planning [ 18 ] , and techniques that improve components of traditional navigation systems to boost performance and robustness [ 19 , 20 ] . However, for self-driving systems operating in complex environments, such as the one proposed in this paper, existing learning-based methods may not always be the optimal solution. II-B LLMs Application With the rapid advancement of Large Language Models (LLMs), an increasing number of tasks across various domains have begun to leverage these models to enhance performance and unlock untapped potential. Researchers like H. Zhang et al. and C. Zhang et al. have explored innovative approaches to integrating LLMs into multi-agent systems, combining them with diverse modules such as communication, memory, and perception to create more cohesive and effective systems [ 21 , 22 ] . Lin et al. further investigated the potential of merging LLM-based planning with traditional methods, demonstrating how this hybrid approach can lead to more efficient and effective problem-solving strategies in complex planning scenarios [ 23 ] . In addition to planning, controlling tasks with the assistance of LLMs has emerged as a cutting-edge area of research. For instance, [ 24 ] focused on learning language-conditioned multi-robot manipulation, while [ 25 ] conducted studies on cooperative systems capable of performing zero-shot tasks through the implementation of LLMs. Moreover, Liu et al. [ 26 ] explored the integration of scene-level visual perception with task plan generation, enabling the system to interpret ambiguous instructions and generate detailed task plans using LLMs. Huang et al. [ 27 ] considered the application of LLMs as zero-shot human models, significantly enhancing human-robot interactions by providing robots with a better understanding of human behaviors and intentions. Additionally, there has been considerable research focused on breaking down complex tasks into smaller, more manageable sub-tasks at the initial stages of the planning process. Notable works have contributed to this approach [ 28 , 29 , 30 ] , while Yao et al. studied ways to boost system efficiency by integrating both internal and external knowledge, allowing the system to iteratively generate and refine planning outcomes [ 31 ] . These efforts collectively highlight the growing influence of LLMs in various aspects of multi-agent systems, planning, and control, offering new possibilities for future advancements. Another emerging area of interest is the integration of Large Language Models (LLMs) with graph-based tasks. As noted by Kambhampati [ 32

Read the complete text