Decentralized Navigation of a Cable-Towed Load using Quadrupedal Robot Team via MARL

Wen-Tse Chen *, Minh Nguyen *, Zhongyu Li *, Guo Ning Sue, Koushil Sreenath · 2025

Read Decentralized Navigation of a Cable-Towed Load using Quadrupedal Robot Team via MARL by Wen-Tse Chen *, Minh Nguyen *, Zhongyu Li *, Guo Ning Sue, Koushil Sreenath (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18221.txt.

Introduction

Wen-Tse Chen and four co-authors teach a team of four-legged robots to tow a load on cables through messy, crowded ground, with no central guide. Their paper is from two thousand twenty-five.

Cables let the team slip through tight gaps, by going slack when they must. But the load's pull flips between taut and slack, and the joint task grows fast as robots are added. The team built a planner taught by reward, with many agents at once. It is taught as a group but runs one robot at a time. The system can steer a team of any size, and handles the flip of the cables as it goes.

Catalog record

CREATORWen-Tse Chen *, Minh Nguyen *, Zhongyu Li *, Guo Ning Sue, Koushil Sreenath
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18221

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Decentralized Navigation of a Cable-Towed Load using Quadrupedal Robot Team via MARL Wen-Tse Chen *, Minh Nguyen *, Zhongyu Li *, Guo Ning Sue, Koushil Sreenath Abstract This work addresses the challenge of enabling a team of quadrupedal robots to collaboratively tow a cable-connected load through cluttered and unstructured environments while avoiding obstacles. Leveraging cables allows the multi-robot system to navigate narrow spaces by maintaining slack when necessary. However, this introduces hybrid physical interactions due to alternating taut and slack states, with computational complexity that scales exponentially as the number of agents increases. To tackle these challenges, we developed a scalable and decentralized system capable of dynamically coordinating a variable number of quadrupedal robots while managing the hybrid physical interactions inherent in the load-towing task. At the core of this system is a novel multi-agent reinforcement learning (MARL)-based planner, designed for decentralized coordination. The MARL-based planner is trained using a centralized training with decentralized execution (CTDE) framework, enabling each robot to make decisions autonomously using only local (ego) observations. To accelerate learning and ensure effective collaboration across varying team sizes, we introduce a tailored training curriculum for MARL. Experimental results highlight the flexibility and scalability of the framework, demonstrating successful deployment with one to four robots in real-world scenarios and up to twelve robots in simulation. The decentralized planner maintains consistent inference times, regardless of the team size. Additionally, the proposed system demonstrates robustness to environment perturbations and adaptability to varying load weights. This work represents a step forward in achieving flexible and efficient multi-legged robotic collaboration in complex and real-world environments. I Introduction In many real-world robotics tasks, the capabilities of a single robot could be insufficient to achieve complex tasks. For example, tasks such as the movement and assembly of large-scale and heavy objects often require the collaborative efforts of multiple robots [ 1 ] . By working together, a robot team can accomplish tasks that go beyond the capacity of an individual robot. Legged robots, such as quadrupedal robots, being dynamically stable systems, are inherently more robust to external loads compared to mobile robots, making them particularly suitable for load-towing tasks. When navigating heavy loads in cluttered and unstructured environments, cable-towed systems offer significant advantages [ 2 ] . Cables provide flexibility in team configurations, enabling robots to maneuver through narrow spaces by dynamically switching between taut and slack states as required. This motivates us to tackle the problem of enabling a team of quadrupedal robots to collaboratively tow a cable-connected load, navigate through complex environments, and reach a destination while avoiding obstacles, as shown in Fig. 1 . Fig. 1: Overlaid snapshots of four quadrupedal robots navigating a cable-towed load through a narrow passage using the proposed decentralized reinforcement-learning-based planner in this work. Later frames are made more transparent to highlight progression. Completing this task requires real-time coordination among teammates to adjust cable tension and avoid obstacles while navigating to the goal. The same MARL-based decentralized policy is used to flexibly control different individual robots in different team sizes. This experiment demonstrates the adaptability of the proposed decentralized policy as one robot is removed partway through the task. More experiments are shown in the video . However, this problem is challenging. First, multiple legged robots are physically connected to a load, coupling their movements with the load and creating a complex dynamic system involving the entire robot-towing-load system. Additionally, the cables introduce hybrid dynamics as they can switch between taut and slack modes, further complicating the system. The complexity of multi-robot systems also grows exponentially with the number of robots. This complexity makes decentralized planning and execution critical for achieving efficient real-time operation that scales with the number of robots in the team. The navigation task also complicates the challenge, requiring collision-free planning over a long horizon while considering obstacles, teammates, and the load. Additionally, the robot team needs to adapt to varying load weights and changing team sizes, necessitating a planning strategy that is both flexible and adaptive. While some efforts have been made to address multi-robot collaboration, prior work often focuses on navigation tasks without accounting for hybrid interactions among robots [ 3 ] or restricts the scope to teams with a small, fixed number of robots [ 4 ] . Recent work has explored centralized model predictive control for similar robot-towing-load systems [ 5 ] , but such an approach suffers from exponential growth in computational complexity, making it unscalable for larger teams, e.g. , the computing time for each replanning cycle for a 12-agent team requires over 20 seconds. In this work, we propose a decentralized MARL planner based on centralized training with decentralized execution (CTDE) framework. It is designed to emphasize (1) scalability, enabling the planner to handle an increasing number of agents, and (2) flexibility, allowing it to adapt to changes in team size during deployment. The core of this approach is a unified planning policy that operates effectively for individual agents, regardless of team size, by conditioning strategy decisions on each robot’s local (ego) observations. Trained across various team sizes, the decentralized policy generalizes well, ensuring both scalability and flexibility. As illustrated in Fig. 1 , all agents utilize the same decentralized policy, achieving consistent performance and inference time irrespective of team size. This design enables dynamic reconfiguration, such as adapting seamlessly when an agent is removed mid-task, while maintaining continued progress toward the goal. The core contribution of this work lies in developing the unified planning policy that is both scalable and flexible to varying team sizes. We propose a MARL-based framework within the CTDE paradigm, which trains decentralized planners to generate commands for the locomotion controllers of individual quadrupedal robots. To address the challenge of training for varying team sizes, we introduce a novel multi-stage training strategy for MARL, whose effectiveness is thoroughly evaluated. The resulting decentralized planner demonstrates scalability by successfully controlling teams of one to four robots in real-world tasks and up to twelve robots in simulation. In real-world experiments, our planner achieves an inference time per replanning step that is over 33 times faster than the previous centralized planning method [ 5 ] (0.039 seconds versus 1.306 seconds) for the same collaborative load-towing tasks and has the consistent time for more number of agents. This underscores the advantages of the proposed decentralized planning. Furthermore, using the proposed MARL framework, we realize several novel applications for collaborative load-towing tasks, including navigating narrow gaps and demonstrating robustness to external perturbations, changes in team size, and varying loads. This work presents a framework and algorithm that marks a step toward flexible, scalable, and robust collaborative systems for multi-legged robot teams in real-world environments. II Related Works In this section, we discuss the two primary approaches to multi-robot collaboration: (1) model-based optimization and (2) multi-agent reinforcement learning (MARL). We review prior work with an emphasis on applications to real-world multi-robot tasks. Additionally, we discuss the design of MARL algorithms to provide a basis for comparison with the algorithm developed in this work. II-A Model-Based Optimization in Multi-Robot Collaboration Model-based optimization can be divided into two categories, centralized Model Predictive Control (MPC) and decentralized MPC. Centralized approaches have been widely used to solve multi-robot collaboration tasks, especially in area

Read the complete text