Propensity Formation-Containment Control of Fully Heterogeneous Multi-Agent Systems via Online Data-Driven Learning

Ao Cao, Fuyong Wang, Zhongxin Liu · 2025

Read Propensity Formation-Containment Control of Fully Heterogeneous Multi-Agent Systems via Online Data-Driven Learning by Ao Cao, Fuyong Wang, Zhongxin Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11699.txt.

Introduction

Ao Cao, Fuyong Wang, and Zhongxin Liu gave an online learning scheme in 2025 for formation and containment control in groups of unlike agents. In such problems, leader agents set a formation and followers must settle inside it. Older methods lean on fixed graph quantities and can waste what leaders broadcast.

Their problem sets follower places by propensity factors released by leaders, a new twist. They name one special leader that carries influence across the formation and build adaptive observers so each agent can estimate the tracking leader's state. A model-based protocol then ties control gains to the regulation equations, with asymptotic convergence shown in the analysis. Readers get a data-driven control design for mixed fleets of robots or vehicles that must form up and hold a moving shape.

Catalog record

CREATORAo Cao, Fuyong Wang, Zhongxin Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11699

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Propensity Formation-Containment Control of Fully Heterogeneous Multi-Agent Systems via Online Data-Driven Learning Ao Cao, Fuyong Wang, Zhongxin Liu Abstract This paper introduces an online data-driven learning scheme designed to address a novel problem in propensity formation and containment control for fully heterogeneous multi-agent systems. Unlike traditional approaches that rely on the eigenvalues of the Laplacian matrix, this problem considers the determination of follower positions based on propensity factors released by leaders. To address the challenge of incomplete utilization of leader information in existing multi-leader control methods, the concept of an influential transit formation leader (ITFL) is introduced. An adaptive observer is developed for the agents, including the ITFL, to estimate the state of the tracking leader or the leader’s formation. Building on these observations, a model-based control protocol is proposed, elucidating the relationship between the regulation equations and control gains, ensuring the asymptotic convergence of the agent’s state. To eliminate the necessity for model information throughout the control process, a new online data-driven learning algorithm is devised for the control protocol. Finally, numerical simulation results are given to verify the effectiveness of the proposed method. I Introduction The rapid progress in communication, perception, and computer technologies has catalyzed the evolution of human-engineered and composite systems towards largescale and intelligence. These extensive systems typically comprise a multitude of interconnected intelligent subsystems working collaboratively to achieve predefined objectives [ 1 , 2 , 3 , 4 ] . Presently, the formation-containment control (FCC) problem within multi-agent systems (MAS) has gained significant prominence in the realm of distributed control systems. FCC is concerned with assisting leaders in forming desired configurations while guiding followers to enter the convex hull delineated by the leaders. Given its specific control objectives, FCC finds a wide array of applications in practical systems, including unmanned airship systems [ 5 ] , unmanned air-ground vehicle systems [ 6 ] , rigid spacecraft systems [ 7 ] , and unmanned aerial vehicle systems [ 8 ] . Significant theoretical progress has been achieved in addressing the FCC problem for homogeneous systems, where both the agent dynamics and the formation dynamics of leaders are identical, as evidenced by several studies [ 9 , 10 , 11 ] . In recent years, attention has also turned to the semi-heterogeneous FCC problem, which deals with systems featuring heterogeneous agent dynamics and homogeneous formation dynamics. These research outcomes span various categories, ranging from undirected [ 12 ] to directed topologies [ 13 ] , from distributed [ 14 ] to fully distributed solutions [ 15 ] , and from fixed [ 16 ] to switched topologies [ 6 ] . Many of these investigations rely on output regulation equations [ 17 , 18 , 19 ] and assume that leaders have identical formation dynamics. However, practical applications often exhibit diverse requirements, and certain scenarios demand heterogeneous formation dynamics to effectively tackle complex tasks. For instance, collaborative search and rescue missions involving unmanned air-ground vehicles after a disaster [ 20 ] . Despite its significance, there remains a noticeable research gap when it comes to fully heterogeneous FCC problems that involve distinct formation dynamics and agent dynamics. Typically, achieving FCC in heterogeneous systems necessitates the development of distributed observers for followers, enabling them to estimate convex combinations of multiple leaders [ 21 , 22 , 23 , 24 ] . This becomes especially challenging when the leader systems exhibit heterogeneity. Recent work in [ 25 ] and [ 26 ] introduced adaptive distributed observers for the containment control (CC) problem [ 27 ] in directed and undirected graphs, respectively. These approaches relaxed the constraint that leader dynamics must be identical. However, they come with an implicit requirement regarding the communication graph: all formation leaders must communicate directly with at least one follower. These methods become inapplicable when a formation leader needs to transmit information through an influential transit formation leader (ITFL), where the followers do not utilize the information from this leader. Additionally, it’s worth noting that in nearly all existing results, the convergence position of the followers is influenced by the eigenvalues of the Laplacian matrix. This dependency is neither reasonable nor practical in real-world operational environments. It is important to highlight that the results discussed regarding FCC and CC in heterogeneous systems rely on precise model knowledge to solve the output regulation equations. However, when acquiring accurate models through explicit modeling becomes a challenge, the design of controllers using data-driven methods that exclusively rely on measurement data becomes necessary. Considerable advancements have been made in the development of data-driven algorithms across various domains, including optimal control [ 28 , 29 , 30 ] , safety control [ 31 , 32 ] , predictive control [ 33 , 34 , 35 ] and robust control [ 36 , 37 ] , with many of these techniques drawing inspiration from reinforcement learning (RL) and behavioral theory. Despite the rapid progress of data-driven control methods in recent years, the cooperative control problem within fully heterogeneous multi-agent systems, relying solely on measurement data, remains an active area of research that has yet to be fully addressed. The primary objective of this article is to develop formation-containment controllers tailored for fully heterogeneous MAS by exclusively leveraging measurement data. The aim is to tackle two critical challenges: the underutilization of leader information in specific topological scenarios and the reliance of follower convergence positions on topology. To address these challenges, this paper introduces the concept of Propensity Formation-Containment Control (PFCC) for fully heterogeneous MAS. The approach assumes that formation leaders generate propensity factors to steer the motion of the followers, which encompasses the development of a data-based adaptive observer tailored for pertinent agents, notably the Influential Transit Formation Leader (ITFL), with the purpose of gathering crucial information. Building upon this observer, the paper develops a model-based PFCC controller and a corresponding online data-driven learning algorithm. The main contributions of this paper can be summarized as follows: 1) A novel Propensity Formation-Containment Control (PFCC) problem is introduced for fully heterogeneous Multi-Agent Systems (MAS) within directed graphs. In contrast to prior Formation-Containment Control (FCC) findings [ 6 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 ] , this problem allows for nonidentical formation dynamics among leaders, and the convergence positions of followers in this context are determined by the propensity factors released by the leaders rather than relying on the eigenvalues of the Laplacian matrix. 2) We have designed a distributed adaptive observer reliant on measurement data for each agent. Notably, this observer offers distinct advantages over the findings in [ 21 , 22 , 23 , 25 , 26 , 12 , 13 , 14 , 15 , 16 , 6 , 24 ] as it doesn’t necessitate any dynamic knowledge and effectively addresses the issue of underutilizing leader information in specific communication topologies. 3) We have developed a novel online data-driven learning scheme for addressing the PFCC problem within fully heterogeneous dynamics. This scheme guarantees both asymptotic convergence and stability. Moreover, it is versatile, applicable not only to under-actuated and fully-actuated systems but also to over-actuated systems. The rest of the paper is organized as follows. In Section II , we provide an

Read the complete text