Adaptation of Parameters in Heterogeneous Multi-agent Systems
Hyungbo Shim, Jin Gyu Lee, and Brian D. O. Anderson · 2025
Read Adaptation of Parameters in Heterogeneous Multi-agent Systems by Hyungbo Shim, Jin Gyu Lee, and Brian D. O. Anderson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00801.txt.
Introduction
Hyungbo Shim, with two co-authors, proposes parameter adaptation for multi-agent systems. The agents differ in their internal dynamics. Such systems are called heterogeneous. Unlike identical agents, they cannot reach perfect synchronization. Strong coupling can still induce approximate consensus among them. That shared behavior is governed by blended dynamics.
The team adds an adaptation law to align the agents' parameters. The law needs no direct exchange of parameters. It reuses the same coupling signal used for state synchronization. The process is thus plausible as a biological or social model. Under a persistent excitation condition, they prove convergence. The agents' dynamics converge to each other over time. The system becomes homogeneous in the limit, with exact consensus of states.
Catalog record
| CREATOR | Hyungbo Shim, Jin Gyu Lee, and Brian D. O. Anderson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-00801
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptation of Parameters in Heterogeneous Multi-agent Systems Hyungbo Shim, Jin Gyu Lee, and Brian D. O. Anderson Abstract This paper proposes an adaptation mechanism for heterogeneous multi-agent systems to align the agents’ internal parameters, based on enforced consensus through strong couplings. Unlike homogeneous systems, where exact consensus is attainable, the heterogeneity in node dynamics precludes perfect synchronization. Nonetheless, previous work has demonstrated that strong coupling can induce approximate consensus, whereby the agents exhibit emergent collective behavior governed by the so-called blended dynamics. Building on this observation, we introduce an adaptation law that gradually aligns the internal parameters of agents without requiring direct parameter communication. The proposed method reuses the same coupling signal employed for state synchronization, which may result in a biologically or sociologically plausible adaptation process. Under a persistent excitation condition, we prove that the linearly parametrized vector fields of the agents converge to each other, thereby making the dynamics asymptotically homogeneous, and leading to exact consensus of the state variables. \IEEEoverridecommandlockouts \overrideIEEEmargins keywords Synchronization, Adaptation, Heterogeneous multi-agent system 1 Introduction Examples of collective phenomena include bird flocking, fish schooling, and the synchronization of beating cells. Such phenomena can be explained by the concept of state consensus in groups of dynamical systems. Early studies on multi-agent systems primarily focused on the case where all agents have identical dynamics. However, attention soon shifted toward heterogeneous multi-agent systems, for which exact consensus is fundamentally unattainable unless every agent shares the same internal model. In particular, differences in node vector fields prevent identical integration, even when all agents start from the same initial condition [ 1 , 2 ] . Consider for instance a network of N agents described by \dot{x}_{i}=f_{i}(x_{i},t)+k\sum_{j\in{\mathcal{N}}_{i}}(x_{j}-x_{i}),\qquad i=1,\cdots,N, (1) where x_{i}\in{\mathbb{R}}^{n} denotes the state of agent i , {\mathcal{N}}_{i} represents the set of neighboring agents of agent i , and k is a constant coupling gain. The function f_{i} is a locally Lipschitz (and possibly time-varying) vector field that may vary from one agent to another (hence the subscript i ). Were consensus to be achieved, the coupling term k\sum_{j\in{\mathcal{N}}_{i}}(x_{j}-x_{i}) would vanish, but any discrepancy of the f_{i} would remain, thereby preventing exact consensus. Despite this inherent limitation implying that exact consensus is unachievable, it was shown in [ 3 , 4 ] that strong coupling—often achieved by choosing a large k —can enforce approximate consensus. More precisely, if the communication graph is undirected and connected, and if the so-called blended dynamics \dot{s}=\frac{1}{N}\sum_{i=1}^{N}f_{i}(s,t) (2) is contractive (in the sense similar to Assumption 3 below), then for any \epsilon>0 there exists a threshold k^{*}>0 such that for every k\geq k^{*} the trajectories x_{i}(t) satisfy 1 1 1 This result is global if the f_{i} ’s are globally Lipschitz; otherwise, it is semi-global. \limsup_{t\to\infty}\|x_{i}(t)-s(t)\|\;\leq\;\epsilon,\quad i=1,\cdots,N, (3) where s(t) is the solution of ( 2 ) with s(0)=\frac{1}{N}\sum_{i=1}^{N}x_{i}(0) [ 3 , 6 ] . Figure 1 illustrates this behavior using three heterogeneous Van der Pol oscillators by showing one of their state variables. In the absence of coupling ( k=0 ), each oscillator exhibits distinct behavior (top subplot). With coupling ( k>0 ), approximate synchronization is observed (middle subplot). Notice that the synchronized behavior does not replicate any individual oscillator’s dynamics from the top subplot; rather, it represents an emergent behavior governed by the blended dynamics ( 2 ) [ 7 ] . This observation supports the idea that seeking to enforce consensus in heterogeneous dynamical systems produces emergent behavior , and indeed, even if exact consensus is not reached but only approximate consensus is achieved, such emergent behavior arises. Moreover, this general conclusion can be exploited in various engineering applications, such as distributed optimization [ 8 ] and distributed state estimation [ 9 ] . Interested readers may refer to [ 10 ] . In these applications, heterogeneity is intentionally introduced as a design tool. On the other hand, not all heterogeneity is intentional. Perturbations, manufacturing imperfections, and wear-and-tear during operation can also result in heterogeneous parameters that are typically undesirable and thus viewed as factors to overcome. Of course, strong coupling alone can in principle reduce the steady-state consensus error ( 3 ) arbitrarily by increasing k . Nonetheless, if additionally the individual internal parameters can be gradually adjusted so that they converge to identical values, then exact consensus can be achieved, without necessarily resorting to very large coupling gains. This approach is illustrated in the bottom subplot of Fig. 1 . Figure 1: Trajectories of the first state variable from three heterogeneous Van der Pol oscillators. (Top) Without coupling, they evolve differently. (Middle) With strong coupling, they nearly synchronize but not exactly. (Bottom) With strong coupling and the proposed adaptation algorithm, the parameters of the node dynamics achieve consensus, yielding a common vector field, and thus, exact synchronization over time. An animated simulation is available at https://youtu.be/CVQxZgb5Pro and the codes are at https://github.com/hyungbo/vfconsensus . Motivated by this idea, we propose a form of parameter update law that aligns the internal parameters of heterogeneous agents. More specifically, we consider the case where the vector field f_{i} is linearly parameterized as \dot{x}_{i}=\psi(x_{i},t)\,\theta_{i}+\psi_{o}(x_{i},t)+k\sum_{j\in{\mathcal{N}}_{i}}(x_{j}-x_{i}) (4) where \theta_{i}\in{\mathbb{R}}^{p} is the parameter vector of agent i , \psi:{\mathbb{R}}^{n}\times{\mathbb{R}}\to{\mathbb{R}}^{n\times p} is a given regressor, and \psi_{o}:{\mathbb{R}}^{n}\times{\mathbb{R}}\to{\mathbb{R}}^{n} represents the common part of f_{i} . The proposed parameter update law is \dot{\theta}_{i}=g\,\psi^{T}(x_{i},t)\cdot k\sum_{j\in{\mathcal{N}}_{i}}(x_{j}-x_{i}), (5) where g is a small positive constant indicating slow evolution of \theta_{i} . If direct communication of the parameters \theta_{i} among agents were allowed, one might simply employ an average-consensus update: \dot{\theta}_{i}=\sum_{j\in{\mathcal{N}}_{i}}(\theta_{j}-\theta_{i}). However, in order to maintain consistency with the biology/sociology motif, our approach crucially avoids explicit parameter sharing. For example, if children in a kindergarten gradually develop similar behaviors over time, it is more plausible that they do so by spending time together (thereby synchronizing their external behavior) rather than by explicitly sharing their “internal parameters.” In ( 5 ), the same coupling signal as in ( 4 ) is recycled for parameter adaptation, eliminating the need for an additional communication channel. In this sense, the agent model ( 4 ) and ( 5 ) may explain the adaptation behavior of a complex swarm. The main objective is to identify appropriate conditions for all \theta_{i} to tend to the same value as t\to\infty so that the agents’ vector fields effectively achieve consensus. Under such circumstances, the states x_{i} no longer just approximately synchronize—they converge to exact consensus. To the best of the authors’ knowledge, adaptation of vector fields in multi-agent systems has rarely been explored, and therefore, we set the goal of this conference paper to convey the core idea in a clear and accessible manner. For this, we adopt the following simplifying assumptions: (i) the function \psi_{o} is identically zero, (ii) the system state dimension is n=1 , and (iii) the function \psi is continuously differentiable. These simplifications allow us to focus on the fundamental mechanisms underlying the proposed adaptation strategy, and their relaxation will be reported in a journal version. In this paper, we use the usual Euclidean vector norm and its induced matrix norm, both of which are denoted by \|\cdot\| . To aid readability, frequently used variables and constants are highlighted in color when they are introduced for the first time. 2 Main Result Let us consider a