Hierarchical Decision-Making in Population Games

Yu-Wen Chen, Nuno C. Martins, Murat Arcak · 2025

Read Hierarchical Decision-Making in Population Games by Yu-Wen Chen, Nuno C. Martins, Murat Arcak (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05808.txt.

Introduction

What happens when people hand their choices in a large group game to agents acting for them? Yu-Wen Chen and two co-authors build that layered setup in a 2025 paper on population games. Classical models assume each person decides directly, yet real settings add managers, platforms, and other proxies between individuals and outcomes.

The authors set out the hierarchy, prove what its equilibria look like, and show when play settles toward them. A second payoff follows: their results give a systematic way to study group games under general convex limits, rules stated as curved constraint sets, without each player knowing the full limits. A navigation example with road capacity limits shows the framework at work in a concrete setting.

Catalog record

CREATORYu-Wen Chen, Nuno C. Martins, Murat Arcak
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-05808

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hierarchical Decision-Making in Population Games Yu-Wen Chen, Nuno C. Martins, Murat Arcak Abstract This paper introduces a hierarchical framework for population games, where individuals delegate decision-making to proxies that act within their own strategic interests. This framework extends classical population games, where individuals are assumed to make decisions directly, to capture various real-world scenarios involving multiple decision layers. We establish equilibrium properties and provide convergence results for the proposed hierarchical structure. Additionally, based on these results, we develop a systematic approach to analyze population games with general convex constraints, without requiring individuals to have full knowledge of the constraints as in existing methods. We present a navigation application with capacity constraints as a case study. ©2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, including reprinting/republishing this material for advertising or promotional purposes, collecting new collected works for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. I Introduction Population games study the aggregate behavior of strategic agents in large populations who adapt their actions via learning to maximize payoffs. A fundamental research question is determining conditions under which learning rules and payoff mechanisms ensure convergence to Nash equilibria. Early studies focused on memoryless payoff mechanisms, such as potential games [ 1 ] . Later, building on [ 2 ] , the paper [ 3 ] introduced the concept of \delta -passivity to characterize stability properties and to allow for dynamic payoff mechanisms. A broader \delta -dissipativity approach was presented in [ 4 ] . Other passivity approaches were applied to imitation dynamics in [ 5 ] . Further advancing this line of work, [ 6 ] brought the notion of counterclockwise passivity (CCW) [ 7 ] to population games. While the studies discussed above assume that individuals directly select their strategies, in many applications, decision-making is mediated by proxies with more information or computational power. For example, investors delegate portfolio management to financial managers, and travelers follow navigation applications in selecting routes. This leads to hierarchical, rather than direct, decision-making as illustrated in Figures 1(a) and 1(b) . Moreover, proxies may have strategy preferences that constrain the social state to a subset of the simplex in which it evolves. Limited work has addressed population games with such constraints. In [ 8 ] , the authors considered box constraints which do not account for coupling restrictions between strategies. Moreover, the work requires a demanding information structure where the individuals have access to all system-wide constraints. In [ 9 ] , a payoff penalty was used to ensure convergence to the feasible set, but the constraints were not satisfied at all times. Recently, [ 10 ] studied constrained best-response dynamics for convex constraints; however, as in [ 8 ] , these constraints are assumed to be common knowledge. The main contributions of this paper are twofold. First, we introduce a hierarchical framework for population games, which captures practical scenarios involving multiple decision layers. With properly designed proxies and payoff structure, we provide convergence results akin to those in classical population games. Second, we address population games with general convex constraints within this framework. Unlike existing methods [ 8 , 9 , 10 ] requiring constraints known to individuals, we incorporate constraints through the hierarchical structure. Section II gives an overview of population games. Section III introduces the hierarchical framework and formulates the main problem. Section IV presents the theoretical results. Section V illustrates the results on a navigation example. II Preliminaries For a classical (single) population game, each individual in the population can choose from a set of strategies \mathcal{S}=\{1,\ldots,d\} . Let \Delta^{d}=\left\{\bm{v}\in\mathbb{R}^{d}_{+}:\bm{1}^{T}\bm{v}=1\right\} be the probability simplex in \mathbb{R}^{d} . Denote the state \bm{s}(t)=[s_{1}(t),\ldots,s_{d}(t)]^{T}\in\Delta^{d} , where s_{i}(t) describes the proportion of the population selecting strategy i at time t . A payoff function F:\Delta^{d}\rightarrow\mathbb{R}^{d} maps a state \bm{s}(t) to a payoff vector F(\bm{s}(t)) with F_{i}(\bm{s}(t)) representing the payoff for choosing strategy i . Definition 1 (Best response to \bm{\pi} within \mathcal{C} ) . The best response to a payoff vector \bm{\pi}\in\mathbb{R}^{d} within a compact set \mathcal{C}\subseteq\Delta^{d} is denoted as \textit{BR}_{\mathcal{C}}(\bm{\pi})=\mathop{\arg\max}_{\bm{s}\in\mathcal{C}}\ \bm{s}^{T}\bm{\pi} . Definition 2 (Nash equilibrium of F within \mathcal{C} ) . Let \mathcal{C}\subseteq\Delta^{d} be compact. \bm{s}^{*}\in\mathcal{C} is a Nash equilibrium for the payoff function F within \mathcal{C} if (\bm{s}-\bm{s}^{*})^{T}F(\bm{s}^{*})\leq 0 , for \bm{s}\in\mathcal{C} . The set of all Nash equilibria for F within \mathcal{C} is denoted as \text{NE}_{\mathcal{C}}(F) . Given payoff vectors \bm{\pi}(t)\in\mathbb{R}^{d} for all t , the individuals switch between strategies to receive higher payoffs, which leads to a dynamics in \bm{s}(t) . An evolutionary dynamics model (EDM) is used to describe this learning dynamics: \displaystyle\dot{\bm{s}}(t)=\mathcal{V}(\bm{s}(t),\bm{\pi}(t)),\quad t\geq 0, (1) where \mathcal{V}:\Delta^{d}\times\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} is defined based on the switching behaviors. Some common EDMs include Smith [ 11 ] , Brown-von Neumann-Nash (BNN) [ 12 ] , and best response dynamics [ 13 , Chapter 6] . While the best response dynamics is defined over the simplex \Delta^{d} , a generalization to it is defined over a compact convex subset of \Delta^{d} as follows. Definition 3 (Constrained best response dynamics [ 10 ] ) . \displaystyle\dot{\bm{s}}(t)\in\textit{BR}_{\mathcal{C}}\left(\bm{\pi}(t)\right)-\bm{s}(t),\quad\mathcal{C}\subseteq\Delta^{d}\text{ compact convex}. (2) Definition 4 (Positive Correlation) . An EDM ( 1 ) is positively correlated if \mathcal{V}(\bm{s},\bm{\pi})\neq\bm{0}\implies\bm{\pi}^{T}\mathcal{V}(\bm{s},\bm{\pi})>0 . Definition 5 (Nash Stationarity w.r.t. \mathcal{C} ) . An EDM ( 1 ) is Nash stationary w.r.t. \mathcal{C} if \mathcal{V}(\bm{s},\bm{\pi})=\bm{0}\iff\bm{s}\in\textit{BR}_{\mathcal{C}}(\bm{\pi}) . While BNN, Smith, and best response dynamics are Nash stationary w.r.t. \Delta^{d} , ( 2 ) is Nash stationary w.r.t. \mathcal{C} . 1 1 1 Since the best response dynamics and ( 2 ) are differential inclusions, a modified version of the Nash stationarity is used, as in [ 13 , Theorem 6.1.4] . III Problem Formulation We first present the core formulation and introduce the key notation using a two-layer example in Section III-A . We extend this to the general hierarchical framework in Section III-B , and formulate several problems in this framework in Section III-C . III-A Illustrative example Consider a group of investors who allocate capital across three investment targets through two managers. This leads to two layers as in Figure 1(b) : the first contains the investors; the second comprises two managers. We assume each investor has one unit of capital and must allocate it to either manager. Manager 1 distributes the funds across three investment targets, while Manager 2 invests only in the first and second. Each decision group has a state variable representing its strategy distribution over its strategy set. Specifically, for each decision group j in layer i , denoted as the (i,j) -group, we define a state variable \bm{s}^{i,j}(t)\in\Delta^{d^{i,j}} , where d^{i,j} is the number of available strategies to the (i,j) -group. The k -th entry of \bm{s}^{i,j}(t) , denoted as s^{i,j}_{k}(t) , represents the proportion of the (i,j) -group selecting the k -th strategy at time t . We define the social state \bm{x}(t)\in\Delta^{3} as the final distribution over the three final strategies (investment targets) at time t : \displaystyle\bm{x}(t) \displaystyle=\begin{bmatrix}x_{1}(t)\\ x_{2}(t)\\ x_{3}(t)\end{bmatrix}=\begin{bmatrix}s^{1,1}_{1}(t)s^{2,1}_{1}(t)+s^{1,1}_{2}(t)s^{2,2}_{1}(t)\\ s^{1,1}_{1}(t)s^{2,1}_{2}(t)+s^{1,1}_{2}(t)s^{2,2}_{2}(t)\\ s^{1,1}_{1}(t)s^{2,1}_{3}(t)\end{bmatrix} (3a) \displaystyle=\underbrace{\begin{bmatrix}1&0&0&1&0\\ 0&1&0&0&1\\ 0&0&1&0&0\end{bmatrix}}_{:=\bm{W}^{2}\in\mathbb{R}^{3\times 5}}\underbrace{\vphantom{\begin{bmatrix}0\\ 0\\ 0\end{bmatrix}}\begin{bmatrix}\bm{s}^{2,1}(t)&\bm{0}_{3\times 1}\\ \bm{0}_{2\times 1}&\bm{s}^{2,2}(t)\end{bmatrix}}_{:=\bm{T}^{2}(t)\in\mathbb{R}^{5\times 2}}\bm{s}^{1,1}(t). (3b) Equation ( 3a ) follows from the paths in Figure 1(b) , while ( 3b ) provides a compact

Read the complete text