Robust Decision-Making in Finite-Population Games

Shinkyu Park, Lucas C. D. Bezerra · 2025

Read Robust Decision-Making in Finite-Population Games by Shinkyu Park, Lucas C. D. Bezerra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06200.txt.

Introduction

Shinkyu Park and Lucas Bezerra wrote a 2025 paper on how robust a crowd game plan stays when the world it was tuned for turns out rougher than expected. In such finite-population games, each of many agents chooses actions by a set rule. One known rule weighs each action by a score and a dose of randomness. Noise and modeling errors are the norm in real use.

The pair asks how the parameters of the rule shape its shield against that roughness. Their proofs show which parameter turns soften the effects of noise, and which make them worse. Worked examples and simulation runs support the proofs. The point is a tuning guide: how to set the parameters so a crowd of agents holds its course when the facts on the ground are off.

Catalog record

CREATORShinkyu Park, Lucas C. D. Bezerra
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06200

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Decision-Making in Finite-Population Games Shinkyu Park, Lucas C. D. Bezerra Abstract We study the robustness of an agent decision-making model in finite-population games, with a particular focus on the Kullback-Leibler Divergence Regularized Learning (KLD-RL) model. Specifically, we examine how the model’s parameters influence the impact of various sources of noise and modeling inaccuracies—factors commonly encountered in engineering applications of population games—on agents’ decision-making. Our analysis provides insights into how these parameters can be effectively tuned to mitigate such effects. Theoretical results are supported by numerical examples and simulation studies that validate the analysis and illustrate practical strategies for parameter selection. I Introduction The population game and evolutionary dynamics framework provides a powerful foundation for modeling and analyzing repeated strategic interactions among a population of decision-making agents [ 1 ] . In this work, we consider a class of population games in which agents’ payoffs—driving their strategy selection—are determined by a dynamic payoff mechanism. Specifically, payoff vectors evolve according to a dynamical system model that depends on both the internal state of the game and the population’s state, which reflects agents’ strategy selections. Our primary focus is on a particular subclass of these games, known as task allocation games [ 2 , 3 ] , where agents interact strategically to accomplish a given set of tasks. The conventional framework relies on several key assumptions: 1) payoff observations are noise-free, 2) switching strategies incurs no delay, and 3) the population size is infinite. However, these assumptions are often unrealistic in engineering applications of population games. We specifically examine decision-making processes in finite-population games, where agents select strategies based on noisy payoff estimates influenced by their own past actions, and where strategy updates are subject to time delays. A central challenge posed by noise and modeling errors is the increased variability in agents’ decision-making, which can hinder convergence to the optimal strategy selection. Our study focuses on identifying a decision-making model from the population game literature that is robust to noise and modeling errors, and on understanding how its parameters can be optimized to reduce the impact of such uncertainties while preserving equilibrium learning. To address this, we investigate the potential of the Kullback-Leibler Divergence Regularized Learning (KLD-RL) model [ 4 ] as a solution. Through theoretical analysis, we examine how careful tuning of the model’s parameters can mitigate the effects of noise and enhance stability of agent decision-making behavior. We validate these findings with simulation studies, demonstrating how parameters can be optimized. This work builds upon and extends recent studies in multi-agent games [ 5 , 6 , 7 , 8 , 9 , 10 ] , which analyze the impact of noise in payoff observations [ 6 , 7 , 8 , 9 ] and time delays [ 5 , 10 ] . Unlike our earlier works [ 5 , 6 ] , which focus primarily on the Smith model, here we examine the robustness of the KLD-RL model. As discussed in Section II , this model exhibits a strong notion of passivity , allowing agents to maintain robustness in the presence of perturbations. Our results therefore suggest that KLD-RL is particularly well-suited for realistic environments, where noise, modeling errors, and finite agent populations play a critical role. Meanwhile, the conventional population game literature often investigates the perturbed best response model, in which payoffs are subject to random noise [ 11 , 12 ] . In contrast to our study, these works assume that the noise affecting the payoff vector is independent of both the payoffs themselves and the population state, which reflects the agents’ strategy choices. Our framework, by comparison, explicitly accounts for noise and modeling inaccuracies that depend on these variables. The paper is organized as follows: Section II introduces preliminaries on evolutionary dynamics and the class of population games considered in this work, followed by the problem formulation. Section III presents an illustrative example with supporting simulations. In Section IV , we present analytical results that explain the robustness of the KLD-RL model and demonstrate how its parameters can be tuned to mitigate the effects of noise and delays in agents’ decision-making. Finally, Section V concludes the paper with a summary and outlines directions for future research. Notation: Given a positive integer n , let \mathbb{R}^{n} denote the spaces of n -dimensional real vectors, \mathbb{R}_{\geq 0}^{n} the space of n -dimensional vectors with nonnegative entries, and \mathbb{R}_{\geq 0} the set of nonnegative real numbers. For notational convenience, given positive integers n and N , we define the finite set \mathbb{X}^{N}=\{(X_{1}^{N},\cdots,X_{n}^{N})\in\{0,1/N,\cdots,1\}^{n}\,|\,\sum_{i=1}^{n}X_{i}^{N}=1\} . Its infinite counterpart, obtained as N\to\infty , is the continuous simplex \mathbb{X}=\{(x_{1},\cdots,x_{n})\in[0,1]^{n}\,|\,\sum_{i=1}^{n}x_{i}=1\} . Note that \mathbb{X}^{N} is a subset of \mathbb{X} for every positive integer N . Throughout the paper, we use the Euclidean norm \|\cdot\|_{2} and the maximum norm \|\cdot\|_{\infty} . Additionally, given a vector a and a vector-valued function \mathcal{A} , the notation a_{i} and \mathcal{A}_{i} refers to the i -th component of a and \mathcal{A} , respectively. II Preliminaries and Problem Description Fig. 1: A feedback diagram consisting of the task allocation game model ( 7 ) and the KLD-RL model ( 3 ). Each agent engaged in the game receives opportunities to revise its strategy at the arrival times \mathbb{T}_{\lambda} of its associated Poisson process with rate parameter \lambda . The parameter \eta in the KLD-RL model regulates the trade-off in decision-making between the payoff vector p(t) and the reference distribution \theta . II-A Evolutionary Dynamics and Task Allocation Games Consider a finite population of N agents engaged in a multi-agent game [ 1 ] . Let the population state at time t\geq 0 be represented by the vector X^{N}(t)=(X^{N}_{1}(t),\cdots,X^{N}_{n}(t))\in\mathbb{X}^{N} , where each component X_{i}^{N}(t) denotes the fraction of agents selecting the i -th strategy among n available options. The agents’ strategy choices determine the payoff vector p(t)=(p_{1}(t),\cdots,p_{n}(t))\in\mathbb{R}^{n} , according to an underlying game model, where each p_{i}(t) represents the payoff received by agents selecting strategy i . Due to the finite population size, each time an agent switches its strategy, the population state X^{N}(t) undergoes a discrete jump to a new state in the finite set \mathbb{X}^{N} . As illustrated in Fig. 1 , the payoff vector and population state are jointly determined by a closed-loop system composed of the game dynamics and the decision-making model. In population games, each agent has the opportunity to revise its strategy at the arrival times of an independent and identically distributed (i.i.d.) Poisson process with rate parameter \lambda . When such a revision opportunity occurs, the agent uses a strategy revision protocol \rho_{ji}:\mathbb{R}^{n}\times\mathbb{X}\to\mathbb{R}_{\geq 0} to determine the probability of switching from its current strategy j to a new strategy i , based on the current payoff vector p(t) and population state X^{N}(t) . A well-known example of such a protocol is the Smith protocol , defined as follows: for all i,j\in\{1,\cdots,n\} , \displaystyle\rho_{ji}^{\text{\tiny Smith}}(p,X^{N})=\begin{cases}\varrho[p_{i}-p_{j}]_{+}&\text{if }i\neq j\\ 1-\sum_{\begin{subarray}{c}i=1\\ i\neq j\end{subarray}}^{n}\varrho[p_{i}-p_{j}]_{+}&\text{otherwise},\\ \end{cases} (1) where \varrho is a positive constant that ensures ( 1 ) defines a valid probability distribution. Another revision protocol, which we focus on in this work, is the Kullback-Leibler Divergence Regularized Learning (KLD-RL) protocol [ 4 ] , defined as follows: for all i,j\in\{1,\cdots,n\} , \displaystyle\rho_{ji}^{\text{\tiny KLD-RL}}(p,X^{N})=C_{i}^{\eta,\theta}(p)=\frac{\theta_{i}\exp(\eta^{-1}p_{i})}{\sum_{l=1}^{n}\theta_{l}\exp(\eta^{-1}p_{l})}, (2) where \eta>0 and \theta=(\theta_{1},\cdots,\theta_{n})\in\mathbb{X} is

Read the complete text