Learning Equilibria in Matching Games with Bandit Feedback
Andreas Athanasopoulos, Christos Dimitrakakis · 2025
Read Learning Equilibria in Matching Games with Bandit Feedback by Andreas Athanasopoulos, Christos Dimitrakakis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03802.txt.
Introduction
Athanasopoulos and Dimitrakakis teach match markets to learn fair ends from thin feed in this twenty twenty-five paper. Two sides pick mates, then play a foe game with the mate they drew. Pay grades for those games start dim to all hands in the match.
Inside, a match fair point is set where no hand gains by a lone shift. A sway grade counts how far a guess sits from that fair point for the run. Their tool bids by bright-side grades of each pay cell it has yet to test. Proof caps the sway growth in a slow, fair curve class for the tool. Mock runs back the proof with like sway paths in play.
Catalog record
| CREATOR | Andreas Athanasopoulos, Christos Dimitrakakis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03802
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Equilibria in Matching Games with Bandit Feedback Andreas Athanasopoulos, Christos Dimitrakakis Abstract We investigate the problem of learning an equilibrium in a generalized two-sided matching market, where agents can adaptively choose their actions based on their assigned matches. Specifically, we consider a setting in which matched agents engage in a zero-sum game with initially unknown payoff matrices, and we explore whether a centralized procedure can learn an equilibrium from bandit feedback. We adopt the solution concept of matching equilibrium [ 24 ] , where a pair consisting of a matching 𝔪 \mathfrak{m} and a set of agent strategies X X forms an equilibrium if no agent has the incentive to deviate from ( 𝔪 , X ) (\mathfrak{m},X) . To measure the deviation of a given pair ( 𝔪 , X ) (\mathfrak{m},X) from the equilibrium pair ( 𝔪 ⋆ , X ⋆ ) (\mathfrak{m}^{\star},X^{\star}) , we introduce matching instability that can serve as a regret measure for the corresponding learning problem. We then propose a UCB algorithm in which agents form preferences and select actions based on optimistic estimates of the game payoffs, and prove that it achieves sublinear, instance-independent regret over a time horizon T T . 1 Introduction Two-sided matching markets model situations in which two distinct sets of agents aim to match with each other based on individual preferences [ 40 ] . Classic examples include students applying to universities, workers seeking employment with firms, or large online platforms that match users with services (e.g., Uber, Amazon Mechanical Turk, Airbnb) [ 39 , 17 , 18 ] . A fundamental solution concept in this setting is stable matching [ 17 ] , a notion of equilibrium where no pair of agents has an incentive to deviate from the proposed assignment. Stability has motivated extensive research in economics, while more recently, computer science has focused on learning such equilibria to analyze competition in online decision-making problems [ 12 , 30 , 25 ] . Prior work on learning to match has only considered scenarios where, after being matched, agents directly receive a random payoff with an unknown expected value. A more realistic setting is for matched agents to interact , and only receive payoffs as a result of their interaction. This reflects real world scenarios where the outcome of a matching depends on the actions taken by the individuals. In particular, we consider two-sided markets where, after being matched, the agents select an action, as introduced in [ 24 ] in a non-learning setting . In our case, once agents are matched, they engage in a two-player game, where the pair of payoff matrices (A,B) is unknown . As a solution concept, Jackson and Watts 2010 proposed matching equilibrium (Definition 3 ), where the equilibrium depends jointly on the matching \mathfrak{m} and the set of strategies X selected by the agents. Informally, agents matched under \mathfrak{m} must play a Nash equilibrium within each pair, and the matching \mathfrak{m} must be stable. Intuitively, a pair of agents dissatisfied with their current outcome, they may have an incentive to deviate and form a new match in which they adopt a different Nash equilibrium. We illustrate an example with known underlying zero-sum games (ZSGs), below. Example 1 . Consider the following simplified example with one agent \{p\} on the left side and two agents \{a_{1},a_{2}\} on the right side, where agents always prefer to match with each other from being single. The agent can adaptively choose their action, with utilities represented by the following payoff matrices of the respective zero-sum games: \begin{array}[]{c@{\hskip 1in}c}A_{p,a_{1}}=\begin{bmatrix}1&-1\\ -1&1\end{bmatrix}\hfil\hskip 72.26999pt&A_{p,a_{2}}=\begin{bmatrix}1&1\\ 1&0\end{bmatrix}\end{array} Agents can naturally form their preferences based on the values of the Nash equilibrium in the respective ZSGs. Specifically, for the pair (p,a_{1}) , the game value is V^{\star}_{p,a_{1}}=0 , with the Nash equiblirium (x_{p,a_{1}}^{\star},x_{a_{1}}^{\star}) given by x_{p,a_{1}}^{\star}=[0.5,\ 0.5] and x_{a_{1}}^{\star}=[0.5,\ 0.5] , while for the second pair (p,a_{2}) , the value is V^{\star}_{p,a_{2}}=1 , with Nash strategies x_{p,a_{2}}^{\star}=[1,\ 0] and x_{a_{2}}^{\star}=[0,\ 1] . Thus, agent p prefers a_{2} over a_{1} under Nash strategies (x_{p,a_{2}}^{\star},x_{p,a_{1}}^{\star}) , and the solution consisting of the matching M=\{(p,a_{2})\} and the strategies X=\{x_{p,a_{2}}^{\star},x_{a_{2}}^{\star}\} corresponds to desired matching equilibrium in the market. On the other hand, any deviation---either in the matching or in the strategies--- can lead to an unstable outcome for the specific example 1 1 1 Note that in general there is a set of possible stable matchings . In the case of known payoff matrices, a stable outcome can be trivially computed by running the algorithm proposed by Gale and Shapley 1962 on preferences formed according to the value of each game [ 23 ] . In ZSG, the agents can efficiently compute the values of the game and select their strategies independently of their opponents. Contributions. In practice, however, agents may be unaware of the underlying payoffs of the games (thus their preferences), and instead must learn through repeated interactions, observing the outcomes of their actions under specific assignments. This presents a complex learning scenario, as agents must simultaneously learn to form their preferences and choose actions. We ask the following question: Is it possible to learn a matching equilibrium through repeated iterations of agents? To address this question, we consider the learning setting where a central platform matches agents, and each agent receives a reward through bandit feedback based on their selected actions. In our model, agents select their strategies based on their match, and after each interaction, they observe the action chosen by their pair. This information allows them to update their estimates of the utilities and refine their preferences. To characterize algorithms in our learning scenario, we propose an objective that measures the distance of the solution from equilibrium at each step. Specifically, we define matching instability (Definition 4 ), which can be interpreted as the minimum subsidy required to make the solution "stable", retaining participants in the market. Our notion extends the Subset Instability (Definition 2 ) introduced in [ 25 , 26 ] for the two-sided matching problem. We also establish several properties of our metric that justify cumulative matching instability as a suitable measure of regret. On the algorithmic side, we show that if agents follow the general principle of optimism in the face of uncertainty the equilibrium can be efficiently learned. Specifically, we propose a UCB-like algorithm, where each agent maintains upper confidence bounds for the payoff matrices of the relevant games. Based on these estimates, agents report their preferences to a central platform, which then computes a (potentially) stable matching. Given the assignment, each agent also selects a strategy for their match, samples an action, and receives stochastic feedback. We prove that our algorithm achieves a regret of \tilde{O}\left(\sqrt{T\mathbf{m}\mathbf{k}\mathbf{p}\mathbf{a}}\right) , where \mathbf{m} and \mathbf{k} are the number of actions available to each agent on the two sides, and \mathbf{p} and \mathbf{a} denote the number of agents on each side, respectively. This bound unifies and generalizes existing results in the literature, all of which are based on UCB-style algorithms. Specifically, when each agent has only one available action (i.e., \mathbf{m}=\mathbf{k}=1 ), the setting reduces to a classical two-sided matching problem, and our regret matches the bound \tilde{O}(\sqrt{T\mathbf{p}\mathbf{a}}) from Theorem 6.6 in [ 26 ] . On the other