Finite-Time Analysis of Q-Value Iteration for General-Sum Stackelberg Games

Narim Jeong, Donghwan Lee · 2026

Read Finite-Time Analysis of Q-Value Iteration for General-Sum Stackelberg Games by Narim Jeong, Donghwan Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04394.txt.

Description

Jeong and Lee study Stackelberg Q-value iteration in two-player general-sum Markov games. Single-agent learning has succeeded in theory and practice, but general-sum games resist extension. The authors introduce a relaxed policy condition fitted to the Stackelberg setting and model learning as a switching system. Building upper and lower comparison systems, they prove finite-time error bounds for Q-functions and characterize convergence. To their knowledge, these are the first finite-time guarantees for Stackelberg Q-value iteration in general-sum Markov games.

Catalog record

CREATORNarim Jeong, Donghwan Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33163
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.04394

Browse the full library · About the Tower of Babel