Algorithm 2
Change Detection of M-UCB: CD · 2026
Read Algorithm 2 by Change Detection of M-UCB: CD (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10177.txt.
Description
Li, Lin, Hsieh, and Huang study piecewise-stationary restless bandits, where each arm evolves as a Markov chain but rewards shift across unknown segments. Their modular framework plugs any bandit solver into change detection and fading exploration, adapting to shifts of unknown count. They measure excess regret from exploration and detection against an oracle restarting the solver at true change points. They prove regret grows roughly like the square root of mixing time times segments times arms times horizon. Simulations show near-oracle regret, beating solvers that ignore change.
Catalog record
| CREATOR | Change Detection of M-UCB: CD |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 122073 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10177