Sequential Change Detection for Learning in Piecewise Stationary Bandit Environments

Yu-Han Huang and Venugopal V. Veeravalli · 2025

Read Sequential Change Detection for Learning in Piecewise Stationary Bandit Environments by Yu-Han Huang and Venugopal V. Veeravalli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10974.txt.

Description

Yu-Han Huang and Venugopal Veeravalli study how to detect a change fast in systems whose reward patterns shift in blocks, in a paper from 2025. The setting comes from bandit learning, where an agent must keep earning while the world changes under it. The goal is to catch a change with little delay and few false alarms.

When the before and after patterns are unknown, the authors propose two tests. Both reach the best possible order of performance as the time window grows. Their delay grows with stricter error limits in a way that suits regret analysis for bandit problems. Computer results support the theory. The work links change detection and online learning in one frame.

Catalog record

CREATORYu-Han Huang and Venugopal V. Veeravalli
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-10974

Browse the full library · About the Tower of Babel