An Information-Theoretic Analysis of Thompson Sampling for Logistic Bandits
Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias J. Oechtering, Mikael Skoglund · 2024
Read An Information-Theoretic Analysis of Thompson Sampling for Logistic Bandits by Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias J. Oechtering, Mikael Skoglund (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-02861.txt.
Description
Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias Oechtering, and Mikael Skoglund analyze an exploration algorithm, in a 2024 preprint, for decision problems with yes-or-no rewards. The setting is the logistic bandit: each action pays a binary reward with a chance set by a logistic curve. Thompson Sampling picks actions by sampling from what it believes about the world. Judging how well it learns is the aim, using an information-based yardstick from earlier work.
That yardstick, the information ratio, weighs each step's loss against what the step teaches. They bound it by a quantity that depends on dimension and on how well the action and parameter spaces align. The bound no longer grows with the logistic slope. From it they derive total regret over time. The regret grows slowly with the slope and not at all with the number of actions, a first for this setting.
Catalog record
| CREATOR | Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias J. Oechtering, Mikael Skoglund |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-02861