Pure Exploration Beyond Reward Feedback: The Role of Post-Action Context
Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam, Negar Kiyavash · 2025
Read Pure Exploration Beyond Reward Feedback: The Role of Post-Action Context by Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam, Negar Kiyavash (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03061.txt.
Description
Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam and Negar Kiyavash study best arm identification when learners also see context after each action, in their 2025 arXiv paper. In bandit problems, the goal is to find the best option with few samples and fixed confidence. Post-action context, revealed after a choice, can carry extra information that speeds the decision.
They split context into two types: separator, where reward depends only on context, and non-separator, where both action and context matter. For each they derive lower bounds on sample needs and give algorithms that meet them asymptotically. Ignoring the context is provably suboptimal, and experiments confirm the gain.
Catalog record
| CREATOR | Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam, Negar Kiyavash |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 149 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03061