Pure Exploration Beyond Reward Feedback: The Role of Post-Action Context

Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam, Negar Kiyavash · 2025

Read Pure Exploration Beyond Reward Feedback: The Role of Post-Action Context by Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam, Negar Kiyavash (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03061.txt.

Description

Mohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam and Negar Kiyavash study best arm identification when learners also see context after each action, in their 2025 arXiv paper. In bandit problems, the goal is to find the best option with few samples and fixed confidence. Post-action context, revealed after a choice, can carry extra information that speeds the decision.

They split context into two types: separator, where reward depends only on context, and non-separator, where both action and context matter. For each they derive lower bounds on sample needs and give algorithms that meet them asymptotically. Ignoring the context is provably suboptimal, and experiments confirm the gain.

Catalog record

CREATORMohammad Shahverdikondori, Amir Mohammad Abouei, Alireza Rezaeimoghadam, Negar Kiyavash
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE149 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-03061

Browse the full library · About the Tower of Babel