Adaptive Estimation and Optimal Control in Offline Contextual MDPs without Stationarity

Riddhiman Bhattacharyya [email protected], Sayak Chakrabarty [email protected], Imon Banerjee [email protected] · 2026

Read Adaptive Estimation and Optimal Control in Offline Contextual MDPs without Stationarity by Riddhiman Bhattacharyya [email protected], Sayak Chakrabarty [email protected], Imon Banerjee [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03393.txt.

Description

Riddhiman Bhattacharyya, Sayak Chakrabarty, and Imon Banerjee give the first adaptive estimator with strong guarantees for offline contextual Markov decision processes. No stationarity is assumed. Contextual processes guide decisions from biostatistics to machine learning. Yet offline use lacked robust, theory-backed methods.

Context from inside the system breaks standard tools. It brings drift and model irregularity. Using T-estimation, they build a selector and prove oracle risk bounds under two losses. They then use the density estimate for optimal control. Finite-sample guarantees for the cost follow, under broad conditions, not narrow special cases.

Catalog record

CREATORRiddhiman Bhattacharyya [email protected], Sayak Chakrabarty [email protected], Imon Banerjee [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03393

Browse the full library · About the Tower of Babel