Adaptive Estimation and Optimal Control in Offline Contextual MDPs without Stationarity
Riddhiman Bhattacharyya [email protected], Sayak Chakrabarty [email protected], Imon Banerjee [email protected] · 2026
Read Adaptive Estimation and Optimal Control in Offline Contextual MDPs without Stationarity by Riddhiman Bhattacharyya [email protected], Sayak Chakrabarty [email protected], Imon Banerjee [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03393.txt.
Description
Riddhiman Bhattacharyya, Sayak Chakrabarty, and Imon Banerjee give the first adaptive estimator with strong guarantees for offline contextual Markov decision processes. No stationarity is assumed. Contextual processes guide decisions from biostatistics to machine learning. Yet offline use lacked robust, theory-backed methods.
Context from inside the system breaks standard tools. It brings drift and model irregularity. Using T-estimation, they build a selector and prove oracle risk bounds under two losses. They then use the density estimate for optimal control. Finite-sample guarantees for the cost follow, under broad conditions, not narrow special cases.
Catalog record
| CREATOR | Riddhiman Bhattacharyya [email protected], Sayak Chakrabarty [email protected], Imon Banerjee [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03393