Off-Policy Evaluation for Recommendations with Missing-Not-At-Random Rewards
2025
Read Off-Policy Evaluation for Recommendations with Missing-Not-At-Random Rewards (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08993.txt.
Description
Tatsuki Takahashi, Chiro Maru, and Hiroko Shoji fix a bias in judging new recommendation rules from logged data, in a paper from 2025. Logged rewards often go missing in a way tied to the reward itself, on top of known place and policy biases.
Old judges can skew badly when both biases sit in one log. Their new judge uses two sets of odds, one for the logging rule and one for reward sighting, as weights. In tests the new judge stayed closest to truth as the reward bias grew. It beat a set of past judges across bias levels.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-08993