Reward Distance Comparisons Under Transition Sparsity

Clement Nyanhongo [email protected], Bruno Miranda Henrique [email protected], Eugene Santos Jr. [email protected] · 2025

Read Reward Distance Comparisons Under Transition Sparsity by Clement Nyanhongo [email protected], Bruno Miranda Henrique [email protected], Eugene Santos Jr. [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11508.txt.

Introduction

Clement Nyanhongo, Bruno Henrique, and Eugene Santos introduce a way to compare reward functions for AI agents without first training the agents, in a 2025 paper. Judging how two reward schemes differ usually means learning a full policy under each, which is costly and can be unsafe. Direct comparison skips that step, but it breaks down when only a few of the possible moves were ever sampled.

Their measure, called SRRD, is built to stay sound under such sparse sampling. It tolerates the mismatch between the moves on record and the moves a full record would show, which is exactly where older direct methods go wrong. The authors prove the measure's robustness in theory. Tests across several domains then show it holds up in practice where rivals fail.

Catalog record

CREATORClement Nyanhongo [email protected], Bruno Miranda Henrique [email protected], Eugene Santos Jr. [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE173 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11508

Browse the full library · About the Tower of Babel