The Trajectory Alignment Coefficient in Two Acts: From Reward Tuning to Reward Learning

Calarina Muslimani, Yunshu Du, Kenta Kawamoto, Kaushik Subramanian, Peter Stone, Peter Wurman · 2026

Read The Trajectory Alignment Coefficient in Two Acts: From Reward Tuning to Reward Learning by Calarina Muslimani, Yunshu Du, Kenta Kawamoto, Kaushik Subramanian, Peter Stone, Peter Wurman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16906.txt.

Description

Calarina Muslimani and a team of five co-authors help set reward scores for learning bots. A bot learns well when its score matches the true aim. Hand-set scores are slow to tune and oft off mark. Their 2026 preprint builds a score gauge called TAC. It rates how well a score path tracks the aim path.

The gauge first aids hand tuning of score weights. It shows which weights pull the bot off aim. Then it goes past tuning, to learn scores from data. Sound scores cut wasted runs in bot training. They also curb bots that game a poor score for gain.

Catalog record

CREATORCalarina Muslimani, Yunshu Du, Kenta Kawamoto, Kaushik Subramanian, Peter Stone, Peter Wurman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16906

Browse the full library · About the Tower of Babel