The Trajectory Alignment Coefficient in Two Acts: From Reward Tuning to Reward Learning
Calarina Muslimani, Yunshu Du, Kenta Kawamoto, Kaushik Subramanian, Peter Stone, Peter Wurman · 2026
Read The Trajectory Alignment Coefficient in Two Acts: From Reward Tuning to Reward Learning by Calarina Muslimani, Yunshu Du, Kenta Kawamoto, Kaushik Subramanian, Peter Stone, Peter Wurman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16906.txt.
Description
Calarina Muslimani and a team of five co-authors help set reward scores for learning bots. A bot learns well when its score matches the true aim. Hand-set scores are slow to tune and oft off mark. Their 2026 preprint builds a score gauge called TAC. It rates how well a score path tracks the aim path.
The gauge first aids hand tuning of score weights. It shows which weights pull the bot off aim. Then it goes past tuning, to learn scores from data. Sound scores cut wasted runs in bot training. They also curb bots that game a poor score for gain.
Catalog record
| CREATOR | Calarina Muslimani, Yunshu Du, Kenta Kawamoto, Kaushik Subramanian, Peter Stone, Peter Wurman |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-16906