Distributionally Robust Token Optimization in RLHF

Yeping Jin, Jiaming Hu, Ioannis Ch. Paschalidis · 2026

Read Distributionally Robust Token Optimization in RLHF by Yeping Jin, Jiaming Hu, Ioannis Ch. Paschalidis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08577.txt.

Description

Jin, Hu, and Paschalidis harden reinforcement learning from human feedback against small prompt shifts that can wreck multi step reasoning. Their DRTO method pairs token level feedback learning with distributionally robust optimization, building ambiguity sets over span losses to stress difficult response segments. Tests show steadier behavior under distribution shift, gaining 4.4 percentage points on MATH-500 with smaller gains on LiveCodeBench over standard token optimization.

Catalog record

CREATORYeping Jin, Jiaming Hu, Ioannis Ch. Paschalidis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47693
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08577

Browse the full library · About the Tower of Babel