Calibrated Preference Learning: The Case of Label Ranking

Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke Hüllermeier · 2026

Read Calibrated Preference Learning: The Case of Label Ranking by Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke Hüllermeier (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30447.txt.

Description

Santo M. A. R. Thies and four co-authors formalize calibration for probabilistic label ranking. Treating rankings as plain classes misses their structure. They build a layered set of notions spanning full rankings, sub-rankings, and top-k rankings. They prove full-rank calibration gives the others, though not the reverse. Empirically, popular label ranking models often calibrate poorly. Applying their framework to RLHF reward models, they find calibration tracks benchmark accuracy strongly but imperfectly.

Catalog record

CREATORSanto M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke Hüllermeier
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94638
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30447

Browse the full library · About the Tower of Babel