Calibrated Preference Learning: The Case of Label Ranking
Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke Hüllermeier · 2026
Read Calibrated Preference Learning: The Case of Label Ranking by Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke Hüllermeier (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30447.txt.
Description
Santo M. A. R. Thies and four co-authors formalize calibration for probabilistic label ranking. Treating rankings as plain classes misses their structure. They build a layered set of notions spanning full rankings, sub-rankings, and top-k rankings. They prove full-rank calibration gives the others, though not the reverse. Empirically, popular label ranking models often calibrate poorly. Applying their framework to RLHF reward models, they find calibration tracks benchmark accuracy strongly but imperfectly.
Catalog record
| CREATOR | Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann, Sebastian J. Vollmer, Eyke Hüllermeier |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94638 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30447