Explanation Quality Assessment as Ranking with Listwise Rewards
Thomas Bailleux, Tanmoy Mukherjee, Emmanuel Lonca, Pierre Marquis, Zied Bouraoui · 2026
Read Explanation Quality Assessment as Ranking with Listwise Rewards by Thomas Bailleux, Tanmoy Mukherjee, Emmanuel Lonca, Pierre Marquis, Zied Bouraoui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24176.txt.
Description
Bailleux and four colleagues recast explanation assessment as ranking, not generation. Instead of emitting one best explanation, they train reward models to order candidates by graded quality. Listwise and pairwise ranking losses keep ordinal structure and avoid score compression from pointwise regression or binary preference goals. Ranking losses beat regression on score separation everywhere, with listwise methods best on clean tiers and pairwise methods tougher on noisy annotations. Small encoders on curated data even match far larger models, and ranking rewards stabilize policy optimization where regression rewards fail.
Catalog record
| CREATOR | Thomas Bailleux, Tanmoy Mukherjee, Emmanuel Lonca, Pierre Marquis, Zied Bouraoui |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43704 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24176