Exploring Re-inforcement Learning via Human Feedback under User Heterogeneity
Sarvesh Shashidhar, Abhishek Mishra, Madhav Kotecha · 2026
Read Exploring Re-inforcement Learning via Human Feedback under User Heterogeneity by Sarvesh Shashidhar, Abhishek Mishra, Madhav Kotecha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20760.txt.
Description
Sarvesh Shashidhar, Abhishek Mishra, and Madhav Kotecha question a basic assumption in how AI models learn from human feedback. Their 2026 paper is about RLHF, the method that trains models with human ratings. RLHF has been effective for AI alignment, the task of making models act as people wish. But it treats all raters as if they respond in the same way.
Real users differ, and the authors put that heterogeneity at the center. If raters want different things, one reward signal may fit no one well. The paper explores what changes when feedback comes from a mixed crowd. It asks how training should handle clashing tastes and values. The work speaks to builders who want models that serve varied users, not an average one.
Catalog record
| CREATOR | Sarvesh Shashidhar, Abhishek Mishra, Madhav Kotecha |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20760