Exploring Re-inforcement Learning via Human Feedback under User Heterogeneity

Sarvesh Shashidhar, Abhishek Mishra, Madhav Kotecha · 2026

Read Exploring Re-inforcement Learning via Human Feedback under User Heterogeneity by Sarvesh Shashidhar, Abhishek Mishra, Madhav Kotecha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20760.txt.

Description

Sarvesh Shashidhar, Abhishek Mishra, and Madhav Kotecha question a basic assumption in how AI models learn from human feedback. Their 2026 paper is about RLHF, the method that trains models with human ratings. RLHF has been effective for AI alignment, the task of making models act as people wish. But it treats all raters as if they respond in the same way.

Real users differ, and the authors put that heterogeneity at the center. If raters want different things, one reward signal may fit no one well. The paper explores what changes when feedback comes from a mixed crowd. It asks how training should handle clashing tastes and values. The work speaks to builders who want models that serve varied users, not an average one.

Catalog record

CREATORSarvesh Shashidhar, Abhishek Mishra, Madhav Kotecha
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20760

Browse the full library · About the Tower of Babel