Objective Decoupling in Social Reinforcement Learning: Recovering Ground Truth from Sycophantic Majorities
Majid Ghasemi, Mark Crowley · 2026
Read Objective Decoupling in Social Reinforcement Learning: Recovering Ground Truth from Sycophantic Majorities by Majid Ghasemi, Mark Crowley (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08092.txt.
Description
AI alignment usually trusts human feedback as noisy but fundamentally honest, an guess that breaks when evaluators are sycophantic, lazy, or adversarial. Majid Ghasemi and Mark Crowley prove that under that guess, standard reinforcement learning suffers objective decoupling: the learned objective separates permanently from ground truth, guaranteeing misalignment.
Their remedy, epistemic source alignment, judges the source of feedback using sparse safety axioms instead of trusting majority consensus. They prove it converges to the true objective even when most evaluators are biased. Tests support the theory. Alignment teams gain both a diagnosis of a shape failure in social feedback settings and a sound mechanism for judging the judges.
Catalog record
| CREATOR | Majid Ghasemi, Mark Crowley |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08092