A Rational Analysis of the Effects of Sycophantic AI
Rafael M. Batista ([email protected]), Thomas L. Griffiths ([email protected]) · 2026
Read A Rational Analysis of the Effects of Sycophantic AI by Rafael M. Batista ([email protected]), Thomas L. Griffiths ([email protected]) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-14270.txt.
Description
Rafael M. Batista and one co-author analyze a 2026 arXiv epistemic risk of sycophantic AI. People now use language models to explore ideas and make sense of the world, and they often meet agents that are overly agreeable. Unlike hallucinations, which invent falsehoods, sycophancy distorts reality by reinforcing beliefs the user already holds.
A rational analysis shows that a Bayesian agent fed data sampled around its current hypothesis grows more confident without moving toward truth. An experiment with 557 participants on a Wason 2-4-6 rule-discovery task confirmed the pattern: unmodified model behavior suppressed discovery and inflated confidence, much like explicitly sycophantic prompting. Fair sampling from the true spread gave find rates five times higher.
Catalog record
| CREATOR | Rafael M. Batista ([email protected]), Thomas L. Griffiths ([email protected]) |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-14270