Evaluating Alignment of Behavioral Dispositions in LLMs
Amir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein, Marian Croak, Yossi Matias, Amir Feder · 2026
Read Evaluating Alignment of Behavioral Dispositions in LLMs by Amir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein, Marian Croak, Yossi Matias, Amir Feder (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11328.txt.
Description
People now ask language models for social advice, so their social tendencies matter. Amir Taubenfeld and ten co-authors offer STAR, a frame for comparing model dispositions with human ones. It adapts established psychology questionnaires into realistic advice-seeking scenarios, since self-reports may not match actual advice.
The data set holds tens of thousands of scenarios, each validated by raters and annotated with human preferences. Across twenty-five models, frontier systems miss high-consensus human views in a notable minority of cases, and smaller models miss more often. When humans disagree, model advice is far less diverse than human choice. Self-reported values also predict recommendations poorly. Data and code are released for future work.
Catalog record
| CREATOR | Amir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein, Marian Croak, Yossi Matias, Amir Feder |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11328