Evaluating Alignment of Behavioral Dispositions in LLMs

Amir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein, Marian Croak, Yossi Matias, Amir Feder · 2026

Read Evaluating Alignment of Behavioral Dispositions in LLMs by Amir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein, Marian Croak, Yossi Matias, Amir Feder (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11328.txt.

Description

People now ask language models for social advice, so their social tendencies matter. Amir Taubenfeld and ten co-authors offer STAR, a frame for comparing model dispositions with human ones. It adapts established psychology questionnaires into realistic advice-seeking scenarios, since self-reports may not match actual advice.

The data set holds tens of thousands of scenarios, each validated by raters and annotated with human preferences. Across twenty-five models, frontier systems miss high-consensus human views in a notable minority of cases, and smaller models miss more often. When humans disagree, model advice is far less diverse than human choice. Self-reported values also predict recommendations poorly. Data and code are released for future work.

Catalog record

CREATORAmir Taubenfeld, Zorik Gekhman, Lior Nezry, Omri Feldman, Natalie Harris, Shashir Reddy, Romina Stella, Ariel Goldstein, Marian Croak, Yossi Matias, Amir Feder
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11328

Browse the full library · About the Tower of Babel