Free-form Association Tasks Reveal Stereotype Hallucination in Large Language Models
Xinrui Chloe Zhao, Douglas Guilbeault, Amir Goldberg · 2026
Read Free-form Association Tasks Reveal Stereotype Hallucination in Large Language Models by Xinrui Chloe Zhao, Douglas Guilbeault, Amir Goldberg (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30945.txt.
Description
Xinrui Chloe Zhao, Douglas Guilbeault and Amir Goldberg compare how humans and language models stereotype when the material itself has no settled meaning. Earlier studies test models on multiple-choice surveys or on group biases that are already conventional. Here participants from five social domains interpreted free-form stimuli, abstract art and Rorschach inkblots, twice: first for themselves, then predicting how members of social groups would respond. Two multimodal models, GPT-4o mini and Llama-3.2-11B-Vision-Instruct, went through the same design.
Human first-order answers were heterogeneous, with little group structure. When predicting others, humans moderately amplified their own tendencies while keeping diversity. The models answered homogeneously at first order, then produced stark second-order stereotypes that neither amplified real tendencies nor matched actual group differences. The authors call this stereotype hallucination. It persisted even after fine-tuning on real participants' responses.
Catalog record
| CREATOR | Xinrui Chloe Zhao, Douglas Guilbeault, Amir Goldberg |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30945