Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates.
Xiangyu MA, Mengmi ZHANG, Shannon ANG, Minne CHEN · 2026
Read Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates. by Xiangyu MA, Mengmi ZHANG, Shannon ANG, Minne CHEN (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30085.txt.
Introduction
Xiangyu Ma, Mengmi Zhang, Shannon Ang, and Minne Chen test whether language models can fake human cultural taste. Market firms already sell synthetic survey panels built from such models. The authors create silicon surrogates for respondents in a national arts survey. Models from OpenAI, Anthropic, and DeepSeek each generate huge samples. Nearly two hundred eighty thousand surrogate respondents result in total.
The silicon tastes turn out to be stylized copies of human tastes. First, surrogates show a systematic bias toward liking things. That inflates population-level estimates of cultural enthusiasm. The bias is not well explained by the usual WEIRD skew. Second, the rich relational structure of real taste vanishes in silicon samples. Third, links between taste and social position are badly distorted. Age links shrink, class links return in outdated form, and gender and race links become caricatures.
Catalog record
| CREATOR | Xiangyu MA, Mengmi ZHANG, Shannon ANG, Minne CHEN |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30085
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates. Xiangyu MA, Mengmi ZHANG, Shannon ANG, Minne CHEN Abstract . Large-language models have proven to be remarkable if inconsistent parrots of public attitudes and opinions. The extent to which LLMs are able to produce reasonable approximations of cultural taste remains an open empirical question that becomes more urgent by the day, with market research companies already offering provisional ‘synthetic’ survey panels and the contamination of standard survey data from LLM-generated responses. In this study, we build on past work on silicon sampling by extending considerations of its algorithmic fidelity and alignment to the domain of cultural consumption. We use large-language models from OpenAI, Anthropic, and DeepSeek to each produce 277,470 ( 30 × 9249 30\times 9249 ) silicon surrogates of survey respondents from the Survey of Public Participation in the Arts (SPPA). We find these silicon surrogates’ tastes to be highly stylized facsimiles of human tastes. (1) Silicon samples have a systematic postive-bias for liking , resulting in inflated ecological estimates of tastes. The individual-level bias of silicon samples are not well-explained by the WEIRD-bias often discussed in the literature. (2) The complex relationality in real taste structures is completely lost among silicon samples. (3) Finally, very little of the known cultural alignment between tastes and social space are preserved. Silicon samples attenuate age-taste associations, resurrect anachronistic class-taste associations, caricaturize gender- and race-taste associations. Key words: AI, taste, consumption, culture, silicon sampling, meta-analysis. 1. Introduction Large-language models have proven to be remarkable if inconsistent chameleons of public attitudes and opinions (e.g Argyle et al. 2023 ; Bisbee et al. 2024 ; Santurkar et al. 2023 ; Kozlowski et al. 2024 ). The extent to which LLMs are able to produce accurate surrogates of cultural taste and consumption remains an open empirical question that becomes more urgent by the day, with market research companies already offering provisional “synthetic” survey panels (e.g. Currie 2025 ; VeraSight 2026 ). In this study, we build on past work on silicon sampling by extending considerations of its algorithmic fidelity and alignment to the domain of cultural tastes. We use large-language models from OpenAI, Anthropic, and DeepSeek to produce silicon surrogates of respondents from the Survey of Public Participation in the Arts (SPPA), compare the tastes and preferences from these silicon samples against their SPPA counterparts. First, we evaluate the ecological and relationality fidelity of these silicon tastes. Then, using a mixed-effects meta-analysis framework, we evaluate the multivariate associations of silicon tastes with key dimensions of social space. We find the following. (1) Silicon samples have a systematic postive-bias for liking , resulting in inflated ecological estimates of tastes. The individual-level bias of silicon samples are not well-explained by the WEIRD-bias often discussed in the literature. (2) The complex relationality in real taste structures is completely lost among silicon samples. (3) Finally, very little of the known cultural alignment between tastes and social space are preserved. Silicon samples attenuate age-taste associations, resurrect anachronistic class-taste associations, caricaturize gender- and race-taste associations. Assessing the fidelity of such silicon tastes is crucial for two main reasons. First, silicon tastes, if faithful, allow for research designs formerly infeasible. Silicon sampling make a seductive promise to researchers. LLMs answer surveys quickly, cheaply, and without fatigue or complaint. It may now be possible to cheaply and quickly produce surveys of public opinion; to field surveys that were thought to be too long, laborious, or boring; to effectively go back in time and ask and then re-ask the questions that you couldn’t or didn’t think so. For social scientists interested in the study of tastes, silicon samples could facilitate finer-grain investigations than previously possible. Present surveys of cultural taste tend to rely on responses to fuzzy cultural categories, such as genres. As Vandebroeck ( Vandebroeck 2022 ) points out, this convention assumes (a) that consumers possess a taxonomy of cultural categories that’s more or less similar to the one posited by the survey and (b) that the cultural categories themselves are not the subject of significant contestation and ambiguity. Genres, in other words, are inherently fuzzy, and it is far from obvious that respondents share the taxonomy a survey imposes on them. Yet fielding surveys that probe finer aspects of cultural taste is difficult, since this makes a survey long, tedious, and expensive. Were silicon samples to prove faithful, they would let researchers interrogate taste at the level of specific works, performances, or sub-genres, and to vary the framing of cultural categories experimentally, at a scale and cost that fielding such instruments on human respondents could never match. Further, silicon samples would facilitate interpolated projections of cultural taste in time and space, allowing up to improve our understanding of the ecology of tastes over time. Extrapolation of public opinion surveys into social space with limited support is a dangerous proposition, but interpolation over known spaces may be plausible and rewarding in and of itself. There are no notable panel studies of cultural taste, and few repeated cross-sectional studies of cultural taste ( Ma 2020 ). Silicon sampling may allow for the construction of such data-sets and produce generative preliminary analysis of changes in taste ecologies over time. Second, silicon sampling of public opinion and behavior is quickly expanding. While the social scientific community has urged caution when it comes to use of silicon samples (e.g. Gao et al. 2025 ; Bisbee et al. 2024 ; Broska et al. 2025 ), these norms are unsettled and frequently transgressed. It’s important to have a better understanding of the quality, biases and limitations of silicon samples across a breadth of sociologically relevant domains ( Lyman et al. 2025 ). Assessing the fidelity of silicon sampling is pressing because the practice is expanding rapidly—in the range of domains to which it is applied, in the sophistication of its methods, and in its rapid expansion by survey and market research companies. Researchers have used LLMs to simulate responses to contentious political items drawn from the American National Election Studies ( Li et al. 2024 ), German public opinions ( Ma et al. 2025 ), and public opinions about climate change ( Lee et al. 2024 ), to project audience attitudes and policy preferences, and to model public-health attitudes such as vaccine acceptance. Importantly, a robust commercial interest in the provision of silicon samples has emerged. Survey and market research companies like Qualtrics and VeraSight have already begun experimental rollouts of “synthetic panels” that are built using silicon samples ( Isaza 2024 ; Currie 2025 ; VeraSight 2026 ). Ordinary survey respondents also frequently turn to LLMs and chatbots to generate ostensibly ‘human’ response surveys, meaning that even researchers who use orthodox survey methods are likely to face non-negligible contamination of ‘synthetic’ responses in their data ( Zhang et al. 2025 ; Veselovsky et al. 2025 ). The techniques themselves behind silicon sampling have also grown more elaborate. Beyond zero-shot prompting, some scholars now fine-tune models on structured survey data to better recover response distributions, attach parameter-efficient persona adapters trained on large persona banks, and query models directly for entire response distributions rather than aggregating individual answers. The ambition of these efforts is captured by the emergence of large reference