Distorted Perspectives of LLM-Simulated Preferences: Can AI Mislead Design?

Eduard Kuric, Peter Demcak, Matus Krajcovic · 2026

Read Distorted Perspectives of LLM-Simulated Preferences: Can AI Mislead Design? by Eduard Kuric, Peter Demcak, Matus Krajcovic (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18311.txt.

Introduction

Eduard Kuric's 2026 study asks whether design preferences simulated by large language models match those of real users. The team aggregates twenty-nine real preference tests from UXtweak, covering 2,073 users, and runs simulations varying reasoning, sampling, persona, and specificity. Results show large steady gaps between real preferences and simulated ones, holding across every manipulation. Synthetic justifications lack genuine depth and nuance, leaning instead on generic properties, single elements, elaboration, and overpraising. Because the gaps replicate across many real studies, the findings carry weight for design teams.

Catalog record

CREATOREduard Kuric, Peter Demcak, Matus Krajcovic
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42605
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18311

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distorted Perspectives of LLM-Simulated Preferences: Can AI Mislead Design? Eduard Kuric, Peter Demcak, Matus Krajcovic Abstract Abstract Purpose. Designers of digital solutions increasingly consult Large Language Models (LLMs) for their work. However, it remains unclear how this may affect the user experiences they produce and there are no established practices. We investigate how design preferences expressed by LLM-driven simulation methods align with those of real users. Design/methodology/approach. We present a study that aggregates real-world data and design stimuli from twenty-nine preference tests conducted in practice by users of the UXtweak online research platform (n = 2073). We perform holistic multimodal simulations where we manipulate LLM variables (model reasoning, sampling, persona type, and specificity) and assess their effects on algorithmic fidelity. Findings. Our results unveil significant and systematic discrepancies between peoples’ real design preferences and LLM simulations that are consistent across manipulations. Synthetic justifications lack genuine depth, nuance and reasoning, which they substitute by patterns like focus on generic properties, specific elements, elaboration and overpraising. Originality/value. The unique attention directed by this research toward preferences within visual design stimuli highlights misrepresentation of perception and meaning by LLMs in a context that is intuitive yet critical for design teams. The external and ecological validity of our findings is high, given their replication across a multitude of real-world studies. Keywords: Large language models, Generative AI, Preference testing, User experience, Design advice, Online research platforms 1 Introduction The rapid proliferation of generative artificial intelligence (GenAI) models — LLMs most prominently — has had deep social impact. In spite of broad industrial pressures to adopt GenAI that can result in what 31 termed as “workslop”, a survey by 49 suggests a lack of clear guidelines for user experience (UX) practitioners responsible for designing digital solutions. Online research platforms such as UXtweak 1 1 1 UXtweak user experience research platform: https://www.uxtweak.com/ , as well as researchers and practitioners have started exploring their potential for UX and interface design ( 49 ) . Experimental applications include creation of personas ( 43 ) , inference of user needs and goals ( 54 ) , heuristic evaluation ( 6 ) , prototyping tool plugins for designing mockups ( 37 ) and ideation ( 18 ) . Use of GenAI can make creative outputs appear more desirable ( 55 ) . The consensus of belief among UX practitioners is that AI can improve efficiency, although it is tempered by caution over the express need to verify GenAI outputs, as well as concerns about overdependence and reduction of critical thinking ( 49 ) . The most common application of GenAI by designers is in text-oriented scenarios, where LLMs are used for brainstorming and as a source of second-opinion-style feedback ( 49 ) . LLMs playing the advisory role for UX designers is where we identify the issue central to our research. While designers of digital solutions may separate themselves from their own proposals when making decisions, they evaluate concepts with a confirmation bias ( 32 ) . If relied on, LLMs could magnify biases and legitimize flawed conclusions by providing external validation for ideas that might be at odds with preferences derived through genuine research, critical thinking, and empathy ( 19 ) . Preferences can be defined as dispositions based on beliefs (e.g., expectations, values, needs, aesthetic sentiments), operating on the threshold between cognition and behavior ( 12 ) . They are granular and uniquely personal due to the diversity of life experiences ( 52 ) . In UX design, user preferences can affect the quality and success of digital products and services by shaping the willingness of people to use them, the manner of using them, their subjective experience, and the resulting satisfaction. Design preferences may be reflected in use efficiency ( 2 ) . Therefore, practices involving sloppy design advice ( 31 ) that misrepresent human preferences could pose serious harm to organizations. It might compromise the usefulness and value of their digital solutions while inflating their development costs, especially when used in early stages. Our study addresses the research gap concerning the lack of understanding of how LLMs mirror human design preferences. Simulation literature refers to this type of accuracy using the term algorithmic fidelity ( 17 ) . Although LLMs are fine-tuned through reinforcement learning from human feedback (RLHF) to make the output itself in line with user preference (e.g., more structured or factual) ( 47 ; 36 ) , this does not inherently translate into an ability to reproduce contextually aware preferences on their subject. Models may present distortions such as agree bias ( 5 ) , prosocial preference ( 17 ) , and minimal variability ( 35 ) . Previous studies demonstrated inconsistencies with broader social or consumer surveys ( 7 ; 3 ) . The focus of our study lies in multimodal evaluation of design preferences where LLMs are provided with concrete sets of visual stimuli as context with high degree of detail. When granted equal information to human samples and steered to simulate them based on descriptive information, how well do LLMs extract comparable implications about preferences for design teams? To contribute insights with generalizable implications for theory, real-world UX practice, and organizational policies, we first acquired a diverse set of twenty-nine (29) preference testing studies — each by a different organization, amounting to 2073 participants in total. Then, we used this dataset as a source of ground truth for LLM simulations involving six (6) different variants to comprehensively assess the capacity of different methods to improve simulated preferences. Alarmingly, our findings demonstrate a systematic failure of LLMs to simulate human design preferences that applies universally across different studies. Furthermore, advanced models with chain-of-thought reasoning, persona modeling, temperature and nucleus sampling have minimal impact on the underlying issues. Our analysis advances the understanding of deviations between human and LLM-simulated design choices, as well as patterns that differentiate generated justifications from human experiential narratives. 2 Background and literature review 2.1 Evaluation of design preferences To echo self-determination theory, the consumption of design by users is not passive ( 48 ) . Human preferences — toward software, travel, food or any other choice domain — are driven by intrinsic and extrinsic motives in pursuit of both utilitarian and hedonic value ( 48 ) . Relevant factors can include attitudes and beliefs ( 41 ) , perceived usability and aesthetics ( 26 ) . Preference can be evaluated through choice behavior ( 39 ) . In user experience research, design preferences are typically gauged through preference testing. This is an established and popular technique where participants are asked to select their preferred design among two or multiple options ( 50 ) . Ensuing follow-up questions ascertain their justification (why?) alongside other information. This method is a simple and quick source of both qualitative and quantitative feedback. The prevalence of research platforms like UXtweak has made online preference testing easy and widely accessible. 2.2 Representation of preferences in LLMs With advancements in AI models, researchers have probed LLMs’ ability to reflect human preferences based on the information from the internet (such as reviews) encoded in their semantic embeddings ( 40 ; 7 ; 42 ) . Unlike problematic earlier models, modern LLMs undergo reinforcement learning from human

Read the complete text