Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning

Haijiang Liu 1 2 3, Qiyuan Li 1 2, Chao Gao 1 2, Yong Cao 4 · 2025

Read Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning by Haijiang Liu 1 2 3, Qiyuan Li 1 2, Chao Gao 1 2, Yong Cao 4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17855.txt.

Introduction

Haijiang Liu and seven co-authors present MARK, a multi stage reasoning frame that helps language models mimic cultural value survey replies past plain demographic cues. Survey mimicry can aid social science if it stays true and clear. Their work came out in twenty twenty-five.

The frame draws on a personality theory's type dynamics. It reads life stress from a person's setting, forecasts group level personality, then weighs its own imitation of thought. Tests on the World Values Survey beat past baselines on exactness by a clear margin. The gap between model picks and human picks also shrank, the authors report.

Catalog record

CREATORHaijiang Liu 1 2 3, Qiyuan Li 1 2, Chao Gao 1 2, Yong Cao 4
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17855

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning Thanks: Corresponding Author: Jinguang Gu. (E-mail: [email protected]). Haijiang Liu 1 2 3, Qiyuan Li 1 2, Chao Gao 1 2, Yong Cao 4 Abstract Introducing MARK , the M ulti-st A ge R easoning framewor K for cultural value survey response simulation, designed to enhance the accuracy, steerability, and interpretability of large language models in this task. The system is inspired by the type dynamics theory in the MBTI psychological framework for personality research. It effectively predicts and utilizes human demographic information for simulation: life-situational stress analysis, group-level personality prediction, and self-weighted cognitive imitation. Experiments on the World Values Survey show that MARK outperforms existing baselines by 10% accuracy and reduces the divergence between model predictions and human preferences. This highlights the potential of our framework to improve zero-shot personalization and help social scientists interpret model predictions. 1 1 1 https://github.com/alexc-l/MARK-Multi-stAge-Reasoning-frameworK 1 Introduction Social surveys are essential for generating insights and supporting decision-making processes in research, yet traditional human-centric experiments often incur significant costs. Therefore, recent studies leverage AI technologies with human-behaviour simulating abilities to create more accurate and interpretable simulations as a valuable alternative ( Horton 2023 ; Argyle et al. 2023 ) . As illustrated on the left side of Figure 1 , solutions like demographic augmentation ( Kwok et al. 2024 ; Zhao et al. 2024a ) and opinion insertion ( Hwang et al. 2023 ) were developed to improve model simulation responses in cultural value surveys. While these studies have primarily relied on prompting that uses personal demographic information (shown as "demo info") as input to the model, models still struggle with zero-shot personalization, and prediction interpretation is still challenging. Figure 1: The MARK framework enhances cultural value survey simulation via multi-stage reasoning over MBTI personality theory with life-situational stress analysis, demographic-based group-level personality prediction, and weighted cognitive imitation. These enhancements increase simulation accuracy, decision interpretability, and response personalization . In this paper, we focus on improving cultural value survey simulation by incorporating psychological theory into the modeling of human responses. Our key insight is that human responses to survey questions are significantly influenced by their mental status (like stress) and associated cognitive processes. To capture these influences, we build a M ulti-st A ge R easoning framewor K ( MARK ) that simulates how different personality types process information and make decisions. MARK draws on the MBTI personality type dynamic theory ( Mitchell 2001 ) to model cognitive functions and their interactions with stress and personal experience, aiming to achieve accurate and psychologically grounded survey simulations than previous methods that primarily rely on demographic information. The process begins with a stress analysis to evaluate societal pressures based on demographic data, which generates sociodemographic prompts that enhance the simulation. Following this, a two-step personality prediction is carried out to infer cognitive functions from these descriptions, utilizing MBTI personality theory. During the survey simulation, a cognitive reasoning stage mimics human thought processes under both life- and situational-stress, influenced by the interplay between human traits and specific questions. Finally, the process concludes with a synthesis stage that reviews the reasoning outcomes to produce the final answer. To reduce personality assumption bias, we evaluate our framework on a clustered version of the World Values Survey (see Appendix D.1 ). Experiments show that MARK can outperform existing baselines by 10% and reduce the divergence between model predictions and human preferences. Further analysis reveals the robustness of our multi-stage reasoning framework - MARK performs stably during simulation even with uncertain personalities . The fidelity of our framework suggests that incorporating personality-driven cognitive processes is a promising direction for improving survey simulation accuracy while providing deeper insights into human decision-making patterns. Our contributions are threefold: 1. We designed a multi-stage reasoning framework with personality cognition called MARK to simulate the human decision process on value surveys. 2. Experiments on simulations show that MARK outperforms other baselines by presenting higher accuracy and generalizes consistently across the U.S. and Chinese cultures. 3. Further analysis suggests that the system performs robustly with uncertain personalities, benefiting from the multi-stage design. 2 Related Work In the field of AI for social science research, researchers have increasingly explored the use of LLMs to simulate human responses to survey questions ( Argyle et al. 2023 ; Cao et al. 2025 ; Liu et al. 2025 ) . Researchers investigate LLMs’ predictive ability of simulating cross-cultural variations ( Kwok et al. 2024 ; Cao et al. 2023 ; AlKhamissi et al. 2024 ) , value diversity ( Santurkar et al. 2023 ; Zhao et al. 2024b ) , and modeling of complex value systems ( Benkler et al. 2023 ; Arora et al. 2023 ) . Moreover, LLMs also show promise in replicating human samples across various fields, including economics ( Horton 2023 ) , psychology ( Aher et al. 2023 ) , and other domain tasks ( Luo et al. 2025 ) . However, these studies also highlight the limitations of LLMs in capturing the intricacies of human behavior, particularly in nuanced decision-making situations ( Bisbee et al. 2023 ) . To improve simulation accuracy, researchers have investigated various prompting strategies ( Mou et al. 2024 ) . A key approach has been the integration of demographic information into LLMs to enhance zero-shot simulations ( Deshpande et al. 2023 ) , known as sociodemographic prompting . However, studies have found that LLMs tend to produce stereotypes and biases under straightforward demographic prompting conditions ( Cheng et al. 2023 ) , complicating efforts to simulate human behaviors with greater precision. To address these challenges, researchers have explored more sophisticated prompting methods. Hwang et al. 2023 proposed incorporating user opinions to better reflect specific group perspectives. Zhou et al. 2023 demonstrated that including cultural background information could enhance model transferability. Cao et al. 2025 shows that fine-tuning on first token probabilities can better align simulated and real response distributions. However, recent studies by Li et al. 2024 and Shen et al. 2024 reveal that current methods still fall short in simulating preference diversity and the intricate decision-making processes characteristic of human behavior. This limitation underscores the need for more personalized and psychologically grounded approaches to survey simulation. 3 MARK: Multi-stAge Reasoning frameworK Figure 2: Overview of the proposed multi-stage reasoning framework for simulating individual cognition in survey responses. The framework comprises four stages: 1) Stress Analysis —evaluates life-societal pressures to generate stress levels and a summarized human profile; 2) Personality Prediction —predicts cognitive functions and personality traits based on the profile; 3) Cognitive Reasoning —assesses stress impact of specific questions, conducts reasoning using predicted functions, and assigns weights to finalize answers; and 4) Synthesis —reviews reasoning history, validates results, and synthesizes them into a cohesive response. Color-coded data sources: Orange boxes indicate survey data, yellow boxes represent function call outputs, and purple boxes denote text generated by LLMs. The Myers-Briggs Type Indicator ( Clawson 2008 , MBTI) is a widely used personality assessment tool that categorizes individuals into 16 distinct personality types. Each personality type is characterized by the interactions between four cognitive functions that describe the mental processes in the order of how we naturally access them and

Read the complete text