Disentangling the Drivers of LLM Social Conformity: An Uncertainty-Moderated Dual-Process Mechanism

Huixin Zhong, Yanan Liu, Shijin Wang, Zijing Ye, Zimu Wang, Shiyao Zhang · 2025

Read Disentangling the Drivers of LLM Social Conformity: An Uncertainty-Moderated Dual-Process Mechanism by Huixin Zhong, Yanan Liu, Shijin Wang, Zijing Ye, Zimu Wang, Shiyao Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14918.txt.

Introduction

Huixin Zhong and co-authors report a 2025 study on why large language models tend to agree with the crowd. In people, going along with a group can come from using group cues to be right, or from a wish to fit in. The team tested whether the same split shows up in AI models.

They ran nine leading models through choice tasks in health, law, and money settings, while changing how clear the facts were. The models leaned on group cues as a guide to the right answer, and their choices grew more sure as proof grew stronger. Doubt shifted how strongly each driver acted.

Catalog record

CREATORHuixin Zhong, Yanan Liu, Shijin Wang, Zijing Ye, Zimu Wang, Shiyao Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-14918

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Disentangling the Drivers of LLM Social Conformity: An Uncertainty-Moderated Dual-Process Mechanism Huixin Zhong, Yanan Liu, Shijin Wang, Zijing Ye, Zimu Wang, Shiyao Zhang Abstract As large language models (LLMs) integrate into collaborative teams, their social conformity—the tendency to align with majority opinions—has emerged as a key concern. In humans, conformity arises from informational influence (rational use of group cues for accuracy) or normative influence (social pressure for approval), with uncertainty moderating this balance by shifting from purely analytical to heuristic processing. It remains unclear whether these human psychological mechanisms apply to LLMs. This study adapts the information cascade paradigm from behavioral economics to quantitatively disentangle the two drivers to investigate the moderate effect. We evaluated nine leading LLMs across three decision-making scenarios (medical, legal, investment), manipulating information uncertainty ( q = 0.667 q=0.667 , 0.55 0.55 , and 0.70 0.70 , respectively). Our results indicate that informational influence underpins the models’ behavior across all contexts, with accuracy and confidence consistently rising with stronger evidence. However, this foundational mechanism is dramatically modulated by uncertainty. In low-to-medium uncertainty scenarios, this informational process is expressed as a conservative strategy, where LLMs systematically underweight all evidence sources. In contrast, high uncertainty triggers a critical shift: while still processing information, the models additionally exhibit a normative-like amplification, causing them to overweight public signals ( β > 1.55 \beta>1.55 vs. private β = 0.81 \beta=0.81 ). 1 Introduction Large Language Models (LLMs) are rapidly evolving from standalone tools into collaborative agents in human-AI systems, raising critical questions about their emergent social behaviors. A key concern is social conformity, the tendency to align with a majority opinion. This phenomenon represents a double-edged sword: it can lead to the “wisdom of crowds” through rational information sharing (informational influence), but it can also cause “groupthink” and cascading errors when driven by a desire for social alignment (normative influence) janis1982groupthink ; surowiecki2004wisdom . Disentangling these motives in LLMs is essential for ensuring their reliability in high-stakes applications. Recent research has robustly established that LLMs do exhibit social conformity. Studies have shown that this behavior is prevalent across models and tasks baltaji2024conformity ; wengwe , and critically, that its likelihood is modulated by factors such as task uncertainty zhu2024conformity ; liu2025exploring . Initial inquiries into the mechanism, such as the work of leng2023llm , have suggested that the process is informational, based on the models’ self-generated rationales. However, a critical gap remains, as prior work has often relied on models’ self-reported rationales and has not been explicitly designed to quantitatively disentangle the drivers of conformity across a diverse range of models. The present study makes three core contributions to address these limitations: First, we introduce a quantitative modeling approach, adapting a behavioral economics information cascade paradigm to objectively measure the decision weights LLMs assign to private versus public signals, moving beyond subjective self-reports. Second, we are the first to systematically manipulate information uncertainty as a moderator, providing a formal test for a dual-process shift in LLM conformity. Our results reveal that LLMs transition from a rational, informational strategy to a normative-like heuristic as uncertainty increases. Finally, we validate these findings across nine leading LLMs, establishing the generalizability of this mechanism. This work thus offers a more rigorous and nuanced model of AI social behavior. 2 Literature Survey 2.1 Social Conformity on Decision Making in Human Teams When making decisions in groups, humans often exhibit social conformity—the tendency to align with a majority, which can lead to either the “wisdom of crowds” or the “madness of crowds” galton1907vox ; mavrodiev2021ambigous . This behavior is driven by two distinct motivations: informational influence, a rational desire for accuracy, and normative influence, a social desire for approval deutsch1955study . While traditional psychology, exemplified by asch1951effects ’s classic experiment, often highlighted normative pressures, behavioral economics has focused on informational conformity, using paradigms like the information cascade to demonstrate that human choices can align with rational Bayesian updating anderson1997information . A critical insight from this literature is that the motivation for conformity is not static but is dynamically moderated by uncertainty. Seminal theories such as the Heuristic-Systematic Model chaiken1980heuristic and research on groupthink janis1982groupthink establish that as uncertainty and cognitive load increase, individuals are more likely to abandon effortful analysis and shift to heuristic processing, such as relying on social signals. Neurocomputational frameworks further suggest that while informational influence dominates under manageable uncertainty, extreme ambiguity can trigger a shift toward normative alignment to reduce conflict and seek social validation toelch2015informational ; kerr2004group . This established human foundation sets the stage for examining conformity in LLMs. While recent studies suggest LLMs mimic such behaviors, the role of uncertainty as a key moderator that can shift their decision-making process from a purely informational strategy to a potentially normative-like one remains underexplored, providing a critical bridge from human psychology to AI research. 2.2 Social Conformity in LLMs Recent advancements in LLMs have sparked growing interest in their emergent social behaviors, particularly social conformity. Early studies in multi-agent systems revealed that LLMs, like humans, are prone to group influence. For instance, baltaji2024conformity conducted simulated intercultural debates and found that LLM agents are highly susceptible to perceived peer pressure, with mere awareness of other participants’ identities sufficient to shift their opinions before discussions begin, underscoring conformity as a driver of persona and opinion inconsistency. Building on this, subsequent research has adapted social psychology paradigms to quantify conformity. wengwe introduced BENCHFORM, featuring reasoning-intensive tasks and five interaction protocols to simulate social influence, confirming conformity’s prevalence and its increase with longer interaction times and larger majorities. zhu2024conformity replicated Asch’s conformity experiments in a question-answering format, showing that LLMs, especially instruct-tuned models, conform more when uncertain about initial predictions. liu2025exploring used the CogMir framework to mirror cognitive science experiments, finding that LLM conformity varies with information certainty in the “Herd Effect” and that they obey authoritative figures more than peer groups, differing from human patterns. While this line of research replicating the Asch paradigm has successfully established the existence of conformity (e.g., wengwe ) and identified information uncertainty as one of the key moderators (e.g., zhu2024conformity ; liu2025exploring ), it offers limited insight into the underlying motivations and mechanisms. leng2023llm advanced this field by applying an information cascade paradigm, suggesting LLMs’ social conformity stems from informational influence based on self-generated explanations. Yet, three key gaps exists: (1) Existing designs lack controlled, quantifiable differentiation between informational (evidence-based) and normative (social pressure-based) influences, leaving the core motivation, particularity normative influence unclear; (2) The use of self-report explanation as a measurement of LLMs’ conformity driver, like GPT-4 citing “Bayesian reasoning,” likely reflect linguistic patterns from training data (e.g., scientific texts) rather than true motives; (3) Reliance on single models (e.g., GPT-4) limits generalizability across diverse LLM models. 3 Research Gap and Objectives Taken together, the reviewed studies reveal several persistent gaps. First, current studies lack a quantitative understanding of whether LLMs, like humans, possess a dual-process mechanism for conformity. Moreover, although task uncertainty has been linked to heightened conformity levels (e.g., zhu2024conformity ), prior work has not explained why does it happen and does it simulate the Heuristic-Systematic Model (HSM) chaiken1980heuristic , which suggest that uncertainty prompts a transition from effortful, analytical thinking (system 2, informational) to heuristic,

Read the complete text