Replicating Human Social Perception in Generative AI: Evaluating the Valence-Dominance Model

Necdet Gürkan, Kimathi Njoki, Jordan W. Suchow · 2025

Read Replicating Human Social Perception in Generative AI: Evaluating the Valence-Dominance Model by Necdet Gürkan, Kimathi Njoki, Jordan W. Suchow (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04842.txt.

Introduction

Necdet Gürkan, Kimathi Njoki, and Jordan Suchow test whether image-making AI systems judge faces the way people do in a 2025 paper. Social research says first impressions of faces fall along two axes: warmth or trust, called valence, and power, called dominance. The team asked whether multimodal AI systems recover that same structure when rating faces.

A standard analysis of the AI ratings found two main axes that closely matched valence and dominance. The traits loaded onto them in line with established definitions. Yet many regions and models also showed a third axis, whose meaning is not yet clear. The findings raise questions about using such systems in hiring and other choices where face judgments matter. They also hint that AI may absorb human-like social biases.

Catalog record

CREATORNecdet Gürkan, Kimathi Njoki, Jordan W. Suchow
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04842

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Replicating Human Social Perception in Generative AI: Evaluating the Valence-Dominance Model Necdet Gürkan, Kimathi Njoki, Jordan W. Suchow Abstract As artificial intelligence (AI) continues to advance—particularly in generative models—an open question is whether these systems can replicate foundational models of human social perception. A well-established framework in social cognition suggests that social judgments are organized along two primary dimensions: valence (e.g., trustworthiness, warmth) and dominance (e.g., power, assertiveness). This study examines whether multimodal generative AI systems can reproduce this valence-dominance structure when evaluating facial images and how their representations align with those observed across world regions. Through principal component analysis (PCA), we found that the extracted dimensions closely mirrored the theoretical structure of valence and dominance, with trait loadings aligning with established definitions. However, many world regions and generative AI models also exhibited a third component, the nature and significance of which warrant further investigation. These findings demonstrate that multimodal generative AI systems can replicate key aspects of human social perception, raising important questions about their implications for AI-driven decision-making and human-AI interactions. K eywords dominance-valence model \cdot multimodal generative AI \cdot social perception 1 Introduction The field of artificial intelligence (AI) has revolutionized many aspects of modern life, transforming both scientific research and industrial practices. In recent years, generative AI—a subset of AI that uses computational techniques to generate novel outputs by learning patterns and structures from training data—has emerged as a groundbreaking tool ( Goodfellow et al., 2020 ) . These systems excel in tasks requiring human-like intelligence, from creative endeavors ( Boussioux et al., 2024 ; Epstein et al., 2023 ) to complex decision-making ( Chuma and De Oliveira, 2023 ; Kim et al., 2024 ; Suri et al., 2024 ) . Beyond mimicking human capabilities in specific domains, generative AI systems are now being explored for their potential to replicate and extend foundational psychological theories, offering new pathways for understanding human cognition and AI’s role in shaping social perception ( Jiang et al., 2024 ; Shiffrin and Mitchell, 2023 ; Strachan et al., 2024 ; Sartori and Orrù, 2023 ) . At the core of generative AI lies the deep neural network architecture, which has led to a significant debate regarding its ability to replicate human cognition ( Bowers et al., 2023 ; Cichy and Kaiser, 2019 ) . These debates focus on diverse neural networks pretrained on tasks such as image classification ( Jha et al., 2023 ; Nadler et al., 2023 ) and natural language processing, including sentiment analysis, and machine translation ( Tuckute et al., 2024 ) . Researchers have combined deep neural network representations with both linear and cognitive models to refine these representations, effectively fine-tuning them to capture aspects of human psychological processes ( Bhatia et al., 2019 ; Sucholutsky and Griffiths, 2024 ; Peterson et al., 2022 ; Gurkan and Suchow, 2022 ; Gürkan and Suchow, 2023 ) . Generative AI fundamentally differs from traditional AI systems in its ability to generalize beyond its training data, raising critical questions about whether human-like cognitive and psychological representations can emerge naturally, without task-specific fine-tuning. Large language models (LLMs), such as ChatGPT, Gemini, and Claude, exemplify this potential. These models, trained on billions of parameters to predict the next token in a sequence, excel in diverse tasks including reasoning ( Huang and Chang, 2022 ) , text comprehension ( Jiang and Li, 2024 ) , and content generation ( Spangher et al., 2024 ) . Unlike conventional language models, their extraordinary capacity for generalization across varied contexts has sparked a growing interest in their ability to inherently encode human-like conceptual and psychological frameworks ( Huang et al., 2023 ; Du et al., 2024 ) . Thus, researchers have begun using LLMs as proxies for human participants to test widely recognized psychological theories, such as Moral Foundations Theory ( Scherrer et al., 2024 ) , theory of mind ( Strachan et al., 2024 ) , cognitive biases ( Hagendorff et al., 2023 ) , and decision-making frameworks ( Herrmann and Levinstein, 2025 ) . Recently, multimodal generative AI models have emerged, integrating multiple data modalities—such as text, images, audio, and video—into a single system. Examples include OpenAI’s DALL-E and GPT-4, Google DeepMind’s Gemini, and Meta’s ImageBind, demonstrating the potential of these systems to synthesize complex outputs by combining insights across different forms of data. This integration enables tasks such as generating descriptive captions for images ( Nguyen et al., 2024 ) , creating visualizations from textual prompts ( Yang et al., 2023 ) , and even producing video content from audio narratives ( Sung-Bin et al., 2023 ) . Multimodal generative AI represents a significant step towards systems that more closely resemble human cognitive abilities, as humans inherently process and combine multiple sensory modalities when reasoning, communicating, or creating ( Schulze Buschoff et al., 2025 ) . Multimodal generative models have demonstrated remarkable capabilities in replicating aspects of human cognition, including the representation of object concepts ( Du et al., 2024 ) , abstract visual reasoning ( Camposampiero et al., 2023 ) , and performance on perceptual psychophysical tasks ( Marjieh et al., 2024 ) . These models have also been shown to embed human-like biases. For instance, CLIP Radford et al., 2021 reflects the values of American racial hierarchies, mirroring both implicit and explicit beliefs present in human cognition ( Wolfe et al., 2022 ) , and exhibits social stereotypes Bianchi et al., 2023 . Furthermore, the trait inferences made by these models from facial images strongly correlate with human impression biases ( Wolfe et al., 2024 ) . Despite these advancements, the question of whether multimodal generative models can replicate broader human psychological theories remains unexplored. In this paper, we examine whether multimodal generative AI models can replicate the valence-dominance theory of impressions of faces. The valence-dominance model ( Oosterhof and Todorov, 2008 ) has been fundamental in psychological research on social perception, explaining how individuals make rapid trait inferences based on facial features. By evaluating whether multimodal AI models encode these dimensions in a way that aligns with human judgments, we aim to assess their potential for modeling complex social perception processes. We tested three state-of-the-art multimodal generative AI models—Claude 3.5 Sonnet, OpenAI GPT-4 Turbo, and Gemini 1.5 Pro—by analyzing their trait inferences from facial images using principal component analysis (PCA). We then compared the extracted dimensions to those observed in human judgments across world regions, leveraging findings from the Psychological Science Accelerator project ( Jones et al., 2021 ) . This cross-cultural comparison allows us to assess whether generative AI models not only replicate the valence-dominance structure but also align with regional variations in human social perception. Our findings contribute to the broader discussion on AI’s ability to approximate human cognitive structures and shed light on its implications for understanding biases in machine-generated representations. 2 Methods 2.1 Face stimuli The face stimuli used in this study were sourced from the Chicago Face Database ( Ma et al., 2015 ) , which was also utilized by the cross-cultural Psychological Science Accelerator project ( Jones et al., 2021 ) we reference to compare the alignment of multimodal generative AI models with different world regions. The dataset consists of facial images of 60

Read the complete text