The role of System 1 and System 2 semantic memory structure in human and LLM biases

Katherine Abramski · 2026

Read The role of System 1 and System 2 semantic memory structure in human and LLM biases by Katherine Abramski (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12816.txt.

Introduction

Katherine Abramski and two colleagues model System 1 and System 2 as semantic memory networks. Dual process theory ties bias mainly to fast associative System 1 thought, with slow deliberative System 2 curbing it. Networks from human and model data let the team test that story. Human memory structures prove irreducible, while model structures do not. Lower bias tracks System 2 structures in humans alone. The gap suggests some conceptual knowledge curbs bias in humans but not in models. Machine and human cognition differ in kind, not degree.

Catalog record

CREATORKatherine Abramski
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63612
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12816

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The role of System 1 and System 2 semantic memory structure in human and LLM biases Katherine Abramski Abstract Keywords: dual process theory, implicit bias, stereotype, semantic network, generative AI, social cognition, conceptual knowledge, multilayer network Implicit biases in both humans and large language models (LLMs) pose significant societal risks. Dual process theories propose that biases arise primarily from associative System 1 thinking, while deliberative System 2 thinking mitigates bias, but the cognitive mechanisms that give rise to this phenomenon remain poorly understood. To better understand what underlies this duality in humans, and possibly in LLMs, we model System 1 and System 2 thinking as semantic memory networks with distinct structures, built from comparable datasets generated by both humans and LLMs. We then investigate how these distinct semantic memory structures relate to implicit gender bias using network-based evaluation metrics. We find that semantic memory structures are irreducible only in humans, suggesting that LLMs lack certain types of human-like conceptual knowledge. Moreover, semantic memory structure relates consistently to implicit bias only in humans, with lower levels of bias in System 2 structures. These findings suggest that certain types of conceptual knowledge contribute to bias regulation in humans, but not in LLMs, highlighting fundamental differences between human and machine cognition. 1 Introduction Implicit biases can have significant societal consequences, often manifesting in the form of stereotypes that negatively impact certain groups. A large body of work has shown that such biases often arise automatically and outside conscious awareness [ 38 , 39 ] , making them particularly challenging to regulate [ 28 ] . Similar concerns have emerged around large language models (LLMs), which have been shown to exhibit harmful implicit biases despite performing well on explicit bias benchmarks [ 9 , 83 ] . This parallels the human tendency for implicit attitudes to diverge from explicit beliefs [ 61 , 58 , 55 ] , raising questions about whether humans and LLMs share similar cognitive architectures, and sparking renewed interest in the cognitive mechanisms underlying biased reasoning in humans and machines alike [ 40 , 82 , 44 ] . A dominant framework for understanding the nature of implicit bias in humans is provided by dual process theories of cognition [ 75 , 36 , 37 ] , which distinguish between two interacting systems of thought: a fast, automatic System 1, and a slower, deliberative System 2 [ 67 , 72 , 43 ] . System 1 relies heavily on learned associations, enabling efficient pattern recognition but making it prone to systematic errors when associations reflect misleading correlations or social stereotypes. Instead, System 2 employs logical reasoning, abstract thinking, and cognitive control, and can monitor, evaluate, and sometimes override System 1 responses [ 60 , 43 ] . Thus, implicit biases are typically attributed to System 1, while bias regulation depends on the selective engagement of System 2 [ 27 , 54 , 28 ] . While there is extensive behavioral evidence supporting this functional distinction, [ 72 , 30 ] , much of this work focuses on characterizing differences in performance, speed, or controllability [ 43 , 10 ] , rather than providing a mechanistic account of how certain representational structures and processes contribute to systematic functional differences [ 32 , 56 , 16 ] . Clarifying this gap requires moving beyond functional characterizations and asking how different forms of knowledge organization bring about observable differences in biased-related behavior. Several theoretical accounts have attempted to address this gap by arguing for the existence of two memory systems: an associative system and a rule-based system [ 67 , 69 , 29 ] , aligning with System 1 and System 2, respectively. Associative systems are characterized by statistical regularities, pattern completion, and similarity-based organization [ 6 , 19 ] , whereas rule-based systems are defined by logical rules, symbolic operations, and propositional (i.e. declarative) knowledge [ 66 , 33 ] . While these accounts aim to provide a mechanistic explanation of the dual process divide, they face two persistent limitations. First, they often blur the distinction between representational structure and process [ 17 , 41 ] . Associative systems are typically specified both in terms of their structural organization and their processing dynamics [ 20 , 19 ] , whereas descriptions of rule-based systems focus primarily on processing dynamics in terms of reasoning procedures, while leaving the structure of the underlying knowledge representations underspecified [ 67 , 62 , 7 ] . As a result, it remains unclear whether systematic functional differences are driven by differences in memory structure, processing mechanisms, or interactions between the two [ 75 , 37 , 25 ] . Second, these accounts are often abstract, providing limited guidance for how representational differences might be operationalized, measured, or compared empirically [ 29 , 31 , 32 ] . 1.1 Modeling conceptual knowledge with semantic memory networks One way to address this gap is to focus explicitly on representational structure by modeling the different forms of conceptual knowledge associated with the two memory systems. Semantic memory networks provide a natural framework for this goal [ 20 , 19 , 11 , 79 ] . Associative memory has long been represented as networks of concepts connected by associative links often built from free associations [ 19 , 6 , 17 , 65 ] . Such representations have been particularly successful in capturing properties commonly attributed to System 1 thinking, including similarity-based organization and lexical retrieval [ 19 , 21 ] . In contrast, representing rule-based memory in network form poses a greater challenge, since it requires flattening logical rules, symbolic operations and propositional knowledge onto an explicit memory structure [ 67 , 62 , 7 ] . Nevertheless, several lines of research suggest that relational network representations – such as feature-based or categorical networks – can preserve important aspects of rule-based and propositional knowledge [ 20 , 68 , 52 , 8 ] . Feature-based networks represent concepts in terms of their defining or characteristic features [ 68 , 52 ] , and can be built from feature norms or dictionary definitions by connecting concepts to their defining characteristics [ 76 , 48 ] . Categorical networks encode taxonomic relations and logical category constraints that reflect category inclusion [ 20 , 74 ] , and are commonly constructed using large-scale lexical resources such as WordNet [ 53 ] , which link concepts through typed semantic relations such as synonymy, antonymy, hypernymy, and hyponymy. Crucially, although representing rule-based memory in relational network form abstracts away from symbolic operations and logical rules, it preserves the core relational knowledge that underlies deliberative logical reasoning [ 14 , 71 ] , providing a structural foundation for System 2 thinking [ 68 , 46 ] . Thus, by encoding different forms of conceptual knowledge in semantic memory networks, associative and rule-based memory systems are put on the same representational plane. Moreover, the network representations enable comparative empirical investigations which can be carried out using well-studied tools, frameworks, and methodologies designed specifically for network models [ 74 ] . One such representational framework that is particular well-suited for this problem is multilayer networks, which allow multiple types of relationships between the same set of nodes to

Read the complete text