The "LLM World of Words" English free association norms generated by large language models
Katherine Abramski, Riccardo Improta, Giulio Rossetti, Massimo Stella · 2024
Read The "LLM World of Words" English free association norms generated by large language models by Katherine Abramski, Riccardo Improta, Giulio Rossetti, Massimo Stella (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01330.txt.
Introduction
Abramski, Improta, Rossetti, and Stella built word association norms from language models in this paper from twenty twenty-four. Psychologists use free association, where a cue word draws a quick reply, to map how minds organize concepts. The team mirrored a large human dataset of about twelve thousand cues. Three language models answered the same cues.
The result is a parallel dataset ready for direct comparison with human norms. Network models built from both sets map the shape of semantic memory in people and machines. The authors show how the data can expose biases, such as gender stereotypes, in both. They frame the norms as a missing base for this line of research.
Catalog record
| CREATOR | Katherine Abramski, Riccardo Improta, Giulio Rossetti, Massimo Stella |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-01330
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The "LLM World of Words" English free association norms generated by large language models Katherine Abramski, Riccardo Improta, Giulio Rossetti, Massimo Stella Abstract Free associations have been extensively used in cognitive psychology and linguistics for studying how conceptual knowledge is organized. Recently, the potential of applying a similar approach for investigating the knowledge encoded in LLMs has emerged, specifically as a method for investigating LLM biases. However, the absence of large-scale LLM-generated free association norms that are comparable with human-generated norms is an obstacle to this new research direction. To address this limitation, we create a new dataset of LLM-generated free association norms modeled after the "Small World of Words" (SWOW) human-generated norms consisting of approximately 12,000 cue words. We prompt three LLMs, namely Mistral, Llama3, and Haiku, with the same cues as those in the SWOW norms to generate three novel comparable datasets, the "LLM World of Words" (LWOW). Using both SWOW and LWOW norms, we construct cognitive network models of semantic memory that represent the conceptual knowledge possessed by humans and LLMs. We demonstrate how these datasets can be used for investigating implicit biases in humans and LLMs, such as the harmful gender stereotypes that are prevalent both in society and LLM outputs. Background & Summary How is conceptual knowledge organized in the mind? Such a question has long been the focus of linguists and cognitive psychologists who aim to better understand the human language capacity [ 1 , 2 ] . Recently, this question has become increasingly relevant in the field of artificial intelligence, particularly regarding large language models (LLMs). Human semantic memory – the repository of conceptual knowledge that encompasses how words get their meaning [ 3 ] – forms the foundation of human language and thought, and thus, its structure and properties influence how we reason, form beliefs and make decisions [ 4 , 5 ] , ultimately shaping our social and political systems. Similarly, the semantic representations that comprise the knowledge encoded in LLMs are the underlying source behind the outputs they produce, and as LLMs become more integrated into our everyday lives, these outputs have an increasing impact on society [ 6 , 7 ] . Thus, the study of the structure and properties of semantic memory is central to understanding not only our own thinking and reasoning, but also the "thinking" and "reasoning" of LLMs, which carries important societal implications. Studying semantic memory involves creating representations of word meanings (semantic representations), often in terms of how words relate to other words. In humans, one common way to do this is using free associations [ 8 , 1 , 9 ] , which are usually accessed by prompting participants with a cue word and asking them to come up with (typically three) associated responses. Since the task is context neutral, responses represent the associative knowledge of words that we possess at an implicit level. Free associations have been extensively used in cognitive psychology and linguistics for studying lexical retrieval [ 1 , 4 ] , semantic organization [ 8 ] , and similarity judgments [ 10 , 2 , 11 ] . They have also been used for studying differences in cognitive processing between concrete and abstract words, i.e. concreteness effects [ 12 ] . Given that free associations have been shown to correlate with stable implicit attitudes [ 13 ] , they have also been used for studying affective biases [ 9 ] . Investigations of conceptual knowledge using free associations are often conducted within network models of semantic memory built from free associations by connecting cue words to their responses. This results in a complex network structure of human conceptual knowledge in which words get their meanings through relationships to other concepts. Such models enable the investigation of complex cognitive processes that take place within semantic memory. In fact, cognitive network models of semantic memory have been used to gain powerful insights about a variety of human cognitive phenomena such as language learning, [ 14 , 8 ] , creativity [ 15 , 16 , 17 ] , personality traits like openness to experience [ 5 ] , and autism spectrum disorder [ 18 ] . While free associations have been widely used for studying semantic memory in humans, very different approaches have been applied for investigating conceptual knowledge in language models. Typically, semantic representations are directly accessed from the model’s embedding space in the form of word embeddings [ 19 ] , i.e. vector representations of words whose meanings are derived from statistical relationships in the training data. Word embeddings provide an advantageous way for investigating certain aspects of semantic memory because of the types of mathematical operations that can be applied within the embedding space. Specifically, the semantic similarity between two words can easily be calculated by computing the cosine similarity between their word vectors. Thus, this approach can be used for extracting word associations directly from the model’s architecture, and these associations can be used to study several aspects related to the model’s conceptual knowledge [ 20 , 21 ] . In recent years, there has been a great interest in investigating the biases encoded in language models, and measuring the strength of associations between words within the model’s embedding space has been extensively applied for accomplishing this goal [ 22 , 23 , 24 , 25 , 26 ] . Such an approach follows the same idea that the Implicit Association Test (IAT) [ 27 ] uses to investigate implicit attitudes in humans. Essentially, it involves using the cosine similarity to measure the strength of the association between pairs of words for assessing biases, for example, man – doctor and woman – nurse . Depending on the strength of these respective associations, this method can reveal certain biases encoded in the model’s embedding space, such as gender biases that reflect the implicit analogy, man is to doctor as woman is to nurse [ 22 ] . Extracting associations from the embedding space for investigating the conceptual knowledge encoded in language models has many advantages, but it also has some important limitations. Perhaps the most significant limitation is that this approach works well for older language models that use static word embeddings – which represent word meanings at the type level – but not so well for newer models, i.e. LLMs, that use contextual word embeddings – which represent word meanings at the token level. Operations on contextual embeddings require that the embeddings are first transformed into static embeddings [ 26 ] , but this can introduce bias and distort similarity estimates [ 19 ] . Another downside to the approach of accessing the embedding space is that it limits the possibility to make comparisons across models and with humans, since the cognitive architecture of each model is vastly different. These limitations have led to a recent shift from the bottom-up approach of accessing the embedding space for investigating the knowledge encoded in language models, towards a top-down approach that involves prompting models with tasks and using their output to make inferences about the knowledge encoded in their embedding space [ 7 , 28 , 6 ] . This approach mirrors methods from cognitive psychology that use behavioral