Probing the contents of semantic representations from text, behavior, and brain data using the psychNorms metabase
Zak Hussain, Rui Mata, Ben R. Newell, Dirk U. Wulff · 2024
Read Probing the contents of semantic representations from text, behavior, and brain data using the psychNorms metabase by Zak Hussain, Rui Mata, Ben R. Newell, Dirk U. Wulff (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04936.txt.
Introduction
Zak Hussain and co-authors compare three ways of capturing what words mean to people, in a 2024 paper. Word representations usually come from internet text, but behavior tests and brain scans promise a closer match to human minds. Using a shared yardstick, the team lined up vectors built from each source and asked where they part ways.
Behavior-based vectors carried extra signal about feelings, agency, and moral tone that text missed. Their psychNorms metabase, plus a new content analysis method, made those gaps readable. For builders of language models meant to think like people, the lesson is to train on what people do, not only on what they write.
Catalog record
| CREATOR | Zak Hussain, Rui Mata, Ben R. Newell, Dirk U. Wulff |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-04936
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Probing the contents of semantic representations from text, behavior, and brain data using the psychNorms metabase Zak Hussain, Rui Mata, Ben R. Newell, Dirk U. Wulff Abstract Semantic representations are integral to natural language processing, psycholinguistics, and artificial intelligence. Although often derived from internet text, recent years have seen a rise in the popularity of behavior-based (e.g., free associations) and brain-based (e.g., fMRI) representations, which promise improvements in our ability to measure and model human representations. We carry out the first systematic evaluation of the similarities and differences between semantic representations derived from text, behavior, and brain data. Using representational similarity analysis, we show that word vectors derived from behavior and brain data encode information that differs from their text-derived cousins. Furthermore, drawing on our psychNorms metabase, alongside an interpretability method that we call representational content analysis, we find that, in particular, behavior representations capture unique variance on certain affective, agentic, and socio-moral dimensions. We thus establish behavior as an important complement to text for capturing human representations and behavior. These results are broadly relevant to research aimed at learning human-aligned semantic representations, including work on evaluating and aligning large language models. 1 Introduction Semantic representations are now a staple in computational linguistics Boleda (2020) , cognitive psychology ( Günther et al., 2019 ; Hussain et al., 2024a ) , as well as natural language processing and artificial intelligence ( Jurafsky and Martin, 2024 ) . Crucial to their success has been the widespread availability of massive corpora of web text ( Crawl, 2024 , e.g., Common Crawl;) used for representation learning. However, recent years have seen an uptick in novel behavioral and neuroscientific datasets for training and evaluating semantic representations, with the broad hope being that these can capture dimensions of human psychology less present in text. For instance, driven by recent large-scale behavior data collection efforts ( De Deyne et al., 2019 ; Hebart et al., 2023 , e.g.,) , researchers are deriving semantic representations from free associations ( Richie and Bhatia, 2021 ; Hussain et al., 2024b ; Wulff and Mata, 2022 ) , odd-one-out judgments ( Hebart et al., 2020 ) , and sensorimotor ratings ( Kennington, 2021 ) . Likewise, semantic representations obtained from brain data (e.g., fMRI, EEG) are becoming popular for evaluating and improving the human-likeness of state-of-the-art AI systems: namely, large language models (LLMs) ( Hollenstein et al., 2019 ; Toneva and Wehbe, 2019 , github.com/brain-score/language ,) . Our study seeks to address two research questions: (a) do behavior and brain representations encode systematically different information than text, and (b) are these differences relevant from the perspective of measuring and modeling human representations? Figure 1 illustrates our approach. First, we run a representational similarity analysis (RSA) to uncover systematic differences between text, behavior, and brain data (Section 4.1 ). We then analyze the content of these differences via our representational content analysis (RCA, Sections 4.2 , 4.3 ), and end with a discussion of the merits and limitations of our work. Figure 1: An illustration of our approach. Word vectors are first obtained from the different data sources and then compared via representational similarity analysis (RSA) and representational content analysis (RCA). 2 Our contributions Our contributions are four-fold. First, we perform a comprehensive comparison of 10 text representations, 10 behavior representations, and 6 brain representations, revealing robust differences between data types (Section 4.1 ). Second, we collate the largest (to our knowledge) metabase of predominantly human-rated (behavioral) word properties (i.e., word norms , Section 3.1 ), which we call psychNorms . The metabase is publicly available at github.com/Zak-Hussain/psychNorms , and reflects over half a century of psycholinguistic research. We hope it will serve as a valuable resource for researchers seeking to measure and interpret abstract language representations along psychologically meaningful dimensions. Third, leveraging psychNorms and linear probes ( Belinkov, 2022 , see, e.g.,) , we demonstrate how to build interpretable informational content profiles for abstract representations via a novel analysis framework that we call representational content analysis (RCA, Section 3.3 ). By comparing the profiles of different representations, we can provide crucial insight into the content of their differences. This could be especially useful for interpreting and navigating discrepancies between the plethora of otherwise opaque representational alignment metrics ( Sucholutsky et al., 2023 ) . Fourth, and most importantly, we show that, despite being trained on orders of magnitudes less data, the behavior representations encode psychological information of comparable and sometimes even superior quality to their text-based cousins (Sections 4.2 , 4.3 ). This suggests behavior as an important complement to text when it comes to measuring and modeling human representations. 3 Methodology 3.1 Representations and norms As mentioned, our analyses seek to answer two questions: (a) do behavior and brain representations encode systematically different information than text, and (b) are these differences relevant from the perspective of measuring and modeling human representations? We attempt to answer these questions using numerical word-level representations (i.e., word vectors ). These continuous representations permit quantitative comparisons across otherwise incommensurate data types (text, behavior, and brain data). Furthermore, because the representations are at the level of individual words (i.e., there is one vector per word), they can be directly probed using widely available word-level ratings (norms) such as those we collate in psychNorms . Table 1: Text, behavior, and brain representations (*trained as part of this research). REPRESENTATION Description fastText CommonCrawl fastText architecture ( Mikolov et al., 2018 ) , trained on CommonCrawl. GloVe CommonCrawl GloVe architecture ( Pennington et al., 2014 ) , trained on CommonCrawl. LexVec CommonCrawl LexVec architecture ( Salle et al., 2016 ) , trained on CommonCrawl. fastText Wiki News fastText architecture ( Mikolov et al., 2018 ) , trained on Wikipedia 2017, UMBC webbase, and statmt.org news. CBOW GoogleNews CBOW architecture ( Mikolov et al., 2013 ) trained on the Google News. fastTextSub OpenSub fastText subword architecture ( Mikolov et al., 2018 ) trained on OpenSubtitles ( Van Paridon and Thompson, 2021 ) . GloVe Wikipedia GloVe architecture ( Pennington et al., 2014 ) trained on Wikipedia 2014. spherical text Wikipedia Spherical text architecture ( Meng et al., 2019 ) trained on Wikipedia 2019. GloVe Twitter GloVe architecture ( Pennington et al., 2014 ) trained on Twitter. morphoNLM Recurrent neural network architecture fine-tuned on morphological informative examples ( Luong et al., 2013 ) . norms sensorimotor Ratings of 6 perceptual modalities and 5 action effectors ( Lynott et al., 2020 ) SGSoftMax[In/Out]put SWOW* [Cue/Response] vectors from Skip-gram softmax architecture ( Goldberg and Levy, 2014 , as in, e.g.,) trained on SWOW ( De Deyne et al., 2019 ) . PPMI SVD SWOW* Positive pointwise mutual information (PPMI) followed by singular value decomposition (SVD) of the SWOW cue-response matrix ( Richie and Bhatia, 2021 ; Hussain et al., 2024b , following, e.g.,) . PPMI SVD EAT* PPMI followed by SVD of the Edinburgh Associative Thesaurus cue-response matrix ( Kiss et al., 1973 , EAT,) . SVD similarity relatedness* SVD of a similarity matrix of aggregated and normalized similarity and relatedness judgment datasets. feature overlap Cosine similarity matrix of overlapping feature frequency percentages between cue pairs in a feature listing task ( Buchanan et al., 2019 ) THINGS Neural network embedding trained to