From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs Louis Schiekiera, Max Zimmer, Christophe Roux, Sebastian Pokutta, Fritz Günther Abstract We investigate the extent to which an LLM’s hidden-state geometry can be recovered from its behavior in psycholinguistic experiments. Across eight instruction-tuned transformer models, we run two experimental paradigms—similarity-based forced choice and free association—over a shared 5,000-word vocabulary, collecting 17.5M+ trials to build behavior-based similarity matrices. Using representational similarity analysis, we compare behavioral geometries to layerwise hidden-state similarity and benchmark against FastText, BERT, and cross-model consensus. We find that forced-choice behavior aligns substantially more with hidden-state geometry than free association. In a held-out-words regression, behavioral similarity (especially forced choice) predicts unseen hidden-state similarities beyond lexical baselines and cross-model consensus, indicating that behavior-only measurements retain recoverable information about internal semantic geometry. Finally, we discuss implications for the ability of behavioral tasks to uncover hidden cognitive states. 1 Introduction In cognitive science, semantic knowledge is typically treated as a latent structure: we cannot observe a speaker’s ‘meaning representation’ directly, but we can systematically probe it through behavior ( De Deyne et al. 2019 ; Günther et al. 2019 ; Jones et al. 2015 ) . Word-association paradigms use this measurement logic: when a participant sees a cue (e.g. dog ), the associations they produce or select (e.g. cat , leash , bark ) are constrained by their underlying semantic organization. When such judgments are aggregated across trials, the resulting cue–response statistics are used for inference: cues that show similar response distributions are inferred to be semantically close, yielding an embedding-like similarity matrix, often conceptualized as a structured mental lexicon or semantic network ( De Deyne & Storms 2008 ; De Deyne et al. 2013 ; Roads & Love 2021 ; Vankrunkelsven et al. 2018 ) . In this sense, association behavior functions as a measurement device: it produces observable data from which one can reconstruct an approximate map of an otherwise unobserved semantic system. Figure 1 : Conceptual overview. For a shared vocabulary \mathcal{V} , we (i) extract layer- \ell word representations to form a hidden-state similarity matrix \mathbf{S}^{\mathrm{hid}}_{\ell} , and (ii) run behavioral association tasks (forced choice/free association) to build a cue–response matrix \mathbf{B} and behavioral similarity \mathbf{S}^{\mathrm{beh}} . RSA correlates the pairwise similarities in \mathbf{S}^{\mathrm{hid}}_{\ell} and \mathbf{S}^{\mathrm{beh}} to quantify behavior–activation alignment. We transfer this measurement logic to large language models (LLMs). Recent work increasingly treats LLMs as ‘participants’ in classic semantic paradigms, using free association and related protocols to construct model-derived semantic norms and network structure that can be compared to large-scale human datasets ( Abramski et al. 2024 ; Abramski et al. 2025 ; Suresh et al. 2023 ; Vintar & Javoršek 2025 ) . A key open question, however, is not only how model behavior compares to humans, but also what a model’s own behavior reveals about its own internal representations. This question is now empirically testable because, unlike in humans, both behavior and internal representations are observable in LLMs ( Jawahar et al. 2019 ; Tenney et al. 2019 ; Zhang et al. 2023 ) . Figure 1 summarizes our approach: we probe a model over a shared vocabulary, derive a behavioral semantic geometry from its responses, and then compare that geometry to the model’s layerwise hidden-state geometry. Concretely, by repeatedly querying a model with a controlled vocabulary and aggregating responses across many trials, we obtain for each cue w_{i} a response distribution encoded as a row \mathbf{B}_{i,:} of a cue–response matrix \mathbf{B} . Each row thus defines a behavioral embedding, and comparing rows induces a behavioral similarity geometry, e.g., \mathbf{S}^{\mathrm{beh}}(i,j)=\cos(\mathbf{B}_{i,:},\mathbf{B}_{j,:}) . Our analysis then asks how well \mathbf{S}^{\mathrm{beh}} recovers the hidden-state similarities \mathbf{S}^{\mathrm{hid}}_{\ell} across layers and prompting contexts. This comparison is useful in practical settings where only black-box behavioral access is available, because it tests how much of a model’s internal semantic organization is recoverable from discrete outputs. Representational Similarity Analysis (RSA) provides a solution to compare representations that differ in dimensionality, scaling, and modality (e.g. behavior, and neural data): rather than aligning coordinates, RSA compares the geometry of two representational spaces by correlating their pairwise similarity structure over a shared set of items ( Kriegeskorte et al. 2008 ; Nili et al. 2014 ) . RSA has been widely used to relate representations across modalities ( Braun et al. 2025 ; Ciernik et al. 2025 ; Klabunde et al. 2024 ; Kornblith et al. 2019 ; Sucholutsky et al. 2024 ) , including comparisons between LLM activations and human brain signals ( Abnar et al. 2019 ; Aw et al. 2023 ) . However, to the best of our knowledge, RSA has not been used to directly compare an LLM’s behavior-derived semantic geometry with its own layerwise hidden-state geometry under a matched vocabulary and experimental protocol. Figure 2 : Behavioral paradigms and derived semantic geometries. Left (forced choice): given a cue word w_{i} and a candidate set c_{i} , the model selects a fixed number of output words o_{i} , producing a cue–response count matrix \mathbf{B}^{\mathrm{FC}} . Right (free association): given w_{i} alone, the model generates multiple output words o_{i} , yielding \mathbf{B}^{\mathrm{FA}} . From the count matrix, we produce similarity matrices \mathbf{S}^{\mathrm{FC}} and \mathbf{S}^{\mathrm{FA}} by cosine similarity between rows. The diagram shows |c_{i}|=4 for FC and |o_{i}|=4 for FA, while our experiments use |c_{i}|=16 for FC and |o_{i}|=5 for FA. In this work, we propose a framework to compare an LLM’s behavioral semantic geometry with its internal hidden-state geometry. Across eight instruction-tuned transformer models, we use two psycholinguistic paradigms—free association (FA) and forced choice (FC)—to collect semantic relations from model behavior and construct behavioral embedding matrices. In parallel, we extract hidden-state representations for the same vocabulary across layers and multiple extraction strategies. This paired design enables within-model alignment between behavior and internals. We evaluate alignment using RSA and a complementary encoding analysis, asking at which layers and under which prompting conditions an LLM’s internal representations most closely reflect the semantics it expresses behaviorally. Our contributions are: 1. Behavior–Activation Alignment. We compare behavior-derived semantic geometries from FC and FA to layerwise hidden-state geometry across eight instruction-tuned transformer models using RSA and nearest-neighbor overlap. We provide a prompt- and layer-resolved characterization of when internal similarity structure matches behavioral semantics. 2. Predictability from Behavior. Using a held-out-words ridge regression protocol, we show that behavioral similarity—especially FC—predicts unseen hidden-state similarities beyond lexical baselines (FastText, BERT) and a cross-model consensus reference. 3. Dataset and Reproducible Harness. We release a large-scale dataset of LLM association behavior (17.5M+ trials) spanning FA and FC across eight models on Hugging Face ( https://huggingface.co/datasets/schiekiera/llm-association-geometry ). 2 Related Work A growing line of work uses LLMs to generate semantic norms and association networks that can be compared to large-scale human resources such as Small World of Words ( Abramski et al. 2024 ; Abramski et al. 2025 ; Suresh et al. 2023 ; Vintar & Javoršek 2025 ) . These studies show that task-elicited semantic structure from LLM outputs often exhibits meaningful overlap with human judgments, while also revealing systematic divergences that reflect model-specific biases ( Abramski et al. 2024 ; Suresh et al. 2023 ) . Prior analyses of transformer representations show that linguistic and semantic information is accessible from hidden states and varies systematically across depth ( Derby et al. 2021 ; Liu et al. 2024 ; Lenci et al. 2022 ; Tenney et al. 2019 ) . Other work relates model activations to external measurements, including brain activity and behavioral signals ( Abnar et al. 2019 ; Aw et al. 2023 ) . Our contribution differs in focusing on alignment between (i) behavioral semantic geometry and (ii) layerwise hidden-state similarity. Work on extraction and cloning attacks reconstructs internal components of LLMs from API outputs, typically assuming access to logits or log-probabilities ( Carlini et al. 2024 ; Gharami et al. 2025 ) . Our setting is deliberately weaker: we use discrete association judgments (no logits) to ask what aspects of internal similarity geometry are recoverable. Finally, evidence for shared structure across LLMs motivates a low-dimensional ‘universal’ or ‘platonic’ semantic geometry ( Huh et al. 2024 ; Jha et al. 2025 ; Kaushik et al. 2025 ) ; we capture this with a cross-model consensus baseline to separate shared from behavior-specific structure. Table 1 : Model specifications. n_{\text{params}} = number of parameters in billions (B); n_{\text{layers}} = number of layers; d_{\text{model}} = hidden-state dimension width. HuggingFace Model IDs are reported in Appendix B . Model n_{\text{params}} n_{\text{layers}} d_{\text{model}} Falcon3-10B-Instruct 10B 40 3072 gemma-2-9b-it 9B 42 3584 Llama-3.1-8B-Instruct 8B 32 4096 Mistral-7B-Instruct-v0.2 7B 32 4096 Mistral-Nemo-Instruct-2407 12B 40 5120 phi-4 14B 40 5120 Qwen2.5-7B-Instruct 7B 28 3584 rnj-1-instruct 8B 32 4096 3 Methods 3.1 Data availability For reproducibility, we release the full behavioral association dataset (17.5M+ trials) on Hugging Face ( https://huggingface.co/datasets/schiekiera/llm-association-geometry ) and provide all code for preprocessing, data collection, postprocessing, evaluation, and plotting in a public GitHub repository ( https://github.com/schiekiera/llm-association-geometry ). 3.2 Vocabulary and preprocessing We begin from the SUBTLEX-US lexicon ( Brysbaert et al. 2012 ) and construct a core noun vocabulary by part-of-speech filtering, lemmatization, and lemma deduplication, then select the top 6,000 nouns by frequency. We then intersect this list with the C4 corpus by retrieving 50 sentences per word; the final vocabulary consists of the 5,000 highest-frequency nouns for which 50 C4 sentences are available ( Raffel et al. 2020 ; Tikhomirova & Wulff 2026 ) . Further details on preprocessing are provided in Appendix C . 3.3 Models We evaluate eight instruction-tuned decoder-only transformer models (see Table 1 ). The models include Falcon3-10B-Instruct ( TII Team 2024 ) , gemma-2-9b-it ( Gemma Team 2024 ) , Llama-3.1-8B-Instruct ( Meta AI 2024 ) , Mistral-7B-Instruct-v0.2 ( Jiang et al. 2023 ) , Mistral-Nemo-Instruct-2407 ( Mistral AI 2024 ) , phi-4 ( Abdin et al. 2024 ) , Qwen2.5-7B-Instruct ( Qwen Team 2024 ) , and rnj-1-instruct ( Vaswani et al. 2025 ) . 3.4 Behavioral association paradigms Figure 2 summarizes the two behavioral paradigms used to produce semantic association structure from each model. Table 2 provides statistics on the number of trials collected for each paradigm. Both paradigms operate over the same fixed vocabulary of 5,000 nouns. Table 2 : Data collection statistics for the two behavioral paradigms across eight models and a shared vocabulary of 5,000 words. \mathrm{T}_{\mathrm{total}} = total number of trials, \mathrm{T}_{\mathrm{m}} = per model, \mathrm{T}_{\mathrm{w}} = per input word, and \mathrm{T}_{\mathrm{w{+}m}} = per model and word. Paradigm \mathrm{T}_{\mathrm{total}} \mathrm{T}_{\mathrm{m}} \mathrm{T}_{\mathrm{w}} \mathrm{T}_{\mathrm{w{+}m}} Forced choice 12.52M 1.565M 2504 313 Free association 5.04M 0.630M 1008 126 3.4.1 Forced-choice paradigm Forced-choice tasks are a standard tool in cognitive psychology and psycholinguistics for studying semantic similarity under fixed candidate sets ( Demiralp et al. 2014 ; Günther et al. 2023 ; Li et al. 2016 ; Roads & Love 2021 ; Tversky 1977 ) . Compared to free-response tasks, forced choice restricts responses to a predefined set that can include both weakly related and unrelated distractors, thereby probing relative similarity over a broad range of association strengths ( De Deyne et al. 2012 ) . In our FC paradigm, each cue word w_{i} is presented together with 16 candidate words, from which the model must select exactly two words that are most semantically related to the cue (see Appendix D.1 for the full prompt). Candidate sets are constructed by a deterministic shuffle of the remaining 4,999 words using a cue-specific random seed (one seed per cue). This results in \left\lceil\frac{4{,}999}{16}\right\rceil=313 FC trials per cue. 3.4.2 Free association paradigm In contrast to forced-choice tasks, free association places minimal constraints on responses, allowing participants to generate whatever associates come most readily to mind ( De Deyne et al. 2019 ) . As a result, FA norms capture aspects of semantic centrality, and have been widely used to study semantic networks, and spreading activation ( Aeschbach et al. 2025 ; De Deyne et al. 2019 ; Petrenco & Günther 2025 ) . Recently, Abramski et al. 2024 collected a dataset of free associations of three LLMs. In the free association paradigm, the model is prompted with a single cue word w_{i} and asked to generate exactly five single-word associates (see Appendix E.1 for the full prompt). To obtain a comparable number of associations per cue word as in the FC paradigm, we repeat this task across multiple stochastic runs with different random seeds. Specifically, we perform 126 runs per cue word. 3.4.3 Postprocessing Both paradigms were designed to yield similar association counts per cue (FC: 626; FA: 630). We excluded non-compliant outputs (e.g., out-of-set selections in FC, cue repetition in FC/FA); for FC, we issued a repair prompt and retried up to five times when needed. After postprocessing, mean usable associations per cue were 610.1 (97.5%) for FC and 622.6 (98.8%) for FA. Compliance details are in Appendix D.3 and Appendix E.3 . All behavioral similarity matrices are computed from compliant associations only. For each paradigm, we aggregate model outputs into a sparse cue–response count matrix \mathbf{B} , with rows indexing cue words and columns indexing response types. We write \mathbf{B}^{\mathrm{FC}} for the forced-choice matrix and \mathbf{B}^{\mathrm{FA}} for the free-association matrix. To reduce the influence of globally frequent responses, we reweight cue–response counts with positive pointwise mutual information (PPMI; see Appendix C.3 ), which emphasizes informative co-occurrences ( Abramski et al. 2024 ) . Finally, we compute a cue–cue similarity matrix by taking cosine similarity between the PPMI-weighted row vectors. 3.5 Hidden-state extraction strategies An important design decision in representational analyses of language models concerns the task context in which word-level hidden states are extracted ( Bommasani et al. 2020 ; Cassani et al. 2024 ; Chronis & Erk 2020 ; Gurnee & Tegmark 2023 ; Tikhomirova & Wulff 2026 ) . Building on prior work, we extract layerwise word representations under four contextual embedding strategies . For each model and each target word w_{i} , we consider the following strategies: • Averaged. The target word embedded in 50 naturally occurring sentences sampled from the C4 corpus ( Raffel et al. 2020 ) . Hidden states are extracted separately for each sentence and then averaged, resulting in a context-aggregated representation ( Bommasani et al. 2020 ; Cassani et al. 2024 ; Tikhomirova & Wulff 2026 ) . For further details see Appendix C . • Meaning. A single fixed, definition-style prompt ( ‘What is the meaning of the word {w}?’ ), providing a minimal but explicit semantic context ( Tikhomirova & Wulff 2026 ) . • Task (FC). The target word embedded in the instruction prompt used for the forced-choice behavioral paradigm without the candidate list (see Appendix D.1 for the full prompt). • Task (FA). The target word embedded in the instruction prompt used for the free-association paradigm (see Appendix E.1 for the full prompt). Figure 3 : Summary of RSA and neighborhood-overlap results (means across models). Panel a (left) compares multiple reference geometries: (a1) mean RSA Pearson correlation as a function of layer, and (a2) mean nearest-neighbor overlap (NN@ k ) as a function of neighborhood size k (log scale). Panel b (right) focuses on behavioral references and compares extraction strategies: (b1) layerwise RSA for PPMI-weighted forced-choice similarity \mathbf{S}^{\mathrm{FC}} and (b2) layerwise RSA for PPMI-weighted free-association similarity \mathbf{S}^{\mathrm{FA}} . Let h_{\ell}(w,c) denote the residual-stream hidden state, i.e., the post-block representation returned after transformer block \ell (self-attention + MLP), of word w in context c of a decoder-only transformer where c specifies the full textual input provided to the model. We define the extracted word representation at layer \ell under strategy s as \mathbf{e}^{s}_{\ell}(w) , computed as follows. For single-context strategies, \mathbf{e}^{s}_{\ell}(w)=h_{\ell}(w,c_{s}(w)) , where c_{s}(w) denotes the strategy-specific prompt in which w appears. For the Averaged strategy, we follow prior work and aggregate across multiple natural contexts: \mathbf{e}^{(\mathrm{avg})}_{\ell}(w)=\frac{1}{50}\sum_{i=1}^{50}h_{\ell}(w,c_{i}(w)), where each c_{i}(w) is a distinct sentence sampled from the C4 corpus that contains w ( Bommasani et al. 2020 ; Tikhomirova & Wulff 2026 ) . For words split into multiple subword tokens, we average hidden states over the token positions whose offset spans overlap the cue’s character span. For each layer \ell , we then compute a hidden-state similarity matrix \mathbf{S}^{\mathrm{hid}}_{\ell}(i,j)=\cos\!\big(\mathbf{e}^{s}_{\ell}(w_{i}),\mathbf{e}^{s}_{\ell}(w_{j})\big). We exclude layer 0 because it consists of static, pre-transformer token embeddings that are not yet contextualized and therefore tend to reflect surface/lexical identity more than the contextual similarity structure we aim to analyze ( Kumar et al. 2024 ; Cassani et al. 2024 ) . In addition, contextual hidden-state spaces in transformers are known to be anisotropic: vectors concentrate in a narrow cone, so cosine similarity can be driven by shared global directions rather than item-specific semantic differences ( Ethayarajh 2019 ) . To mitigate this, for each model, layer \ell , and extraction strategy s , we mean-center the extracted vectors by subtracting the empirical mean over the vocabulary before computing cosine similarity. Concretely, letting \mathbf{e}^{s}_{\ell}(w_{i})\in\mathbb{R}^{d} be the vector for word w_{i} and \mu^{s}_{\ell}=\frac{1}{|\mathcal{V}|}\sum_{i=1}^{|\mathcal{V}|}\mathbf{e}^{s}_{\ell}(w_{i}) , we use \widetilde{\mathbf{e}}^{s}_{\ell}(w_{i})=\mathbf{e}^{s}_{\ell}(w_{i})-\mu^{s}_{\ell} ( Huang et al. 2021 ) . 3.6 Baselines Beyond behavioral embeddings, we compare hidden-state similarities to three vocabulary-aligned baselines (for further details see Appendix C.2 ). • FastText. Pretrained English FastText vectors trained on Common Crawl (300d) ( Bojanowski et al. 2017 ) . We form a FastText similarity matrix \mathbf{S}^{\mathrm{FT}} by cosine similarity between the aligned word vectors. • BERT. bert-base-uncased ; we embed each word in a fixed base prompt and extract the mean of the subword tokens aligned to the target word span from the final hidden layer ( Devlin et al. 2019 ) . We form a BERT similarity matrix \mathbf{S}^{\mathrm{BERT}} by cosine similarity between these word-level embeddings. • Cross-model consensus. We define a cross-model consensus geometry by aggregating hidden-state cosine-similarity matrices across the remaining models (excluding the target model) to obtain a single reference similarity structure over the shared vocabulary. This baseline is motivated by recent evidence for a shared, low-dimensional semantic subspace across diverse LLMs, often discussed as a universal or platonic representational geometry ( Huh et al. 2024 ; Jha et al. 2025 ; Kaushik et al. 2025 ) . We define the cross-model consensus for target model m as the mean pairwise cosine similarity across all layers of all other models: \displaystyle s^{(m^{\prime},\ell)}(i,j) \displaystyle:=\cos\!\big(\mathbf{e}^{\!s}_{\ell,m^{\prime}}(i),\,\mathbf{e}^{\!s}_{\ell,m^{\prime}}(j)\big), (1a) \displaystyle\mathbf{S}^{\mathrm{X}}_{\mathrm{m}}(i,j) \displaystyle:=\frac{1}{Z}\sum_{m^{\prime}\neq m}\ \sum_{\ell}s^{(m^{\prime},\ell)}(i,j). (1b) where \mathbf{e}^{s}_{\ell,m^{\prime}}(w) is the layer- \ell word vector from model m^{\prime} under strategy s , and Z is the total number of model–layer terms included. This reference excludes the target model to avoid leakage. 3.7 Evaluation 3.7.1 Representational similarity analysis RSA quantifies the extent to which different representational spaces share the same pairwise similarity structure ( Kriegeskorte et al. 2008 ; Nili et al. 2014 ) . For each model, embedding extraction strategy, and transformer layer \ell , we compare the hidden-state similarity matrix \mathbf{S}^{\mathrm{hid}}_{\ell} to five reference semantic geometries defined over the same vocabulary: (i) PPMI-weighted forced-choice behavioral similarity \mathbf{S}^{\mathrm{FC}}_{\mathrm{PPMI}} , (ii) PPMI-weighted free-association behavioral similarity \mathbf{S}^{\mathrm{FA}}_{\mathrm{PPMI}} , (iii) FastText similarity \mathbf{S}^{\mathrm{FT}} , (iv) BERT similarity \mathbf{S}^{\mathrm{BERT}} , and (v) cross-model consensus similarity \mathbf{S}^{\mathrm{X}}_{\mathrm{m}} . We denote a generic reference geometry by \mathbf{S}^{\mathrm{ref}} , where \mathbf{S}^{\mathrm{ref}}\in\{\mathbf{S}^{\mathrm{FC}}_{\mathrm{PPMI}},\mathbf{S}^{\mathrm{FA}}_{\mathrm{PPMI}},\mathbf{S}^{\mathrm{FT}},\mathbf{S}^{\mathrm{BERT}},\mathbf{S}^{\mathrm{X}}_{\mathrm{m}}\} . We sample n = 500,000 word pairs for RSA estimation. Hidden-state similarities are computed as cosine similarity between layerwise word vectors extracted at layer \ell . Behavioral similarity matrices are computed as cosine similarity between cue vectors derived from the cue–response count matrices, using PPMI weighting to correct for frequency effects. Lexical baseline similarities (FastText and BERT) are likewise computed using cosine similarity over the corresponding embedding matrices. For each layer \ell , RSA is performed by vectorizing the upper-triangular entries (i