Grounded Concreteness: Human-Like Concreteness Sensitivity in Vision–Language Models
Aryan Roy, Zekun Wang, Christopher J. MacLellan · 2026
Read Grounded Concreteness: Human-Like Concreteness Sensitivity in Vision–Language Models by Aryan Roy, Zekun Wang, Christopher J. MacLellan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18065.txt.
Introduction
Aryan Roy, Zekun Wang, and Christopher J. MacLellan ask whether seeing makes a model more human in how it feels word concreteness. Their 2026 preprint compares vision-language models with text-only ones. People sense that some words name things you can touch, while others name abstract ideas. The team tests whether models share that sensitivity. They run a controlled comparison between matched Llama text backbones and their vision counterparts, using text-only prompts for both.
Keeping the prompts text-only makes the test fair. Any edge for the vision models must come from what image training taught them. The result bears on how grounding shapes language skill. It also informs debates about whether text alone can teach human-like word sense.
Catalog record
| CREATOR | Aryan Roy, Zekun Wang, Christopher J. MacLellan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18065
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Grounded Concreteness: Human-Like Concreteness Sensitivity in Vision–Language Models Aryan Roy, Zekun Wang, Christopher J. MacLellan Abstract Do vision–language models (VLMs) develop more human-like sensitivity to linguistic concreteness than text-only large language models (LLMs) when both are evaluated with text-only prompts? We study this question with a controlled comparison between matched Llama text backbones and their Llama Vision counterparts across multiple model scales, treating multimodal pretraining as an ablation on perceptual grounding rather than access to images at inference. We measure concreteness effects at three complementary levels: (i) output behavior, by relating question-level concreteness to QA accuracy; (ii) embedding geometry, by testing whether representations organize along a concreteness axis; and (iii) attention dynamics, by quantifying context reliance via attention-entropy measures. In addition, we elicit token-level concreteness ratings from models and evaluate alignment to human norm distributions, testing whether multimodal training yields more human-consistent judgments. Across benchmarks and scales, VLMs show larger gains on more concrete inputs, exhibit clearer concreteness-structured representations, produce ratings that better match human norms, and display systematically different attention patterns consistent with increased grounding. 1 Introduction Human meaning is not uniformly “linguistic”: some concepts are tightly linked to perception and action (e.g., apple, run ), while others are largely relational and context-dependent (e.g., stronger, justice ). A long tradition in cognitive science treats concreteness as a graded dimension of conceptual representation, with concrete words benefiting from richer sensory codes and exhibiting robust behavioral advantages over abstract words ( 31 ; 3 ) . Concreteness therefore offers a rare bridge between cognitive theory (how humans represent meaning) and computational diagnostics (how models encode and use meaning), enabling measurable tests of cognitive alignment between humans and modern language systems ( 13 ; 7 ) . More broadly, recent work in language acquisition argues that neural models can serve as hypothesis generators and testers for cognitive theories, provided we design analyses that connect internal mechanisms to behavioral signatures ( 33 ) . Figure 1: Comparison of concreteness rating distributions for selected words. For each word, we plot the empirical distribution of model-generated token ratings from Llama Vision (VLM) and Llama Text (LLM), alongside human norms from 7 . A central tension is that contemporary large language models (LLMs) learn from text alone, raising questions about whether “meaning” can be recovered from form without grounding ( 21 ; 4 ) . While distributional learning can capture many semantic regularities, the absence of perceptual experience may be especially consequential for concreteness : in humans, concrete concepts are supported by sensorimotor simulations and imagery-like codes ( 31 ; 3 ) . Vision-language models (VLMs) offer a natural testbed for this debate. By aligning text with visual representations (e.g., CLIP-style contrastive learning and instruction-tuned VLMs), VLMs may develop more human-like, graded concreteness representations than comparably sized text-only LLMs ( 34 ; 1 ; 25 ; 42 ) . Yet prior evidence connecting concreteness to model behavior and representations is difficult to interpret as a vision effect . On one hand, multimodal/distributional semantics work links concreteness to perceptual grounding and visual consistency ( 23 ; 22 ; 30 ) ; on the other hand, separate lines probe concreteness as an axis in embedding spaces using text-derived features ( 9 ; 48 ) . However, these strands rarely provide a controlled ablation that isolates the contribution of visual input, and they typically analyze a single level (task performance or representations) rather than jointly linking behavior, geometry, and processing dynamics. This motivates a controlled LLM–VLM ablation in which the language backbone is held as comparable as possible and the primary difference is access to vision, allowing the contribution of visual grounding to be isolated. In this work, concreteness awareness is evaluated under this ablation by triangulating evidence across three complementary levels of analysis. First, at the output level , we ask whether VLM accuracy on question answering increases with the concreteness of the queried concepts. We further elicit model-produced concreteness ratings (token-level) and measure their alignment with human norms (Figure 1 ) ( 13 ; 7 ) . Second, at the embedding level , we test whether token representations organize by graded concreteness by projecting token-level embeddings into a low-dimensional space (t-SNE) and measuring within-bin compactness via intra-cluster dispersion across concreteness bins. Third, at the attention level , we quantify contextual dependence as the entropy of each token’s self-attention distribution: if abstract meaning is more compositionally supported by surrounding context, abstract tokens should exhibit broader, higher-entropy attention, whereas concrete tokens should exhibit sharper, lower-entropy attention concentrated on fewer positions. This prediction aligns with classic context availability accounts of concreteness effects in psycholinguistics, which argue that abstract words benefit more from supportive context for comprehension than concrete words ( 38 ; 37 ) . Our analyses are designed as a vision ablation for semantic grounding: holding the base language model family and scaling regime as constant as possible, we ask what changes when vision is introduced. This yields a coherent story linking classic cognitive accounts of concreteness—dual coding and grounded cognition ( 31 ; 3 ) —to measurable signatures in modern foundation models: (i) behavioral sensitivity to concreteness in downstream QA, (ii) representational geometry that recovers a concreteness ordering, and (iii) contextual dependence reflected by attention entropy. Contributions. We make following contributions: (1) a controlled LLM–VLM ablation study that isolates the effect of visual grounding on concreteness awareness across matched model families and scales; (2) output-level evidence that tests concreteness sensitivity in QA and quantifies alignment between model-elicited concreteness ratings and human norms; (3) internal diagnostics connecting grounding-based accounts to model representations and processing, including concreteness-conditioned clustering in embedding space (t-SNE with intra-cluster dispersion) and attention-entropy measures of contextual dependence motivated by context-availability theories of abstract meaning. 2 Related work 2.1 Measuring concreteness in language Concreteness is a graded psycholinguistic property that captures how directly a concept can be experienced through the senses, and it has been extensively measured through human norming studies. Classic resources such as the MRC Psycholinguistic Database provide lexical attributes including concreteness/tangibility judgments ( 13 ) , and later large-scale norms substantially expand coverage and improve reliability for modern evaluation settings ( 7 ) . In parallel, computational work has proposed algorithmic approximations of concreteness. Early NLP approaches connected concreteness-related cues to figurative language phenomena, using concrete vs. abstract contextual signals for literal/metaphorical sense identification ( 43 ) . More recent methods treat concreteness prediction as a supervised estimation problem over distributional features and contextual representations ( 9 ) . A particularly relevant line incorporates visual information: “visual concreteness” can be operationalized via cross-image consistency within multimodal datasets ( 22 ) , and visually grounded learning objectives can shape linguistic structure and representations ( 39 ) . Given known context sensitivity (a word’s perceived concreteness can shift with discourse and reference), human norms provide an external anchor for evaluation, while model-produced ratings can be treated as context-conditioned distributions rather than fixed type-level attributes. 2.2 Grounding and vision language models Grounding-based accounts of meaning emphasize that linguistic symbols ultimately connect to perception and action, motivating the classic symbol-grounding problem ( 21 ) . In NLP, grounding has been studied through both definitional discussions and benchmark/task design, with critiques highlighting that “grounding” can mean different things depending