Evaluating Adjective-Noun Compositionality in LLMs: Functional vs Representational Perspectives

Ruchira Dhar Qiwei Peng Anders Søgaard · 2026

Read Evaluating Adjective-Noun Compositionality in LLMs: Functional vs Representational Perspectives by Ruchira Dhar Qiwei Peng Anders Søgaard (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09994.txt.

Introduction

Ruchira Dhar, Qiwei Peng and Anders Søgaard test how language models handle adjective noun composition, a core part of language. They probe the skill two ways: by task prompts and by reading the models' internal states. A striking split appears, since models build sound compositional representations inside yet fail to use them reliably in task answers. The gap, they argue, shows why contrastive evaluation gives a fuller picture of model skill.

Catalog record

CREATORRuchira Dhar Qiwei Peng Anders Søgaard
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29639
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09994

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating Adjective-Noun Compositionality in LLMs: Functional vs Representational Perspectives Ruchira Dhar Qiwei Peng Anders Søgaard Abstract Compositionality is considered central to language abilities. As performant language systems, how do large language models (LLMs) do on compositional tasks? We evaluate adjective–noun compositionality in LLMs using two complementary setups: prompt-based functional assessment and a representational analysis of internal model states. Our results reveal a striking divergence between task performance and internal states. While LLMs reliably develop compositional representations, they fail to translate consistently into functional task success across model variants. Consequently, we highlight the importance of contrastive evaluation for obtaining a more complete understanding of model capabilities. 1 Introduction Compositionality —the ability of systems to generate complex meanings from simpler parts— is often considered a key factor in human language processing Smolensky 1987 ; Fodor and Pylyshyn 1988 ; Partee et al. 1995 ; Townsend et al. 2018 ; Donatelli and Koller 2023 . Today, large language models (LLMs) are considered highly performant natural language systems Min et al. 2023 . This has led to questions on the compositionality of such models Saba 2023 ; Mahowald et al. 2024 ; McCurdy et al. 2024 : if compositionality is key to language, then are LLMs compositional as well? 1 1 1 Non-compositional LLMs have been argued to at least be conceivable Block 1981 ; Bender et al. 2021 . Early empirical work investigated compositionality in neural models with tasks like SCAN Lake and Baroni 2018 , COGS Kim and Linzen 2020 , and PCFG Hupkes et al. 2020 . However, these paradigms are a poor fit for modern pretrained LLMs: they rely on controlled train–test splits designed for models trained from scratch, and many use synthetic or restricted fragments of English that are likely already represented in large-scale pretraining corpora. More recently, compositionality has been evaluated in LLMs through functional task-based assessments Pavlick and Callison-Burch 2016 ; Bertolini et al. 2022 ; Sun et al. 2024 ; Xu et al. 2024 ; Zhang et al. 2024 ; Dziri et al. 2024 ; Ma et al. 2024 , alongside methods aimed at improving performance on such tasks SHAO et al. 2023 ; Drozdov et al. 2023 ; Press et al. 2023 ; Lu et al. 2024a ; Chen et al. 2024 ; Li et al. 2024b . In parallel, another line of work probes internal representations to identify compositional structure and layer-wise mechanisms Hewitt and Manning 2019 ; Murty et al. 2023 ; Kumon and Yanaka 2025 ; Peng et al. 2025 ; Guo et al. 2025 . Yet these functional and representational approaches are rarely evaluated side by side on the same models and tasks, making it difficult to determine whether they provide converging or divergent evidence about compositionality in LLMs. Recent work suggests that external task performance and internal representations may diverge in LLMs Lampinen et al. 2024 ; Orgad et al. 2025 — but does such divergence also apply to compositional abilities? Do functional task evaluations and representational analyses provide converging evidence of compositionality in LLMs? In this work, we address this gap by directly contrasting functional and representational evaluation within a unified experimental framework. We focus on adjective–noun compositionality and evaluate LLMs across three inference-based tasks capturing substitutivity, systematicity, and overgeneralization Hupkes et al. 2020 ; Hupkes et al. 2023 . For each model family, we measure task performance under scaling and instruction tuning and conduct a layer-wise analysis to assess compositional structure in internal representations. By comparing behavioral trends with representational signals across model variants, we seek to test whether the two paradigms yield converging empirical conclusions about compositionality in LLMs. LLaMA2 CodeLLaMA Qwen2.5-Coder Gemma2 Dataset 7B 7B-it 13B 7B 7B-it 13B 7B 7B-it 14B 2B 2B-it 9B AddOne (F1) 77.97 18.01 78.49 78.49 75.36 54.92 77.58 20.87 12.62 78.49 29.61 59.76 PLANE (F1) 36.70 33.73 35.35 33.33 42.67 33.33 33.33 34.57 38.14 33.33 33.33 36.84 CompComb (Acc) 66.67 72.59 45.93 95.56 71.11 93.33 77.04 73.34 71.11 77.04 73.33 45.19 Table 1: The results of all models on Addone, PLANE, and COMPCOMB datasets. 2 Experimental Setup To study compositionality, we focus on the domain of adjective–noun (AN) phrases. From a linguistic perspective, AN constructions are among the most frequent and semantically transparent instances of phrasal composition, making them a classic testbed for compositional semantics ( Partee et al. 1995 ; Kamp and Partee 1995 ; Guevara 2010 ; Hartung et al. 2017 ; Bertolini et al. 2021 ) . Crucially, meaning composition in this domain can be operationalized through inference: if the composed phrase preserves or alters entailment relations with its parts, the model must reason about semantic structure rather than rely on lexical associations Lebowitz 1983 ; Geiger et al. 2019 ; Donatelli and Koller 2023 . This inference-based framing has been central in both formal semantics ( Partee et al. 1995 ) and recent NLP evaluations of compositionality ( Pavlick and Callison-Burch 2016 ; Bertolini et al. 2022 ) . 2.1 Task Choice Compositionality in natural language can manifest in many forms, such as substitutivity, systematicity, and overgeneralization Hupkes et al. 2020 . We adopt one adjective-noun (AN) based task on meaning inference for each of these aspects: Substitutivity. Substitutivity requires that substituting a semantically compatible modifier preserves entailment Pickel and Szabó 2004 ; Werning et al. 2012 ; Hupkes et al. 2020 ; Li et al. 2024a . Let S(n) denote a sentence containing noun n , and S(an) its adjective-modified form. We define a binary entailment function: E\big(S(an),S(n)\big)=\begin{cases}1&\text{if }\llbracket S(an)\rrbracket\models\llbracket S(n)\rrbracket\\ 0&\text{otherwise.}\end{cases} (1) For example, entailment holds in The runner set a new record \models The runner set a record , since the adjective restricts but does not alter the core meaning. In contrast, entailment does not hold in The alleged thief was arrested \not\models The thief was arrested , as the adjective modifies the truth conditions of the noun phrase. We use the AddOne dataset Pavlick and Callison-Burch 2016 to evaluate substitutivity. Systematicity. Systematicity requires recombining known semantic relations to infer a novel one Cummins 1996 ; Symons and Calvo 2014 ; Hupkes et al. 2020 . Given two base entailments— an\models n and an\models h (with h a hypernym of n )—and must decide the composed entailment an\models ah , testing whether the adjective can be systematically carried across the noun–hypernym relation. We define a binary entailment function over the target inference: E(an,ah)=\begin{cases}1&\text{if }\llbracket an\rrbracket\models\llbracket ah\rrbracket\\ 0&\text{otherwise.}\end{cases} (2) We then consider three inference types: IT1: E(an,n) , IT2: E(an,h) , and IT3: E(an,ah) . For some adjectives, all inference types hold: red car \models car , red car \models vehicle , and red car \models red vehicle . While for others, IT1 and IT2 hold but IT3 fails: small elephant \models elephant , small elephant \models animal , but small elephant \not\models small animal . We use the PLANE dataset Bertolini et al. 2022 to evaluate systematic compositional inference. Overgeneralization. Overgeneralization occurs when compositional rules are incorrectly extended to expressions whose meanings do not transparently derive from their parts Macken 2014 ; Hupkes et al. 2020 ; Csordás 2023 . In adjective–noun phrases, the modifier typically preserves type membership (e.g., an denotes a subset of n ). However, exocentric compounds may contain the

Read the complete text