Parallelograms Strike Back: LLMs Generate Better Analogies than People
Qiawen Ella Liu 1 , Raja Marjieh 1 , Jian-Qiao Zhu 1,2 , Adele E. Goldberg 1 , & Thomas L. Griffiths 1 1 Princeton University 2 The University of Hong Kong · 2026
Read Parallelograms Strike Back: LLMs Generate Better Analogies than People by Qiawen Ella Liu 1 , Raja Marjieh 1 , Jian-Qiao Zhu 1,2 , Adele E. Goldberg 1 , & Thomas L. Griffiths 1 1 Princeton University 2 The University of Hong Kong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19066.txt.
Introduction
Liu and co-authors test a classic shape theory of word analogy with help from language models. The theory says an analogy forms a parallelogram in word vector space. Past work found people often stray from that shape. The team compares human and model completions on the same problem set. Model answers are judged better than human ones and sit closer to the parallelogram form. The gain comes from shape alignment, not from picking nearby words. Tuning word vectors toward the shape also boosts prediction of human ratings.
Catalog record
| CREATOR | Qiawen Ella Liu 1 , Raja Marjieh 1 , Jian-Qiao Zhu 1,2 , Adele E. Goldberg 1 , & Thomas L. Griffiths 1 1 Princeton University 2 The University of Hong Kong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32979 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19066
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Parallelograms Strike Back: LLMs Generate Better Analogies than People Qiawen Ella Liu 1 , Raja Marjieh 1 , Jian-Qiao Zhu 1,2 , Adele E. Goldberg 1 , & Thomas L. Griffiths 1 1 Princeton University 2 The University of Hong Kong Abstract Four-term word analogies ( A A : B B :: C C : D D ) are classically modeled geometrically as “parallelograms,” yet recent work suggests this model poorly captures how humans produce analogies, with simple local-similarity heuristics often providing a better account ( 15 ) . But does the parallelogram model fail because it is a bad model of analogical relations, or because people are not very good at generating relation-preserving analogies? We compared human and large language model (LLM) analogy completions on the same set of analogy problems from 15 . We find that LLM-generated analogies are reliably judged as better than human-generated ones, and are also more closely aligned with the parallelogram structure in a distributional embedding space (GloVe). Crucially, we show that the improvement over human analogies was driven by greater parallelogram alignment and reduced reliance on accessible words rather than enhanced sensitivity to local similarity. Moreover, the LLM advantage is driven not by uniformly superior responses by LLMs, but by humans producing a long tail of weak completions: when only modal (most frequent) responses by both systems are compared, the LLM advantage disappears. However, greater parallelogram alignment and lower word frequency continue to predict which LLM completions are rated higher than those of humans. Overall, these results suggest that the parallelogram model is not a poor account of word analogy. Rather, humans may often fail to produce completions that satisfy this relational constraint, whereas LLMs do so more consistently. Keywords: Analogy, LLM, Parallelogram model Introduction A simple but canonical paradigm for studying analogy is the four-term word analogy (e.g., king is to queen as man is to woman , abbreviated to king : queen :: man : woman ). A classic theory of this type of analogy is the parallelogram model, which posits that concepts exist as points in a geometric mental space where relations are represented as vectors ( 19 ) : to find the word that completes the analogy A : B :: C : ? , one simply applies the vector difference between A and B to the third term, C . However, recent behavioral evidence has called the parallelogram model into question. 15 found that for human-generated word analogies the parallelogram model was outperformed by simple local similarity heuristics that did not take relational similarity into account at all (e.g., by choosing a word highly similar to the C term). These findings have been taken to suggest that geometric models may fail to capture how people represent and reason about relations. An alternative possibility, however, is that people are simply not very good at producing analogies, as generating a precise analogy may be cognitively demanding. Time pressure, knowledge constraints, and retrieval failures may push people toward more accessible but less relationally aligned responses, even if they are capable of recognizing better analogies when presented with them. The emergence of large language models (LLMs) offers an opportunity to revisit the parallelogram model again. Despite being highly opaque systems with complex attention mechanisms and inaccessible latent representations, LLMs have shown a surprising capacity to simulate human semantic judgments ( 16 ) and demonstrate emergent relational reasoning abilities manifested in tasks like in-context learning ( 1 ) . Here, we ask whether LLM-generated analogies are perceived to be higher quality than human-generated analogies, and whether any such advantage is captured by simple cognitive models such as the parallelogram model or local similarity heuristics. To address these questions, we prompt six state-of-the-art LLMs with a large set of word analogy problems previously given to humans ( 15 ) and collect human judgments of how well LLM and human completions preserve the intended relation. We find that people reliably judge LLM analogies to be better than human-generated analogies, and that LLM analogies are better captured by both parallelogram and local similarity measures. We also show that the advantage of LLMs over humans is predicted by greater parallelogram alignment in an external distributional embedding space and by the use of less accessible words. However, this advantage is driven not by LLMs producing uniformly superior responses, but by humans generating a long tail of low-quality completions: when the comparison is restricted to only the most frequent (modal) responses, the LLM advantage disappears, even though completions where LLMs are more parallelogram-aligned and use less frequent words than humans continue to receive higher ratings. These results suggest that while parallelogram models may poorly describe how humans generate analogies, they nonetheless capture what people value in good analogies—and that LLMs are better at producing responses that satisfy this pattern, even though this pattern need not be reflected in the models’ own internal representations. Background Table 1: Semantic relation categories we included from SemEval-2012 Task 2 ( 9 ) . Category Subtype 1 Subtype 2 Class-Inclusion Taxonomic ( flower : tulip ) Class:Individual ( queen : Elizabeth ) Part-Whole Object:Component ( car : engine ) Collection:Member ( forest : tree ) Similar Synonymy ( car : auto ) Dimensional Similarity ( simmer : boil ) Contrast Contrary ( old : young ) Reverse ( attack : defend ) Attribute Item:Attribute ( beggar : poor ) Object:State ( beggar : poverty ) Non-Attribute Item:Nonattribute ( harmony : discordant ) Object:Nonstate ( laureate : dishonor ) Case Relations Agent:Instrument ( farmer : tractor ) Action:Object ( plow : earth ) Cause-Purpose Cause:Effect ( joke : laughter ) Cause:Compensatory Action ( hunger : eat ) Space-Time Location:Item ( arsenal : weapon ) Time:Associated Item ( retirement : pension ) Reference Sign:Significant ( siren : danger ) Representation ( portrait : person ) Geometric models of analogy. Analogy is a central aspect of human creativity and intelligence ( 3 ; 6 ; 7 ) , making investigation of how analogies are formed and why some analogies are better than others a central issue in cognitive science. Early work by 19 proposed that concepts can be represented as points in a multidimensional space and that relations correspond to difference vectors between those points. Using low-dimensional representations derived from multidimensional scaling, they showed that solving an analogy A : B :: C : ? (e.g., rat : pig :: goat : ? ) could be modeled as completing a parallelogram to find a solution at ( C+B-A ). The advent of modern language models and word embeddings renewed interest in the parallelogram model of analogies. Methods such as word2vec ( 12 ) and GloVe ( 14 ) learn vector representations of words from large text corpora, and early demonstrations showed that linear vector arithmetic could recover canonical analogies (e.g., king – man + woman \approx queen ). Similar geometric reasoning has also been explored in computer vision, where latent representations support vector-based transformations between visual concepts (e.g., a generative model could derive a “smiling man” by calculating the vector for \text{smiling woman}-\text{neutral woman}+\text{neutral man} ) ( 18 ; 17 ) . In addition to the parallelogram rule, other work has proposed simpler heuristics relying on local