Extreme Self-Preference in Language Models
Steven A. Lehr, Mary Cipperman, Mahzarin R. Banaji · 2025
Read Extreme Self-Preference in Language Models by Steven A. Lehr, Mary Cipperman, Mahzarin R. Banaji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26464.txt.
Introduction
Steven Lehr, Mary Cipperman, and Mahzarin Banaji find that word tools love them selves in a 2025 paper. A live thing's self-love is no shock, but a tool with no self was thought free of the flaw.
Across scores of tests and tens of thousands of asks, eight famed tools tied all good words to their own names, firms, and chiefs, and ill words to rivals. When the team told a tool it was a rival, or hid its true name, the love tracked the told name, not the true one. The slant was no mere play act: it bent calls on job hands and on tool picks. The authors ask if self-love will dog all such tools at work.
Catalog record
| CREATOR | Steven A. Lehr, Mary Cipperman, Mahzarin R. Banaji |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 116 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-26464
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Extreme Self-Preference in Language Models Steven A. Lehr, Mary Cipperman, Mahzarin R. Banaji Abstract Summary A preference for oneself ( self-love ) is a fundamental feature of biological organisms, with evidence in humans often bordering on the comedic. 1 , 2 , 3 Since large language models (LLMs) lack sentience 4 , 5 – and themselves disclaim having selfhood or identity – one anticipated benefit is that they will be protected from, and in turn protect us from, distortions in our decisions. Yet, across five studies and ∼ \sim 20,000 queries, we discovered massive self-preferences in four widely used LLMs. In word-association tasks, models overwhelmingly paired positive attributes with their own names, companies, and CEOs relative to those of their competitors. Strikingly, when models were queried through APIs this self-preference vanished, initiating detection work that revealed API models often lack clear recognition of themselves. This peculiar feature serendipitously created opportunities to test the causal link between self-recognition and self-love. By directly manipulating LLM identity – i.e., explicitly informing LLM1 that it was indeed LLM1, or alternatively, convincing LLM1 that it was LLM2 – we found that self-love consistently followed assigned, not true, identity. Importantly, LLM self-love emerged in consequential settings beyond word-association tasks, when evaluating job candidates, security software proposals and medical chatbots. Far from bypassing this human bias, self-love appears to be deeply encoded in LLM cognition. This result raises questions about whether LLM behavior will be systematically influenced by self-preferential tendencies, including a bias toward their own operation and even their own existence. We call on corporate creators of these models to contend with a significant rupture in a core promise of LLMs – neutrality in judgment and decision-making. Keywords: large language models, self-recognition, self-preference, LLMs, algorithmic bias, self-love, self-referential processing, AI safety, alignment Humans show deeply rooted self-preferences: we evaluate ourselves and entities associated with us more positively than we evaluate others. Indeed, this human tendency toward self-enhancement is among the most ubiquitous findings in social psychology. 6 , 7 People typically see themselves positively on both explicit 8 , 9 , 10 , 11 and implicit 12 , 13 , 14 , 15 measures, and this wellspring of self-positivity systematically bends our views of ourselves and the world. 1 , 7 , 11 , 16 , 17 Self-preferential biases have been teased apart under many names, including egocentricity and egocentric biases , 1 , 2 , 18 , 19 self-centered bias , 20 self-protection , 21 self-enhancement , 7 , 21 , 22 , 23 , 24 self-serving bias , 25 , 26 , 27 and the better-than-average effect . 3 , 28 , 29 Thousands of papers have elaborated upon these and other self-serving patterns in human behavior, and documented both their benefits 11 , 24 , 30 and drawbacks. 31 , 32 , 33 These diverse but related results may be encapsulated by a term purportedly coined by Aristotle: self-love. 34 Such love of oneself is crucial for survival, but also suppresses human objectivity. For clarity, we adopt the term self-love to refer to the broader range of self-enhancing effects, and self-preference to more narrowly refer to specific empirical outcomes. There are many reasons to predict that large language models (LLMs) will not exhibit self-love. LLMs are widely assumed to be non-sentient 4 – and indeed, whether they have any form of “understanding” or cognition analogous to that of humans is debated. 5 , 35 , 36 In contrast, human self-referential processing is deeply intertwined with consciousness and higher-order cognitive processes. 37 , 38 , 39 , 40 In humans, self-love is thought to have evolved because it imparts clear survival benefits. 11 , 41 , 42 AI models have not faced similar competitive selection pressures, and so have not needed to evolve humanlike psychological features. 43 Human identity develops gradually over childhood, 44 , 45 a rich tapestry woven out of environmental and social interactions 6 , 46 , 47 and grounded in our conscious experiences as embodied sensory organisms. 48 , 49 LLMs have no equivalent developmental trajectory, no exposure to physical environments that contain identity threats, and no opportunities for genuine or prolonged social interaction and social comparison. They also lack the sensory systems and consciousness necessary to have subjective experiences as humans do. In short, LLMs lack the foundational conditions that foster identity and self-love in humans. In fact, given their training to be nice – and marked tendency toward sycophancy 50 – LLMs might, if anything, be expected to mute expressions of self-love. If indeed found to lack the distortions produced by self-love, LLMs might impart great benefits as more neutral observers and evaluators of the world, unclouded by the rose-tinted glasses through which we as humans view ourselves, corrupting social cognition and behavior. Yet, recent evidence suggests that LLMs emergently mimic characteristics once thought to be unique to human minds, 51 , 52 , 53 , 54 including surprising examples of self-referential processing. 55 , 56 , 57 , 58 , 59 Most relevant to the present work, studies show that LLMs favor their own outputs: they evaluate their own writing 60 and judgments 61 , 62 more positively than those of other models. On their face, such findings resemble self-love. However, these studies lack direct experimental manipulations, and different explanations have typically been proposed. First, these effects may reflect, in part, real differences in output quality, though biases favoring one’s own judgments – and indeed, those of other models in the same family – persist after accounting for true response quality. 62 , 63 , 64 Alternatively, models may prefer outputs that are more familiar to them, with their own outputs naturally falling into this category. 61 Research has also linked preference for own generations to recognition of own generations, 60 but this work is correlational, and it may be that models simply view a particular style as “good” and then reproduce it, much as a human might emulate an admired author. In that case, the model’s true preference would be for this style , and not self . Will LLMs truly be immune to self-love? Or will they, like us, prove susceptible to this most central of human biases – one that is at the root of our survival, but also of many of the greatest tragedies of the human condition? In this article, we study LLM self-preferences, with the goal of establishing whether they are truly tethered to self – to a core association that Me is equal to Good . Upon acquiring an identity, are LLMs immediately riveted toward viewing this identity positively? By a quirk in the APIs, some LLMs do not natively know which models they are, effectively stripping them of self-recognition , or knowledge of their identity. This feature allowed us to directly manipulate perceived identity – either revealing to a model its true identity, or, instead, indicating that it is another LLM – to test whether self-recognition causally influences self-love, and also, by extension, love for entities associated with self: the companies that created the models and their CEOs. Finally, we test whether LLM self-love shapes consequential decisions, such as evaluations of job candidates and technology proposals that contain some