LLMs syntactically adapt their language use to their conversational partner
Florian Kandra, Vera Demberg, Alexander Koller · 2025
Read LLMs syntactically adapt their language use to their conversational partner by Florian Kandra, Vera Demberg, Alexander Koller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07457.txt.
Introduction
People in conversation drift toward each other's way of speaking, and a 2025 paper by Florian Kandra, Vera Demberg, and Alexander Koller asks whether chatbots do the same. The team built a corpus of conversations between large language models and tracked their sentence choices over time.
As the chats went on, the two models' syntax grew more alike. That drift confirms that modern language models adapt their language use to a partner, at least in a basic way. The finding matters for anyone building agents that talk with people or with each other for long stretches. It also gives researchers a clean test bed for studying how machine talk settles into shared habits.
Catalog record
| CREATOR | Florian Kandra, Vera Demberg, Alexander Koller |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-07457
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLMs syntactically adapt their language use to their conversational partner Florian Kandra, Vera Demberg, Alexander Koller Abstract It has been frequently observed that human speakers align their language use with each other during conversations. In this paper, we study empirically whether large language models (LLMs) exhibit the same behavior of conversational adaptation. We construct a corpus of conversations between LLMs and find that two LLM agents end up making more similar syntactic choices as conversations go on, confirming that modern LLMs adapt their language use to their conversational partners in at least a rudimentary way. 1 Introduction It has been documented broadly that when humans talk to each other, they adapt their language use to their communication partners by coordinating their behavior and language. Humans align not only their gestures, posture, and speech rate ( Holler and Wilkin 2011 ; Shockley et al. 2009 ; Jungers and Hupp 2009 ) , but also their linguistic decisions at deeper levels, such as semantics and syntax Bock 1986 ; Garrod and Anderson 1987 . In other words, the distribution over syntactic structures of two human speakers becomes more similar as a conversation progresses. In this paper, we investigate whether large language models (LLMs) adapt their syntactic choices to their conversational partners as well. While it is well known that LLMs can be explicitly prompted towards embodying different “personas” and changing the style of the language they generate Deshpande et al. 2023 ; Thillainathan and Koller 2025 , it is unclear whether merely being present in a conversation with an interlocutor is sufficient to make LLMs adapt their language use to their interlocutor’s. The ability to adapt to the communication partner’s language is associated with increased success in goal-oriented conversations Reitter and Moore 2014 , and it enables a dialogue system to meet a user’s language use rather than requiring the user to adapt to the system Schlangen 2022 . Language models will only serve as effective foundations for dialogue systems if they prove capable of implicitly adapting to a user’s language. To this end, we create a new dataset of conversations between LLMs in which both LLMs are prompted to initially exhibit different language use. We then measure the dynamics of syntactic language adaptation over the course of the conversations, using a method adapted from the human-human analysis of Reitter and Moore 2014 . We find that GPT-4o Hurst et al. 2024 conversations show statistically significant adaptation when comparing syntactic repetitions within conversations against repetitions across conversations, replicating Reitter’s findings for human conversations. We further show this is a continuous process active throughout conversations and conclude by discussing whether these findings demonstrate “human-like” alignment in LLMs. 2 Background As we mentioned above, humans adapt their language use to their communication partners across various linguistic levels. In this paper, our focus is on syntactic adaptation: Do the distributions over the syntactic structures that two interlocutors produce become more similar over the course of a conversation? In the psycholinguistics literature on human communication, two separate (but not exclusive) mechanisms have been proposed to explain the mutual adaptation of language use. Rasenberg et al. 2020 contrast two theoretical views that explain the process through alignment on different cognitive levels: on a conscious level, in which cooperative decisions establish a situational common ground Brennan and Clark 1996 , and a subconscious level, in which automatic priming leads to aligned representational states Pickering and Garrod 2004 . In psycholinguistics, priming refers to a process in which encountering a word or construction temporarily increases the activation of a cognitive representation, thereby increasing the probability for the word or construction to be reproduced. In this paper, we study the conversational behavior of artificial, LLM-based agents. We will primarily focus on the level of outwardly observable changes to the language use and describe it with the theory-neutral word adaptation . We will discuss in Section 5 the extent to which concepts like alignment and priming can apply to LLMs. Related Work. The only study to date examining adaptation in LLMs Cai et al. 2024 focused on short-term syntactic adaptation. They showed that ChatGPT and Vicuna are more likely to complete a sentence with a double object or a prepositional object when primed with a sentence of the respective type. We extend this research to long conversations with natural sentences rather than carefully constructed one-sentence stimuli. 3 Measuring human-human adaptation The phenomenon of long-term syntactic adaptation was first measured on corpora of human-human dialogues by Reitter and Moore 2014 . The basic idea is to determine whether the usage frequency of a syntactic structure (specifically, a rule in a context-free grammar) in the first half of a conversation has a statistical impact on its frequency in the second half. We follow Reitter in splitting each conversation in a dialogue corpus into two parts. We call the first 49% of each conversation Prime and the last 49% of each conversation Target ; the middle 2% are discarded to ensure that we measure long-term adaptation as opposed to short-term priming. On corpora that are not already syntactically annotated, we parse each conversation with the Neural Berkeley Parser 1 1 1 We used the benepar_en3_large model of the benepar python package for parsing and spacy ’s en_core_web_md model for tokenization. Kitaev and Klein 2018 ; Kitaev et al. 2019 , to obtain a set of context-free production rules for the Prime and Target section of each conversation, respectively. Adaptation takes place if rule repetitions are more likely between the Prime and Target of the same conversation (where adaptation is possible), compared to a Prime and Target of different conversations (where no adaptation could have taken place). To make this comparison, we draw two samples for each rule across the Target s of all conversations: one for which we check whether the rule has been uttered by the other speaker in the Prime of the same conversation, and the other for which we check whether the rule has been uttered by a speaker in a random, unrelated conversation. We encode the presence of a rule in a binary variable Prime for each sample, which is 1 if the rule is present. Another binary variable, SameConv , is used to indicate whether we looked for a prime in the same conversation ( 1 ) or in a different, random conversation ( 0 ). If repetitions are more likely between speakers within conversations, such that we see an effect of SameConv on Prime , we take that as evidence of cross-speaker adaptation. We further include features representing the log-frequency of rules across all conversations ( ln(Freq) ), as more frequent rules are expected to be more likely to appear in any Prime , and a variable ln(Size) . This second variable encodes the amount of different rules that a speaker used in the Prime of a conversation, i.e. the size of the set of rules that we use to look for a prime; a larger set increases the probability of any rule to occur. We follow Reitter and Moore 2014 in excluding rules that appear only once in the whole dataset and rules that have disproportionately high frequencies (around 0.3\% of each dataset), because these rules are