Are LLMs good pragmatic speakers?
Mingyue Jian, N. Siddharth · 2024
Read Are LLMs good pragmatic speakers? by Mingyue Jian, N. Siddharth (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01562.txt.
Description
Abstract Large language models ( LLM s) are trained on data assumed to include natural language pragmatics, but do they actually behave like pragmatic speakers? We attempt to answer this question using the Rational Speech Act ( RSA ) framework [ 9 , 10 ] , which models pragmatic reasoning in human communication.
Catalog record
| CREATOR | Mingyue Jian, N. Siddharth |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-01562
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Are LLMs good pragmatic speakers? Mingyue Jian, N. Siddharth Abstract Large language models ( LLM s) are trained on data assumed to include natural language pragmatics, but do they actually behave like pragmatic speakers? We attempt to answer this question using the Rational Speech Act ( RSA ) framework [ 9 , 10 ] , which models pragmatic reasoning in human communication. Using the paradigm of a reference game constructed from the TUNA [ 27 ] corpus, we score candidate referential utterances in both a state-of-the-art LLM (Llama3-8B-Instruct) and in the RSA model, comparing and contrasting these scores. Given that RSA requires defining alternative utterances and a truth-conditional meaning function , we explore such comparison for different choices of each of these requirements. We find that while scores from the LLM have some positive correlation with those from RSA , there isn’t sufficient evidence to claim that it behaves like a pragmatic speaker. This initial study paves way for further targeted efforts exploring different models and settings, including human-subject evaluation, to see if LLM s truly can, or be made to, behave like pragmatic speakers. 1 Introduction With the emergence of large language models ( LLM s) [ 4 , 1 , 6 , 14 , 15 , 25 , 26 ] , a key question arises: can these models, trained on data presumed to include natural language pragmatics, exhibit pragmatic reasoning akin to humans? While LLM s have demonstrated formal linguistic competence (adherence to linguistic rules), their functional competence in pragmatic language use remains uncertain and warrants further investigation [ 17 ] . Although much research has focused on evaluating LLM s’ pragmatic abilities as listeners, particularly their comprehension of non-literal language [ 12 , 16 , 23 , 24 , 19 ] , less attention has been given to their pragmatic capabilities as speakers. Specifically, it remains unclear whether LLM s can effectively use context to generate non-literal utterances; i.e., being informative beyond being simply true . Investigating this aspect is crucial for deepening our understanding of LLM s’ generative processes and enhancing their reliability. Humans are typically pragmatic agents in communication. Imagine a room with three pieces of furniture: a small red desk, a small yellow desk, and a large red chair. If a friend directs your attention to “the red one”, you would first eliminate the yellow desk as a possibility. Given the remaining red objects, your reasoning would then likely discount the chair, on account of it being distinct in the room, and that if it were the intended referent, the simpler utterance would have been just “the chair”. This finally leads you to the intended referent being the small red desk. This recursive reasoning process that takes informativity into account beyond simply being literally true, encapsulates pragmatic communication. A particularly influential model of pragmatic communication is the Rational Speech Act ( RSA ) framework [ 10 , 7 ] which quantitatively models theory of mind [ 8 , 21 ] , formalising how speakers and listeners use context, shared knowledge, and probabilistic reasoning to communicate effectively. This framework operates language understanding as a recursive process, where both speakers and listeners in a conversation behave rationally to reason each other’s intention. In the earlier example, when a friend refers to “the red one”, you exclude the yellow desk as a literal listener, guided by a “meaning function” that checks alignment with the words. The pragmatic speaker, your friend, chooses words with the expectation that you, as the listener, will interpret them correctly. As a pragmatic listener, you refine your interpretation, using both the message and context to infer intent. This interaction between speaker and listener, each considering the other’s perspective, is key to effective communication, as modelled by the RSA framework. Nguyen [20] applies the RSA framework to view RLHF-fine-tuned language models as bounded pragmatic speakers, where RLHF equips the LLM with a “theory of mind” listener model. This enables the LLM to anticipate listener interpretation when computing the distribution of the pragmatic speaker. However, this study does not examine the pragmatic generation ability of unmodified LLM . Carenini et al. [5] examines vanilla LLM s’ pragmatic reasoning using RSA to find that GPT-2 XL’s reasoning aligns with RSA in a metaphor task structured as “ X is Y ”, with a restricted meaning and utterance space. However, this focuses on the LLM as a listener ; we instead propose using a reference game to compare LLM scores as a speaker against RSA using a natural language format aligned with LLM training data. Additionally, we explore how the alignment varies with different sources of alternative utterances and RSA models that employ distinct meaning functions. Our results indicate that our vanilla LLM model (Llama3-8B-Instruct [ 26 ] ) has a positive correlation with the two RSA models that employ different meaning functions in the context of the reference game task, the correlation is stronger when scoring the logic-constructed utterances, and when the RSA model is with a rule-based meaning function. However, we do not see a clear alignment of the LLM ’s pragmatic scoring with that from the RSA models. 2 Rational Speech Act Model (RSA) The RSA model iteratively refines a heterogeneous relation between alternative utterances U and intended meanings O , such that the relations begin being purely literal, and is refined using pragmatic reasoning: U\times O\to[0,1] . The framework begins with a literal listener L_{lit} : \displaystyle P_{L_{lit}}(o|u) \displaystyle\propto M(u,o)\cdot P(o),\qquad (1) where, in the context of our reference game, each object is equally likely to be selected, resulting in a uniform prior P(o) . Thus, the literal listener’s interpretation relies entirely on the meaning function M() . The pragmatic speaker P_{S_{p}} is constructed from a literal listener L_{lit} : \displaystyle P_{S_{p}}(u|o) \displaystyle\propto e^{\alpha(\ln P_{L_{lit}}(o|u)-\ln|u|)}=\left(\frac{P_{L_{lit}}(o|u)}{|u|}\right)^{\alpha}. (2) Here, |u| is the utterance length imposing a cost on longer productions. This cost function aligns with the maxims of a pragmatic speaker [ 11 ] , favouring the use of fewer attributes to convey the intended meaning within a controlled attribute space. Additionally, this approach ensures that comparisons between the RSA models and LLM remain valid. The preset prompt to the LLM (Appendix B ) instructs it to describe the object using as few words as possible, effectively serving as a cost function that indirectly penalises longer outputs. \alpha is a parameter that scale the rational level of S_{p} . A higher \alpha will sharpen the probability distribution and vice verse. 2.1 RSA model with different meaning functions We construct two RSA models with different meaning functions (MFs) for further investigation. They take the form U\to[0,1] , indicating whether the utterance u literally describes the object o . Prompt-based MF: This leverages the natural language understanding capabilities of LLM s for scoring. We use prompt engineering to generate numeric scores from the LLM , employing 3-shot prompting to guide the model with input-output examples that establish a fixed output template (Figure 9 in Appendix F ). The prompt-based meaning function is defined as: M_{\text{p}}(u,o)=\frac{P(\text{Yes}\>|\>\text{{LLM}}(o,u))}{P(\text{Yes}\>\cup\>\text{No}\>|\>\text{{LLM}}(o,u))}, (3) representing the probability of the model answering “Yes”. The prompt template is refined through a process of trial and error (Appendix F ). Rule-based MF : This is based on feature