Rational Retrieval Acts: Leveraging Pragmatic Reasoning to Improve Sparse Retrieval

Arthur Satouf, Gabriel Ben-Zenou, Benjamin Piwowarski, Habiboulaye Amadou-Boubacar, Pablo Piantanida · 2025

Read Rational Retrieval Acts: Leveraging Pragmatic Reasoning to Improve Sparse Retrieval by Arthur Satouf, Gabriel Ben-Zenou, Benjamin Piwowarski, Habiboulaye Amadou-Boubacar, Pablo Piantanida (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03676.txt.

Introduction

Arthur Satouf, Gabriel Ben Zenou, Benjamin Piwowarski, Habiboulaye Amadou Boubacar, and Pablo Piantanida present a 2025 paper on improving sparse search with ideas from linguistics. Sparse retrievers score documents term by term, ignoring how the rest of the collection shapes what a term means. The Rational Speech Acts framework asks how a speaker trims features to single out one object among many.

Adapted to search, the framework reweights each token by contrast with other documents. Representations become sharper, since common tokens count less and distinctive ones more. Added to several sparse models, the method improved results every time. On out-of-domain tests from the BEIR benchmark it reached top performance. Code is publicly available.

Catalog record

CREATORArthur Satouf, Gabriel Ben-Zenou, Benjamin Piwowarski, Habiboulaye Amadou-Boubacar, Pablo Piantanida
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03676

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rational Retrieval Acts: Leveraging Pragmatic Reasoning to Improve Sparse Retrieval Arthur Satouf, Gabriel Ben-Zenou, Benjamin Piwowarski, Habiboulaye Amadou-Boubacar, Pablo Piantanida Abstract . Current sparse neural information retrieval (IR) methods, and to a lesser extent more traditional models such as BM25, do not take into account the document collection and the complex interplay between different term weights when representing a single document. In this paper, we show how the Rational Speech Acts (RSA), a linguistics framework used to minimize the number of features to be communicated when identifying an object in a set, can be adapted to the IR case – and in particular to the high number of potential features (here, tokens). RSA dynamically modulates token-document interactions by considering the influence of other documents in the dataset, better contrasting document representations. Experiments show that incorporating RSA consistently improves multiple sparse retrieval models and achieves state-of-the-art performance on out-of-domain datasets from the BEIR benchmark. https://github.com/arthur-75/Rational-Retrieval-Acts Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3730239 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Novelty in information retrieval CCS: Information systems Probabilistic retrieval models CCS: Information systems Information retrieval diversity CCS: Information systems Document structure CCS: Information systems Content analysis and feature selection † † cc-license: by 1. Introduction The IR field evolved rapidly since the transformer architecture has been adopted to design various types of models, ranging from effective but less efficient cross-encoders ( Nogueira et al., 2019 ) to more efficient models based on dual architectures ( Hofstätter et al., 2021 ; Formal et al., 2024 ) . Among the latter, sparse neural IR models like e.g. SPLADE ( Formal et al., 2024 ) are state-of-the-art with a performance well above that of standard IR models like BM25 ( Robertson and Zaragoza, 2009 ) on most datasets. However, on the document representation side, ( Mackenzie et al., 2021 ) showed that transformer-based sparse IR model can produce “wacky weights” – i.e., term weights with limited discriminative power. This issue is compounded by the typically small number of query keywords, as well as the relatively low contrastive ability of existing models. Even traditional models such as BM25 do not fully capture the interplay among terms within documents. Another issue with sparse representations is on the query (user) side. Azzopardi and Zuccon ( Azzopardi and Zuccon, 2019 ) describe users as rational agents when they interact with a search engine: they seek to reduce the number of keywords they type. Such economy-based theories in IR echo the one of Grice in linguistics ( Grice, 1975 ) , that focuses on how people convey meaning beyond what is explicitly stated. These ideas have been mathematically formalized in the Rational Speech Acts (RSA) framework, proposed by Frank and Goodman ( Frank and Goodman, 2012 ) . RSA models human-like communication between a speaker and a listener by assuming a shared common knowledge among pragmatic agents that helps lower the communication cost (number of utterances) while keeping meaning unambiguous. While users behave as pragmatic speakers ( Azzopardi and Zuccon, 2019 ) , existing IR models are not pragmatic listeners ( Mackenzie et al., 2021 ) – and we argue here that this discrepancy can be reduced using the RSA framework, especially for out-of-domain adaptation. More precisely, we show that applying RSA to IR, to transform literal document representations to pragmatic ones, improves the performance of IR sparse models. Neural networks and modern IR models already capture meaning beyond individual token semantics, for example through attention mechanisms, but, in addition, we distinguish here between literal representations (before RSA is applied) and pragmatic representations (after RSA refines them). The word pragmatic here is to be understood in the sense of Bunt’s concept of pragmatic behavior ( Bunt, 2017 ) , that is acting in consideration of the context. RSA incorporates such context with the consideration of external information (in our case, all possibly queried documents and all tokens of the vocabulary). Cohn-Gordon et al. ( Cohn-Gordon et al., 2018 ; Cohn-Gordon and Goodman, 2019 ) first applied RSA to image captioning and machine translation to reduce ambiguity. In image captioning, RSA refines the output of a language generation model, ensuring the generated caption distinguishes the target image from others in the dataset. In translation, RSA modifies the English translation of a German sentence to ensure unambiguous meaning relative to other sentences in the set of sentences to translate. In both cases, the goal is produce the most suitable utterance possible regarding the context – which is the set of all possible meanings to be conveyed, i.e., still in Bunt’s sense ( Bunt, 2017 ) , the most pragmatic utterances. In other terms, RSA brings models up to humans pragmatic level. Just as in language tasks, we show in this paper that RSA enhances IR by making document representations more pragmatic. RSA has also been employed to model various linguistic phenomena ( Degen, 2023 ; Goodman and Frank, 2016 ; Degen et al., 2015 ; Frank, 2016 ) , and its simplicity and explainability make it a powerful tool for modeling human communicative behavior. However, this simplicity also poses challenges when scaling the RSA to real-world scenarios with significantly larger datasets. To date, only a few works have successfully integrated RSA with AI-driven language models, often requiring adaptations to the RSA mechanism itself ( Cohn-Gordon et al., 2018 ; Cohn-Gordon and Goodman, 2019 ; Shen et al., 2019 ; Kim et al., 2020 ; Kim et al., 2021 ) . Similarly, applying RSA to IR requires adjustments to handle large lexicons, leveraging sparse IR model outputs to our advantage. In this paper, we make the following contributions: • We introduce Rational Retrieval Acts (RRA), an adaptation of the RSA ( Frank and Goodman, 2012 ) for sparse IR models, carefully extending it to handle a large number of documents (meanings) and tokens (utterances). • We achieve significant performance improvements in out-of-domain sparse retrieval without increasing inference costs. 2. The Rational Retrieval Acts (RRA) To apply the RSA framework to IR, we map tokens from the vocabulary \mathcal{T} to RSA’s utterances and documents from the set \mathcal{D} to RSA’s meanings . For clarity, we use the IR terminology (tokens, documents) instead of the RSA’s (utterances, meaning). 2.1. Integrating the RSA RSA initially assumes that we can define a positive weight \mathcal{L}(t,d)\in\mathbb{R}^{+} for each token-document pair (t,d)\in\mathcal{T}\times\mathcal{D} . The function \mathcal{L} is called the Initial Lexicon. In this paper, we propose to derive \mathcal{L}(t,d) directly from the weights w_{t,d} predicted by a sparse IR model using the following equation: (1) \mathcal{L}(t,d)=f(w_{t,d})\ , where f represents a well chosen initial transformation function. RSA then defines the literal listener distribution over the documents conditioned on each token, L_{0}(d|t) . It represents how the IR model interprets t , indicating how likely each document d is to be relevant if t appears in the query. The formula defining L_{0} also includes a prior term \mathbf{P}(d) , which can serve the same role as in probabilistic approaches in information retrieval, e.g. (

Read the complete text