Bridging the Gap: From Ad-hoc to Proactive Search in Conversations Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and De

Chuan Meng, Francesco Tonolini, Fengran Mo, Nikolaos Aletras, Emine Yilmaz, Gabriella Kazai · 2025

Read Bridging the Gap: From Ad-hoc to Proactive Search in Conversations Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and De by Chuan Meng, Francesco Tonolini, Fengran Mo, Nikolaos Aletras, Emine Yilmaz, Gabriella Kazai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00983.txt.

Introduction

Chuan Meng and co-authors present Conv2Query, a bridge that lets ordinary search engines work inside conversations. Their paper appeared in 2025. Proactive search tries to fetch useful information during a chat before the user asks. Existing engines were trained on short, tidy queries, so feeding them long, noisy chat history works poorly. Tuning them on chat data helps only so much, because the input mismatch remains.

Conv2Query instead rewrites the conversation into a short query first. That query can feed an off-the-shelf engine directly, or the engine can be tuned further with it. Tests on two proactive search data sets showed clear gains both ways. The authors say translating context into queries is a simple, reusable fix for a growing class of search tools.

Catalog record

CREATORChuan Meng, Francesco Tonolini, Fengran Mo, Nikolaos Aletras, Emine Yilmaz, Gabriella Kazai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00983

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging the Gap: From Ad-hoc to Proactive Search in Conversations Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3729915 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Information retrieval Chuan Meng, Francesco Tonolini, Fengran Mo, Nikolaos Aletras, Emine Yilmaz, Gabriella Kazai Abstract . Proactive search in conversations (PSC) aims to reduce user effort in formulating explicit queries by proactively retrieving useful relevant information given conversational context. Previous work in PSC either directly uses this context as input to off-the-shelf ad-hoc retrievers or further fine-tunes them on PSC data. However, ad-hoc retrievers are pre-trained on short and concise queries, while the PSC input is longer and noisier. This input mismatch between ad-hoc search and PSC limits retrieval quality. While fine-tuning on PSC data helps, its benefits remain constrained by this input gap. In this work, we propose Conv2Query, a novel conversation-to-query framework that adapts ad-hoc retrievers to PSC by bridging the input gap between ad-hoc search and PSC. Conv2Query maps conversational context into ad-hoc queries, which can either be used as input for off-the-shelf ad-hoc retrievers or for further fine-tuning on PSC data. Extensive experiments on two PSC datasets show that Conv2Query significantly improves ad-hoc retrievers’ performance, both when used directly and after fine-tuning on PSC. † † cc-license: by (a) Ad-hoc search. Ad-hoc retrievers are typically trained on concise ad-hoc queries. (b) Proactive search in a multi-party conversation from the ProCIS dataset ( Samarinas and Zamani 2024 ) . Two avatars represent two users in the conversation. Prior work typically inputs lengthy and noisy conversational context (e.g., concatenated history and the current utterance) into ad-hoc retrievers. Figure 1 . Comparison between ad-hoc search and proactive search in conversations. 1. Introduction PSC ( PSC ) aims to retrieve relevant documents based on an ongoing conversation without an explicit query from the user ( Samarinas and Zamani 2024 ; Ros et al. 2023 ; Pal and Ganguly 2021 ; Ganguly et al. 2020 ; Andolina et al. 2018 ) . This contrasts with traditional ad-hoc or conversational search which typically follows the popular “query–response” ( Lai et al. 2025 ; Yoon et al. 2024 ; Ye et al. 2023 ; Jang et al. 2024 ) or “query–clarification” paradigms ( Lu et al. 2025 ; Zhang et al. 2024 ; Butala et al. 2024 ; Meng et al. 2023a ) , where users issue explicit queries, and then the system retrieves information or asks clarifying questions. PSC has been shown to not only reduce user effort in formulating and refining explicit queries in conversations, but also enrich conversations by proactively introducing relevant facts and ideas ( Andolina et al. 2018 ) . Specifically, PSC supports conversations in two key ways: (i) Conversation contextualisation ( Samarinas and Zamani 2024 ; Pal and Ganguly 2021 ; Ganguly et al. 2020 ) . PSC can proactively retrieve relevant documents to clarify concepts or fact-check claims, before the user explicitly asks for them ( Samarinas and Zamani 2024 ; Pal and Ganguly 2021 ; Ganguly et al. 2020 ) . E.g., Figure 1(b) , shows a conversation about “pancake”, where a user mentions a specific pancake “Staffs oatcake.” The search system returns a document explaining “Staffordshire oatcake,” helping the user understand it without needing to search manually (e.g., “What is a Staffs oatcake?” in Figure 1(a) ). (ii) Interest anticipation ( Samarinas and Zamani 2024 ; Ros et al. 2023 ) . PSC can proactively retrieve documents aligning with users’ next potential interests before they ask for them, also known as interest anticipation ( Samarinas and Zamani 2024 ; Ros et al. 2023 ) . As shown in Figure 1(b) , even without the current user utterance, after a user states, “it’s also nice to do one or two savoury,” the system proactively retrieves information about “Staffordshire oatcake,” a savoury pancake. By retrieving this information in advance, the system eliminates the need for a manual query (e.g., “What pancakes are savoury?”) and ensures a natural conversation flow. Motivation . Existing studies typically feed raw conversational context into off-the-shelf ad-hoc lexical/neural retrievers, or further fine-tune the neural ones on PSC using this raw context ( Samarinas and Zamani 2024 ; Ros et al. 2023 ) . However, previous work faces three key limitations: (i) Input gap between ad-hoc pre-training and PSC inference . Directly feeding raw conversational context into neural retrievers pre-trained on ad-hoc search data (e.g., MS MARCO ( Bajaj et al. 2016 ) ) leads to poor retrieval quality ( Ros et al. 2023 ) . This is due to the mismatch between the input format used in pre-training and inference: ad-hoc neural retrievers are pre-trained on short and concise queries, whereas in PSC , they receive longer and noisier conversational contexts. Such a distribution shift between training and inference hinders retrieval effectiveness ( Zhuang et al. 2022 ; Rau and Kamps 2022 ; Zhuang and Zuccon 2021 ) . (ii) Input gap between ad-hoc pre-training and PSC fine-tuning . While further fine-tuning ad-hoc neural retrievers on PSC data improves performance ( Samarinas and Zamani 2024 ; Ros et al. 2023 ) , the retrieval quality might still be limited by the input mismatches between the source ad-hoc search task (ad-hoc queries) and the target PSC task (conversational context). The discrepancy limits neural retrievers’ ability to fully leverage pre-trained ad-hoc knowledge, hindering effective transfer learning ( Shi et al. 2024 ; Zhang et al. 2022 ) . (iii) Limited performance of lexical retrievers . Prior work has shown that traditional lexical retrievers (e.g., BM25 ( Robertson et al. 1995 ) ) struggle with verbose conversational contexts ( Samarinas and Zamani 2024 ; Ros et al. 2023 ) . Unlike neural retrievers, they cannot be fine-tuned on PSC data. A novel framework for PSC . To tackle the above limitations, we propose a Conversation-to-Query framework (Conv2Query) for PSC , which aims to effectively adapt ad-hoc neural retrievers to PSC . Conv2Query aims to transform lengthy, noisy conversational context into short, concise ad-hoc queries that closely resemble the format of queries in widely-used ad-hoc search datasets, like MS MARCO ( Bajaj et al. 2016 ) ); these datasets have been widely-used for training numerous state-of-the-art retrievers ( Ma et al. 2024 ; Formal et al. 2022 ; Formal et al. 2021 ; Xiong et al. 2021 ) . We hypothesise that Conv2Query can effectively improve the performance of ad-hoc neural retrievers on PSC by providing ad-hoc queries during both inference and fine-tuning on PSC data; and Conv2Query can also effectively improve lexical retrievers’ performance by delivering concise queries that eliminate noises in conversational contexts. Learning pseudo ad-hoc query targets . Modelling Conv2Query poses a key challenge. In PSC , users’ search intents for each conversational context are implicit, and we need to generate ad-hoc queries that reveal the implicit search intent for each context. However, no ground-truth ad-hoc query training targets revealing implicit search intents are available to optimise the mapping in Conv2Query. Also, our preliminary experiments show that directly prompting LLM to generate ad-hoc

Read the complete text