Modeling shopper interest broadness with entropy-driven dialogue policy in the context of arbitrarily large product catalogs Conference: Workshop on Generative AI for E-Commerce; September 22, 2025; Prague, Czech Republic CCS: Computing methodologies Multi-agent planning

Firas Jarboui, Issa Memari · 2025

Read Modeling shopper interest broadness with entropy-driven dialogue policy in the context of arbitrarily large product catalogs Conference: Workshop on Generative AI for E-Commerce; September 22, 2025; Prague, Czech Republic CCS: Computing methodologies Multi-agent planning by Firas Jarboui, Issa Memari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06185.txt.

Introduction

A shopping assistant should ask questions when a request is vague and recommend when it is sharp, and Firas Jarboui and Issa Memari make that call from entropy in a 2025 paper. Conversational recommenders over huge catalogs must balance exploring a shopper's needs against exploiting them. Their method measures the breadth of interest from the score distribution of a neural retriever.

High entropy in the re-ranked scores signals ambiguity, so the dialogue policy asks exploratory questions; low entropy signals a specific intent and triggers direct recommendations. The routing keeps a language-model agent aware of an arbitrarily large catalog in real time without stuffing the catalog into its context window. The authors present the entropy signal as a simple, effective steering rule.

Catalog record

CREATORFiras Jarboui, Issa Memari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06185

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modeling shopper interest broadness with entropy-driven dialogue policy in the context of arbitrarily large product catalogs Conference: Workshop on Generative AI for E-Commerce; September 22, 2025; Prague, Czech Republic CCS: Computing methodologies Multi-agent planning Firas Jarboui, Issa Memari Abstract . Conversational recommender systems promise rich interactions for e-commerce, but balancing exploration (clarifying user needs) and exploitation (making recommendations) remains challenging, especially when deploying large language models (LLMs) with vast product catalogs. We address this challenge by modeling the breadth of user interest via the entropy of retrieval score distributions. Our method uses a neural retriever to fetch relevant items for a user query and computes the entropy of the re-ranked scores to dynamically route the dialogue policy: low-entropy (specific) queries trigger direct recommendations, whereas high-entropy (ambiguous) queries prompt exploratory questions. This simple yet effective strategy allows an LLM-driven agent to remain aware of an arbitrarily large catalog in real-time without bloating its context window. 1. Introduction Recommender systems are increasingly turning to conversational agents to create interactive, personalized shopping experiences. Instead of passively presenting a list of items, a conversational recommender can ask questions, understand user preferences in real-time, and explain or refine recommendations through dialogue ( Ren et al. 2021 ) . The recent breakthrough of large language models (LLMs) has accelerated this trend, as LLMs can fluidly generate natural language and handle complex user utterances ( Feng et al. 2023 ) . By leveraging LLMs, conversational recommenders (CRS) have the potential to combine the strengths of traditional recommendation algorithms (database knowledge, collaborative filtering signals) with the flexible reasoning and language capabilities of AI assistants ( Liu et al. 2023 ) . This synergy, however, comes with new challenges. Chief among them is how to manage the dialogue policy – i.e., deciding when the system should ask clarifying questions versus when it should present actual recommendations – in a way that takes advantage of the LLM’s capabilities without overwhelming it with information. In this work, we propose an entropy-based routing strategy to address this challenge. The key idea is to quantitatively estimate the broadness or ambiguity of the user’s request by looking at the distribution of retrieval scores for candidate items. Intuitively, if the retrieval results are tightly clustered around a few high-scoring items, the conversational agent should exploit this and make a recommendation. Conversely, if the scores are spread out, it signals ambiguity – the agent should explore by asking a clarifying question or preference query. We start by setting up the orchestration framework of the developed conversational AI before focusing on the its behavior as a shopping assistant. We then detail the product search pipeline, we discuss the limitations of naive retrieval augmented generation (RAG) and how that led us to develop the entropy-driven dialogue policy. We conclude the paper with empirical evidence supporting this work and the research directions we want to take in the future. Through this work, we aim to demonstrate that modeling user interest broadness via entropy is an effective and novel way to enhance LLM-driven recommender systems, contributing to more intelligent and adaptive conversational recommenders in practice. 2. Multi–skill E-commerce AI Agent Figure 1. High-level data flow of the agent (see § 2 ). We operate a production-grade AI agent that currently serves {\sim}200\,\text{K} incoming shopper messages per day across live chat widgets and e-mails for thousands of e-commerce brands. Merchants expect from the agent to both remove purchase-blocking friction (e.g. “What’s your refund policy?”) and actively increase basket conversion through persuasive, context-aware product recommendations ( Zhang et al. 2018 ) . Treating “support” and “sales” in isolation would miss critical dependencies (clarifying a shipping deadline often opens a sales opportunity, and vice-versa) and would force costly hand-offs. We therefore build a multi-skill agent that unifies these tasks inside a single control loop (similar unified assistant strategies are described in Alibaba’s AliMe system for example ( Li et al. 2017 ) ). Figure 1 schematizes the pipeline, which is organised into three routing nodes . (1) Planning node: Given the raw shopper message (and session metadata such as pages visited, cart contents, and prior orders), a large language model (LLM) decomposes the interaction into • support requests —independent units of friction to be solved; • a binary decision on whether a sales opportunity exists. The planner outputs a structured JSON plan that names each request and, if applicable, flags the turn for sales activation. This approach aligns with multi-intent detection in dialog systems, where a single utterance may contain multiple intents that need handling ( Gangadharaiah and Narayanaswamy 2019 ) . (2) Resolution workflows: Each element of the plan is processed by a dedicated workflow , i.e. a guarded chain of LLM calls with retrieval-augmented generation (RAG) over merchant data ( Lewis et al. 2020 ) . • Support-agent workflow queries the merchant knowledge base (policies, FAQs, etc.) and generates a concise resolution instructions. This ensures accurate answers to policy or support questions by retrieving relevant documents ( Feng et al. 2020 ) . • Shopping-assistant workflow (focus of the remainder of this paper) selects a sales tactic — discovery or recommendation —then produces tactic-specific instructions that will later surface to the shopper. This design follows the conversational recommendation paradigm where the system can ask clarifying questions to discover user needs or present product recommendations when confident, as shown to improve recommendation relevance in interactive e-commerce settings ( Zhang et al. 2018 ) . (3) Reply-generation node: A final LLM aggregates all instruction digests, resolves overlaps, checks coherence, and produces a single reply. If any digest signals low confidence or excessive complexity, the node triggers a handover to a human agent instead of auto-replying. The remaining sections of this paper dive into the shopping-assistant workflow and, in particular, the detailed mechanism that handle routing between discovery and recommendation tactics. 3. AI Shopping Assistant In every sales-oriented turn, the agent must decide between two conversational tactics : (1) Discovery — ask clarifying questions or surface a small set of representative items to help the shopper refine their intent or explore the merchant’s offer. (2) Recommendation — once the intent is precise, present a concrete product (or bundle) and explain how it satisfies the expressed need. Choosing the appropriate tactic at each turn is vital for both customer experience and conversion ( Ren et al. 2024 ; Jannach et al. 2021 ) . Implementing this mixed-initiative behaviour raised two technical challenges: Product context retrieval: How can we fetch high-quality candidate products without overflowing the LLM context window? We start by answering this in subsection 3.1 by detailing our two-stage search pipeline and the distinction between our identification and recommendation retrieval operators. Tactic selection.: How can the system infer turn by turn whether the dialogue is still exploratory or ready for a recommendation? The subsequent subsections review our baseline solution, its limitations, and how those limitations led us to the entropy-based approach this paper introduces. 3.1. Product Search System Our shopping assistant relies on a two–stage neural search pipeline whose input is an LLM-generated query assembled from the live context—conversation turns, pages visited, cart contents, and past orders. Each query is executed on the merchant’s product catalogue in one of two modes: • Identification :

Read the complete text