INSPIRE: Intent-aware Neural Sponsored Product Retrieval for E-commerce

Shasvat Desai, Hong Yao, Utkarsh Porwal, Kuang-chih Lee · 2026

Read INSPIRE: Intent-aware Neural Sponsored Product Retrieval for E-commerce by Shasvat Desai, Hong Yao, Utkarsh Porwal, Kuang-chih Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23889.txt.

Introduction

Desai, Yao, Porwal, and Lee teach Walmart's sponsored search to read the hidden intent inside short grocery queries, in a 2026 paper on information retrieval. A query like a bread brand name may silently encode a gluten free need, and a snack brand may want its protein bars shown for keto searches that never mention it. Missing such signals wastes the few ad slots available. INSPIRE represents intent as structured attributes: brand, flavor, dietary needs, ingredients, subtype, and cuisine.

A large language model annotates products with these attributes, acting as teacher. A lightweight student model is fine tuned to predict them at catalog scale. Predicted intents are then folded into the query and product embeddings of a dense retrieval system, so matching respects intent as well as wording.

Catalog record

CREATORShasvat Desai, Hong Yao, Utkarsh Porwal, Kuang-chih Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23889

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

INSPIRE: Intent-aware Neural Sponsored Product Retrieval for E-commerce Shasvat Desai, Hong Yao, Utkarsh Porwal, Kuang-chih Lee Abstract Walmart holds the largest share of the U.S. e-commerce grocery market, where food and beverage categories generate some of the highest search traffic and, consequently, drive a substantial portion of sponsored search revenue. At this scale, even small mismatches between user intent and retrieved products can lead to significant losses in both user engagement and monetization. Yet, understanding user intent in grocery search is inherently challenging. Queries are typically short, ambiguous, and highly diverse, often underspecifying critical preferences. For example, a query like schar white bread implicitly encodes a gluten-free preference through brand association, while queries such as chickpea pasta or oatmilk reflect underlying dietary preferences like gluten-free, plant-based, or lactose-free alternatives. Failing to capture these signals results in retrieving products that might be semantically similar but misaligned with the user’s true needs. From the advertiser’s perspective, many products are explicitly designed to target specific intents—such as dietary preferences or size variants—and must be surfaced at the right moment to be effective. For example, a brand like Quest Nutrition, which sells high-protein, low-sugar snacks, wants its products to appear for queries like protein bars, low carb snacks, or keto snacks, even when these attributes might not be explicitly stated in the product title text. When retrieval systems fail to capture these intent signals, relevant products are not shown to the right users at the right time. From an advertiser’s perspective, this means their products are missing high-intent opportunities where conversion is most likely. Over time, this leads to lower returns on ad spend, reduced trust in the platform, and potential advertiser attrition. Losing advertisers directly translates to a loss in advertising revenue and weakens the overall sponsored search ecosystem. This challenge is further amplified in sponsored search, where only a limited number of ad slots are available, making precise relevance essential. Thus, we propose INSPIRE (Intent-aware Neural Sponsored Product Retrieval for E-commerce), an intent-aware retrieval framework for sponsored search that leverages structured intent signals to better align user queries with relevant food and beverage products. INSPIRE represents intent as a set of structured, multi-dimensional attributes derived from both user queries and product content, capturing explicit signals (e.g., brand, flavor) as well as implicit preferences (e.g., dietary constraints, cuisine types) that are often not directly expressed in queries. We develop a weakly supervised intent learning pipeline, where a large language model serves as a teacher to generate structured intent annotations from product titles and descriptions. We then distill these annotations by using them to finetune a lightweight student LLM model through LoRA based supervised finetuning (LoRA-SFT) that predicts intent attributes—such as brand, flavor, dietary preference, ingredient, product subtype, and cuisine type—at Walmart catalog scale. We then introduce an intent-augmented dense retrieval framework, where predicted intents are incorporated into query and product representations within a bi-encoder, enabling more precise matching between queries and sponsored products. To support real-world usage, we deploy the system as a scalable inference service. The distilled student model is served via a high-throughput API powered by vLLM, enabling efficient intent prediction over large product catalogs with low latency. This design ensures that intent-aware retrieval can be applied in production settings while maintaining efficiency and scalability. [ [email protected], ] *1 [[email protected]] [[email protected]] [[email protected]] keywords Intent aware retrieval ,User behavior modeling ,LoRA based LLM Supervised Finetuning for intent generation,Knowledge Distillation , † † copyrightyear: 2026 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: ECOM’26: SIGIR Workshop on eCommerce, Jul 24, 2026, Melbourne, Australia † † address: Walmart Global Tech, USA † † corresp: Corresponding author. 1 Introduction Figure 1: Overview of INSPIRE, an intent-aware retrieval framework for sponsored search. The system identifies failure cases in production query–item pairs, generates structured intents using an ensemble of teacher LLMs with cross-model consensus, and distills them into efficient student models via LoRA-based supervised fine-tuning. These intents are incorporated into query and item representations to train an intent-augmented dense retrieval model, enabling improved alignment between user queries and products. Intent understanding for Walmart’s grocery search is critical for two primary reasons: relevance and safety. Relevance is essential because Food and Beverages drives significant user traffic and revenue. Equally important is safety. Systems must respect dietary restrictions and ensure that retrieved products are allergen-safe, as failures can lead to harmful user experiences. For example, a user with a peanut allergy searching for “nut free protein bars” should not be shown products containing peanuts, even if they are otherwise highly relevant. Intent understanding requires capturing both explicit intents (e.g., brand, flavor) and implicit intents (e.g., dietary preferences, cuisine type). When explicit signals are ignored—such as returning a different brand for “Coke vanilla” or mismatching flavor in “barbecue chips”—the results are immediately unsatisfactory and erode user trust. The challenge is substantially greater for implicit intents, where users expect systems to infer constraints like sugar-free, dairy-free, or gluten-free even when they are only partially specified or entirely unstated. Crucially, this alignment must hold on both the query side and the product side : understanding what the user expresses is insufficient unless the system can also correctly interpret what the product represents. These signals are rarely explicit in product titles, requiring retrieval systems to reason over latent product knowledge rather than surface-level text. Brands often implicitly encode such properties—Schär is widely associated with certified gluten-free products, Nutpods with dairy-free and vegan offerings, and LILY’S with no-sugar-added chocolate—while ingredient-level cues further reinforce them (e.g., chickpea-based products are inherently gluten-free, Bomba rice is appropriate for paella whereas Arborio rice is not). Successfully retrieving the right items therefore demands a deeper alignment between implicit user constraints and equally implicit product attributes. As shown in Table 1 , failing to capture these signals results in items that are lexically similar yet violate key constraints, making them practically unusable. Beyond preference, this also impacts safety and effort, as users are otherwise forced to inspect ingredient lists and nutritional information to verify suitability. These challenges are further amplified in sponsored search. Ad engagement is inherently sparse—whether an ad is shown depends not only on relevance but also on campaign activity, auction dynamics, bid competitiveness, and advertiser budget. Moreover, the number of ad slots is significantly smaller than organic results, making precise relevance essential. Missing a relevant product therefore not only degrades user experience but also adversely impacts advertisers, leading to lost revenue, lower click-through rates, and reduced return on ad spend. Consequently, accurately modeling both query and product intents is critical to serving users effectively while sustaining a healthy advertiser ecosystem. To address these challenges, we propose INSPIRE (Intent-aware Neural Sponsored Product Retrieval for E-commerce) , an intent-aware retrieval framework that leverages structured intent signals to better align queries with relevant food and beverage products. INSPIRE represents intent as a set of structured, multi-dimensional attributes derived from both queries and product content, capturing explicit signals (e.g., brand, flavor) as well as implicit preferences (e.g., dietary constraints, cuisine types). We develop an INSPIRE with the following components: (i) Failure identification : perform hard negative mining and error analysis to surface query–item pairs

Read the complete text