NAM: A Normalization Attention Model for Personalized Product Search In Fliggy Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Res
Shui Liu, Mingyuan Tao, Maofei Que, Pan Li, Dong Li, Shenghua Ni, Zhuoran Zhuang · 2025
Read NAM: A Normalization Attention Model for Personalized Product Search In Fliggy Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Res by Shui Liu, Mingyuan Tao, Maofei Que, Pan Li, Dong Li, Shenghua Ni, Zhuoran Zhuang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08382.txt.
Introduction
Shui Liu and six co-authors personalize product search for a travel platform in a 2025 paper. Search that learns from past clicks can match shoppers better. Older methods tune results to the user alone and ignore the item's own popularity, which skews the ranking.
Popular items get their conversion rates overstated while niche items are underrated. Shoppers also lean on personal taste far more for niche items than for hits. Their model decides when to personalize using a rarity weight and a gate. It also normalizes attention from a global view to fix item comparisons. The design aims for rankings that respect both the shopper and the catalog's long tail.
Catalog record
| CREATOR | Shui Liu, Mingyuan Tao, Maofei Que, Pan Li, Dong Li, Shenghua Ni, Zhuoran Zhuang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08382
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NAM: A Normalization Attention Model for Personalized Product Search In Fliggy Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3730235 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Learning to rank Shui Liu, Mingyuan Tao, Maofei Que, Pan Li, Dong Li, Shenghua Ni, Zhuoran Zhuang Abstract . Personalized product search provides significant benefits to e-commerce platforms by extracting more accurate user preferences from historical behaviors. Previous studies largely focused on the user factors when personalizing the search query, while ignoring the item perspective, which leads to the following two challenges that we summarize in this paper: First, previous approaches relying only on co-occurrence frequency tend to overestimate the conversion rates for popular items and underestimate those for long-tail items, resulting in inaccurate item similarities; Second, user purchasing propensity is highly heterogeneous according to the popularity of the target item: it is less correlated with the user’s historical behavior for a popular item and more correlated for a long-tail item. To address these challenges, in this paper we propose NAM , a N ormalization A ttention M odel, which optimizes ”when to personalize” by utilizing Inverse Item Frequency (IIF) and employing a gating mechanism, as well as optimizes ”how to personalize” by normalizing the attention mechanism from a global perspective. Through comprehensive experiments, we demonstrate that our proposed NAM model significantly outperforms state-of-the-art baseline models. Furthermore, we conducted an online A/B test at Fliggy, and obtained a significant improvement of 0.8% over the latest production system in conversion rate. 1. Introduction Personalized product search addresses the critical problem of information overload in industrial practices ( Sondhi et al. 2018 ; Su et al. 2018 ) . It operates by allowing different individuals to receive personalized results for the same query according to their historical behaviors. This significantly enhances the relevance of search results to user preferences and greatly improves product retrieval performance. Despite its great potential, personalization might not always be beneficial ( Teevan et al. 2008 ; Dumais 2016 ; Bennett et al. 2012 ) , since customers’ purchase decisions are affected by both the relevance of target items and the customer preferences. Therefore, it is crucial to understand both ”when to personalize” and ”how to personalize” when developing the search model. To that end, a series of deep-learning models have been proposed to extract user preferences from behavior sequences based on the current search context, such as ( Zhou et al. 2018 ; Zhou et al. 2019 ; Ai et al. 2019 ; Guo et al. 2019 ) , where attention mechanism plays a crucial role in all these models. Specifically, attention variant models that focus on the relationship between queries and user behavior sequences have been proposed ( Ai et al. 2019 ; Bassani et al. 2024 ; Bi et al. 2020 ) , allowing the weight of personalization to be as large as 1 when personalization is dominant and as small as 0 when it is not needed at all. However, the research gap lies in the fact that, to the best of our knowledge, previous models are all built upon query-dependent attention and tend to ignore the characteristics of items as a result. We argue that exploring personalization from the item perspective is particularly important due to the following reasons: (1) To answer the question of ”when to personalize”, the popularity of the items needs to be taken into account, since customers’ purchase decision is also affected by the bandwagon effect ( Abdollahpouri et al. 2019 ; Perc 2014 ) brought by the item’s popularity. (2) Relying only on co-occurrence item frequency will lead to the overestimation of conversion rates for popular items and the underestimation for long-tail items, resulting in a Matthew effect ( Celma and Cano 2008 ) , as well as the suboptimal item similarities or attention weights. Considering these challenges, we propose three intuitions, which motivate us to conduct preliminary data analysis to validate them on our industry dataset. Based on the data analysis, we propose the Normalization Attention Model (NAM), which consists of a gating mechanism with IIF of target item to model when to personalize, as well as a global normalized attention mechanism with IIF of items in user historical behaviors to model how to personalize. 2. Intuition & Data Analysis In this section, we present three intuitions and demonstrate them through data analysis, which inspired the methods for enhancing the ranking model. Intuition 1: Popular items are overestimated, while long-tail items are underestimated. Due to the fact that the search model is trained based on historical data, popular items dominate the model, resulting in the model overestimating the click-through rate for popular items while underestimating the click-through rate for long-tail items. To demonstrate this intuition, we collect consumer logs from the product search system on Fliggy 1 1 1 http://www.fliggy.com/ . Based on the logs, we sort items in descending order based on the number of users who interacted with them and divide them into five levels, then compare the predicted click-though rate & post-click conversion rate (pCTCVR), the actual click-though rate & post-click conversion rate (CTCVR), and predicted Conversion rate Over Conversion rate (PCOC) corresponding to each level. PCOC is calculated as: PCOC=\frac{pCTCVR}{CTCVR} . The result is presented in Table 1 , which clearly indicates that popular items are overestimated, while long-tail items are underestimated. Table 1 . PCOC on Different Item Popularity Level. The closer the value of PCOC is to 1, the better. Level ExposurePercentage pCTCVR CTCVR PCOC [0,1%] 57.08% 0.74% 0.63% 1.1715 (1%,5%] 21.29% 0.79% 0.79% 0.9957 (5%,20%] 16.26% 0.71% 0.79% 0.9076 (20%,100%] 5.37% 0.18% 0.22% 0.8174 Intuition 2: Globally-normalized item similarity leads to better recommendation results. Proper suppression of popular items improves the performance of the recommender system. For example, adjusting the weight of item frequency in the similarity formula is often used to alleviate the Harry Potter problem ( Zhao et al. 2013 ) in recommendation system ( CarlKadie 1998 ) . Based on consumer logs collected from our product search system, we investigate the hit rate with different similarity formulas. The hit rate metric is calculated as: HitRate@k=\frac{\sum\limits_{u\in U}{\sum\limits_{i\in I_{u}}{\#\{\Gamma_{i}\cap S_{i,k}\}}}}{\sum\limits_{u\in U}\sum\limits_{i\in I_{u}}{\#\Gamma_{i}}} , where u represents a user, i represents an item. I_{u} is the item set that interacted with u. \Gamma_{i} is the collection of items that have interactions occurring later than item i. S_{i,k} is the collection of top k similar items of item i. " \# " represents the number of elements in a set. Co-occurrence similarity is calculated as: Co\text{-}occurrenceSim_{\ i,j}=\#(U_{i}\cap U_{j}) , where U_{i} is the users that interacted with item i . Jaccard similarity is calculated as: JaccardSim_{i,j}=\frac{\#(U_{i}\cap U_{j})}{\#(U_{i}\cup U_{j})} , and Cosine similarity is calculated as: CosineSim_{i,j}=\frac{\#(U_{i}\cap U_{j})}{\sqrt{\#U_{i}\#U_{j}}} . It’s evident from Table 2 that the hit rate of Jaccard and Cosine similarity performs much better than Co-occurrence Frequency similarity, since Jaccard and Cosine similarity involves the item’s frequency as global normalization. Table 2 . Hit Rate with different Similarity Methods. Method HitRate@10 HitRate@20 HitRate@30 Co-occurrence Frequency 10.04% 17.27% 22.61% Jaccard