A Survey on E-Commerce Learning to Rank
Md. Ahsanul Kabir, Mohammad Al Hasan, Aritra Mandal, Daniel Tunkelang, Zhe Wu · 2024
Read A Survey on E-Commerce Learning to Rank by Md. Ahsanul Kabir, Mohammad Al Hasan, Aritra Mandal, Daniel Tunkelang, Zhe Wu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03581.txt.
Introduction
Kabir and co-authors present a 2024 survey of learning-to-rank methods for online shopping search. Ranking decides which products a shopper sees first, and sales hinge on that order. Big platforms guard their ranking recipes, so outsiders cannot tell which methods work best. Features range from relevance and personal taste to seller fame and paid placement.
The survey gathers the published methods for this niche and sorts them by approach. The team also runs the methods on a large real shopping data set for a fair race. Results are compared on how well the top results match each query. The authors claim the first survey with such a hands-on test in this field.
Catalog record
| CREATOR | Md. Ahsanul Kabir, Mohammad Al Hasan, Aritra Mandal, Daniel Tunkelang, Zhe Wu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03581
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Survey on E-Commerce Learning to Rank Md. Ahsanul Kabir, Mohammad Al Hasan, Aritra Mandal, Daniel Tunkelang, Zhe Wu Abstract In e-commerce, ranking the search results based on users’ preference is the most important task. Commercial e-commerce platforms, such as, Amazon, Alibaba, eBay, Walmart, etc. perform extensive and relentless research to perfect their search result ranking algorithms because the quality of ranking drives a user’s decision to purchase or not to purchase an item, directly affecting the profitability of the e-commerce platform. In such a commercial platforms, for optimizing search result ranking numerous features are considered, which emerge from relevance, personalization, seller’s reputation and paid promotion. To maintain their competitive advantage in the market, the platforms do no publish their core ranking algorithms, so it is difficult to know which of the algorithms or which of the features is the most effective for finding the most optimal search result ranking in e-commerce. No extensive surveys of ranking to rank in the e-commerce domain is also not yet published. In this work, we survey the existing e-commerce learning to rank algorithms. Besides, we also compare these algorithms based on query relevance criterion on a large real-life e-commerce dataset and provide a quantitative analysis. To the best of our knowledge this is the first such survey which include an experimental comparison among various learning to rank algorithms. 1 Introduction Ranking is a central problem in information retrieval. Ranking result typically depends on the relevance between documents and queries, that’s why in some references ranking is also called relevance ranking. To illustrate, given a query, the document will have higher ranking if it is more relevant to the query than other documents. If there is a large number of documents associated with a query, the top ranked documents are the most important documents as well. While learning to rank (LTR) has been the focus of information retrieval for maximizing search relevance [ 1 , 2 , 3 , 4 , 5 , 6 ] , the applications of LTR include collaborative filter, document retrieval, definition finding, key term extraction, important email routing, product rating, sentiment analysis, and anti web spam. However, in the e-commerce domain, the purpose of LTR is to help the buyers to find and purchase their intended products. The buyers’ intent advocates the demand side while the listings by the e-commerce site represent the supply side of the platform. The goal of the e-commerce LTR is to provide the most relevant products for the supply and the demand side and to maximize the chance to generate revenue. While both a web search engine and an e-commerce site intend to ensure user satisfaction by presenting the most relevant products that a user is searching for, an e-commerce site maximizes revenue or sales, and minimizes the inventory cost showing the most relevant products. Additionally, the feature selection strategy of the two differs because the e-commerce queries are often shorter, lack syntactic structure and product property dominant than the web queries. Moreover, the ranking of products for the e-commerce queries are performed for user signals, like click rate, add-to-cart rate, and purchased rate. Due to the importance of e-commerce product ranking, quite a bit of research is performed in this area [ 7 , 8 , 9 , 10 ] . However, due to business privacy, and competition among the companies, the methods of LTR remain private. For the same reason, and user privacy most of the datasets are not public in this domain. There is a survey illustrating the challenges, business insights, and research opportunity in e-commerce domain [ 11 ] for relevance learning, product classification, taxonomy classification, recommendations, search personalization, learning to rank etc. However, the goal of this paper is to provide a general research idea in e-commerce domain. There is another survey [ 12 ] which focuses on data processing, representation learning, candidate selection, and general idea of product ranking. But illustrating the models details, experimenting with the models, and ranking among the models are not emphasized much. There is hardly any research to illustrate and rank the current LTR methods based on experiment in e-commerce domain. So the contributions of this paper are the following – 1. To our best knowledge we are the first to illustrate the LTR methods in details describing the e-commerce specific challenges and probable solution. 2. We perform experiments with the LTR methods and rank them based on the performance in a real e-commerce dataset. We organize the paper as follows – In Section 2 we formulate the problem of LTR using a common framework, then we divide the LTR methods into three groups and illustrate the mechanism of each method demonstrating the loss function each method is solving. Next we illustrate the e-commerce specific challenges in Section 3, and the evaluation metrics used in LTR methods in Section 4. After that in Section 5 we demonstrate the possibility of finding available datasets in e-commerce domain, and finally in Section 6 we provide the experiment results for all the illustrated methods and rank them based on the performance in an e-commerce dataset. 2 LTR Framework To demonstrate the machine learning frameworks, we first formally define the LTR problem in e-commerce domain. Let a training dataset contain n training queries \{q_{i}\}_{i=1}^{n} . The corresponding products for q_{i} be { p^{(i)}_{j} } {}_{j=1}^{m^{(i)}} such that p^{i}_{1}\succeq p^{i}_{2}....\succeq p^{i}_{m^{(i)}} in terms of relevance and m^{(i)} be number of relevant product for q_{i} . The goal is to design a ML framework which learns to rank from the training instances and perform best in the test data. Each framework approaches the LTR problem in two ways. First, they define different input and output spaces. Input spaces are contingent on feature selection and representation learning of query and products. The output space is to facilitate the learning process based on ranking the documents with respect to query document relevance. Second, each framework has a particular heuristic to learn a scoring function which can rank the products with respect to the corresponding e-commerce query. To learn the scoring function each method minimizes a distinguished loss function \mathcal{L} . Note that, there are quite a few research available for LTR in information retrieval [ 13 , 14 , 15 ] . However, these methods are not e-commerce specific. On the other hand, there are other methods available in e-commerce domain which are designed to meet specific requirements [ 16 , 17 ] . In this research we want to demonstrate the important existing methods along with the loss functions each method solves. Our main goal is to provide a general idea of LTR methods, and in the next subsections we illustrate them. Figure 1: Illustration of a LTR model to perform e-commerce product ranking task. 2.1 Pointwise Approaches Pointwise approaches [ 18 , 19 , 20 , 21 , 22 , 23 , 24 , 10 ] assign each query, product pair a relevance score. The ranking is performed in a straightforward way checking whether existing learning methods can be directly applied. To illustrate, a d dimensional vector, x^{(i)}_{j} is constructed for each query product pair ( q_{i} , p^{(i)}_{j} ) as input space. In addition, a list of floating