InteractRank: Personalized Web-Scale Search Pre-Ranking with Cross Interaction Features
Sujay Khandagale, Bhawna Juneja, Prabhat Agarwal, Aditya Subramanian, Jaewon Yang, Yuting Wang · 2025
Read InteractRank: Personalized Web-Scale Search Pre-Ranking with Cross Interaction Features by Sujay Khandagale, Bhawna Juneja, Prabhat Agarwal, Aditya Subramanian, Jaewon Yang, Yuting Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06609.txt.
Introduction
Sujay Khandagale and five colleagues wrote a 2025 paper on InteractRank, a system for the pre-ranking stage of web-scale personalized search. Modern search engines refine billions of items through stages: retrieval, pre-ranking, full ranking, and blending. Pre-ranking must score hundreds of thousands of candidates down to a few thousand, fast.
Pre-rankers usually use two-tower models, which are efficient but miss the rich interactions between a query and an item that full rankers exploit. Adding cross interaction features to pre-ranking is hard because of the computational cost at that scale. InteractRank integrates those features into pre-ranking while keeping it efficient enough for production use. Better pre-ranking means the full ranker sees a stronger shortlist, improving final search quality.
Catalog record
| CREATOR | Sujay Khandagale, Bhawna Juneja, Prabhat Agarwal, Aditya Subramanian, Jaewon Yang, Yuting Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06609
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
InteractRank: Personalized Web-Scale Search Pre-Ranking with Cross Interaction Features Sujay Khandagale, Bhawna Juneja, Prabhat Agarwal, Aditya Subramanian, Jaewon Yang, Yuting Wang Abstract . Modern search systems use a multi-stage architecture to deliver personalized results efficiently. Key stages include retrieval, pre-ranking, full ranking, and blending, which refine billions of items to top selections. The pre-ranking stage, vital for scoring and filtering hundreds of thousands of items down to a few thousand, typically relies on two tower models due to their computational efficiency, despite often lacking in capturing complex interactions. While query-item cross interaction features are paramount for full ranking, integrating them into pre-ranking models presents efficiency-related challenges. In this paper, we introduce InteractRank, a novel two tower pre-ranking model with robust cross interaction features used at Pinterest. By incorporating historical user engagement-based query-item interactions in the scoring function along with the two tower dot product, InteractRank significantly boosts pre-ranking performance with minimal latency and computation costs. In real-world A/B experiments at Pinterest, InteractRank improves the online engagement metric by 6.5% over a BM25 baseline and by 3.7% over a vanilla two tower baseline. We also highlight other components of InteractRank, like real-time user-sequence modeling, and analyze their contributions through offline ablation studies. The code for InteractRank is available at https://github.com/pinterest/atg-research/tree/main/InteractRank . Conference: Companion Proceedings of the ACM Web Conference 2025; April 28-May 2, 2025; Sydney, NSW, Australia Companion Proceedings of the ACM Web Conference 2025 (WWW Companion ’25), April 28-May 2, 2025, Sydney, NSW, Australia DOI: 10.1145/3701716.3715239 ISBN: 979-8-4007-1331-6/2025/04 CCS: Information systems Retrieval models and ranking CCS: Information systems Web searching and information discovery † † cc-license: by 1. Introduction Search and Recommendation Systems are a crucial part of any online social media platform. In order to recommend high quality content to users, we need systems that help us score items at a large scale in a short amount of time. These systems typically use a multi-stage pipeline, as shown in Figure 1 . The process begins with the retrieval stage, selecting around 10^{5} relevant items from a billion-scale corpus. The pre-ranking stage then uses a lightweight model to refine this list to about 10^{3} items. Following this, the ranking stage employs sophisticated expensive models to narrow down to 10^{2} items. Finally, the blending stage enhances diversity and monetization utility, producing the final items to be shown to the user. Figure 1. Cascading search recommendation funnel In this paper, we address the challenge of pre-ranking items at a web-scale to deliver substantial product impact. Pre-ranking is essential as it improves the speed and accuracy of search and recommendation systems. By implementing fast pre-ranking methods, we can allocate additional latency budget to run a complex ranking model. Furthermore, pre-ranking plays a vital role in improving the recall, relevance and diversity of the final results. Developing a pre-ranking method is challenging due to the need to meet strict latency constraints while understanding the complex interactions among users, queries, and items. Given these latency limitations, using heavy deep learning models like DCN and DLRM ( Wang et al., 2021b ; Naumov et al., 2019 ) is impractical. A common solution is the two tower model ( Covington et al., 2016 ) , where one tower computes a query embedding from user and query information, and the other computes an item embedding. Items are ranked based on the similarity between these embeddings. However, while two tower models can capture interactions within a single tower (such as among item features), they fall short in capturing interactions between items and queries, limiting their accuracy. Another common approach uses count-based features like BM25 ( Robertson and Walker, 1994 ) . These methods create a wide, sparse feature vector based on term occurrences and rank items by aggregating these feature values. While they can capture interactions through co-occurrences, they struggle with capturing the semantic meanings of queries, as they mainly rely on frequency counts rather than conceptual relationships between terms. Consequently, they are also unable to utilize real-time contextual information, such as user activities within the same session. We introduce InteractRank, a two tower model enhanced with powerful cross-interaction features, designed to combine the strengths of traditional two tower models and interaction-feature-based approaches. Like conventional two tower models, InteractRank constructs a query embedding from user and query attributes and an item embedding from item-specific features, using these to calculate similarity. Beyond this, our model integrates cross-interaction features based on user engagement between items and queries ( Nguyen et al., 2023 ) . By combining these cross-interaction features with the dual-tower structure, InteractRank effectively captures item-query interactions and real-time context, such as user activities within the same session. Our contributions are as follows: (1) We introduce InteractRank, the production search pre-ranking model at Pinterest serving hundreds of millions of users and billions of searches daily. Through our A/B tests we show that InteractRank significantly boosts user engagement by merging the strengths of the two tower architecture with powerful cross-interaction features. The performance improvement achieved by InteractRank exceeds the sum of the individual contributions of two tower and interaction-feature-based methods, highlighting a strong collaborative effect. (2) We present our framework for generating query-item cross-interaction features, called ItemQueryPerf (IQP). IQP utilizes item-query relationships derived from two years of user engagement data and has been successfully serving cross-interaction features in our search and recommendation products. (3) We evaluated the impact of various design choices, including feature interaction within each tower, leveraging user’s activity sequences and the sampling of negative examples, using large-scale real-world application data. This evaluation provides insights into optimizing two tower models and cross interaction features for real-world applications. 1.1. Related Work In this section, we review the principal categories of related work relevant to our study: pre-ranking techniques, personalization strategies within recommendation systems, and the utilization of interaction features to enhance model performance. 1.1.1. Pre-ranking Pre-ranking serves as a pivotal component in the modern multi-stage recommendation stack. Its primary function is to narrow down \mathcal{O}(10k) items, sourced from various candidate generators, to a few hundred candidates suitable for complex ranking models ( Wang et al., 2021b ; Lian et al., 2018 ; Zhou et al., 2018 ; Song et al., 2019 ; Huang et al., 2019 ; Tang et al., 2020 ; Zhang et al., 2022 ) . Given the substantial volume of items evaluated during the pre-ranking stage, speed is crucial; consequently, two tower models ( Huang et al., 2013 ) have emerged as a popular choice. Nevertheless, these models are inherently limited in capturing the nuances of interaction between user, query and item. In response, recent studies ( Wang et al., 2020 ; Li et al., 2022 ; Santhanam et al., 2022 ) have aimed to enhance model complexity to improve interaction understanding, while still prioritizing operational efficiency. There are primarily three types of approaches utilized in enhancing user, query and item interactions. Models such as ColBERT ( Khattab and Zaharia, 2020 ; Santhanam et al., 2022 ) , SPLADE ( Formal et al., 2021 ; Formal et al., 2022 ) , and SparCode ( Su et al., 2023 ) learn multiple vectors for both queries and items, employing operators like MaxSim during serving to balance efficiency with effectiveness. However, many of these methods either incur high deployment