Talos: Optimizing Top- K K Accuracy in Recommender Systems Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates CCS: Information systems Recommender
Shengjia Zhang, Weiqin Yang, Jiawei Chen, Peng Wu, Yuegang Sun, Gang Wang, Qihao Shi, Can Wang · 2026
Read Talos: Optimizing Top- K K Accuracy in Recommender Systems Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates CCS: Information systems Recommender by Shengjia Zhang, Weiqin Yang, Jiawei Chen, Peng Wu, Yuegang Sun, Gang Wang, Qihao Shi, Can Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19276.txt.
Introduction
Shengjia Zhang and seven co-authors aim recommender training squarely at the top of the list. A recommender's job is to surface a small set of items that best match a user's taste. Users see only the top few, so quality there matters far more than quality deep in the ranking.
Their method, Talos, optimizes top K accuracy directly rather than a loose proxy. Training for the metric that users feel should sharpen the head of the list where clicks happen. The work was shared at the ACM Web Conference, a main venue for web scale ranking research.
Catalog record
| CREATOR | Shengjia Zhang, Weiqin Yang, Jiawei Chen, Peng Wu, Yuegang Sun, Gang Wang, Qihao Shi, Can Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19276
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Talos: Optimizing Top- K K Accuracy in Recommender Systems Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates CCS: Information systems Recommender systems Shengjia Zhang, Weiqin Yang, Jiawei Chen, Peng Wu, Yuegang Sun, Gang Wang, Qihao Shi, Can Wang Abstract . Recommender systems (RS) aim to retrieve a small set of items that best match individual user preferences. Naturally, RS place primary emphasis on the quality of the Top- K K results rather than performance across the entire item set. However, estimating Top- K K accuracy ( e.g., Precision@ K K , Recall@ K K ) requires determining the ranking positions of items, which imposes substantial computational overhead and poses significant challenges for optimization. In addition, RS often suffer from distribution shifts due to evolving user preferences or data biases, further complicating the task. To address these issues, we propose Talos, a loss function that is specifically designed to optimize the Top- K K recommendation accuracy. Talos leverages a quantile technique that replaces the complex ranking-dependent operations into simpler comparisons between predicted scores and learned score thresholds. We further develop a sampling-based regression algorithm for efficient and accurate threshold estimation, and introduce a constraint term to maintain optimization stability by preventing score inflation. Additionally, we incorporate a tailored surrogate function to address discontinuity and enhance robustness against distribution shifts. Comprehensive theoretical analyzes and empirical experiments are conducted to demonstrate the effectiveness, efficiency, convergence, and distributional robustness of Talos. The code is available at https://github.com/cynthia-shengjia/WWW-2026-Talos . 1. Introduction Being able to provide personalized suggestions, Recommender Systems (RS) ( Ko et al. 2022 ; Zhang et al. 2019 ) are integral to several online service platforms. On these platforms, users are typically presented with only a small set of items. Consequently, RS primarily emphasizes the quality of the Top- K items ( e.g., Precision@ K and Recall@ K ) rather than the performance across the entire item set. Existing RS often adopt a learning-based paradigm ( He et al. 2020 ; Wu et al. 2024a ) — learning a recommendation model to estimate user preference scores over items and then retrieving the Top- K items with the highest predicted scores as recommendations. The distinct focus on Top- K accuracy has inspired extensive research on recommendation loss functions. The loss function determines the direction of model optimization, whose importance cannot be overemphasized ( Wu et al. 2024b ; Yang et al. 2024 ) . Recent years have witnessed the emergence of two prominent types of loss functions: Figure 1 . ( Left ). Illustration of the inconsistency between LLPAUC/AUC/NDCG and Top- K accuracy (Precision@ K and Recall@ K ) for two difference ranking schemes of ten items, where ranking scheme 2 achieves better AUC/LLPAUC and NDCG, while worse on Top- K accuracy; ( Right ). The relationship among Talos, LLPAUC, SL, and BPR. • Full-ranking Losses : Some works aim to improve the overall ranking performance without explicitly targeting Top- K estimation. Prominent examples include BPR ( Rendle et al. 2009 ) and Softmax Losses ( Wu et al. 2024b ) , which have been shown to approximately optimize the Area Under the ROC Curve (AUC) and Normalized Discounted Cumulative Gain (NDCG), respectively. However, AUC and NDCG evaluate the quality of the entire ranking list, which can differ substantially from the quality of the Top- K subset most relevant to RS outcomes. Consequently, optimizing these full-ranking loss functions does not necessarily translate to improvements in Top- K accuracy and may sometimes reduce it. Figure 1 provides an example where AUC and NDCG increase while Precision@ K and Recall@ K decrease. Such cases are not rare in RS. By empirically analyzing arbitrary pairs of ranking lists for users on real-world datasets, we observe that the ratio of such inconsistent cases exceeds 34.37% and 28.49% on average. • Partial-AUC-based Losses : Another line of research focuses on developing loss functions for optimizing Partial-AUC metrics ( e.g., LLPAUC ( Shi et al. 2024 ) and OPAUC ( Shi et al. 2023 ) ), which evaluate the partial area under the ROC curve and correlate more strongly with Top- K accuracy than full - ranking losses. Indeed, as shown in Table 1.1 , the inconsistency ratio between LLPAUC and Precision@ K decreases to 21.86% on average. Nevertheless, the gap still exists. More critically, Partial-AUC metrics are highly complex, incurring significant optimization challenges. It can be seen from their surrogate loss functions often involve adversarial training ( Shi et al. 2024 ) , which complicates training stability and reduces effectiveness. Furthermore, these loss functions introduce additional hyperparameters compared to BPR and SL, necessitating expensive and time-consuming tuning efforts. These limitations significantly hinder their practical application. Given these limitations, an important research question raises: How can we design a loss function that directly optimizes top - K accuracy in recommender systems? Considering the characteristics of Top- K optimization and RS, we identify the following key obstacles: • Ranking-aware Discontinuous Objective : Top- K accuracy ( e.g., Precision@ K ) are computed only over the Top- K ranked items, requiring a ranking - dependent truncation — determining which items lie in the Top- K positions. This process requires computing item ranking positions, incurring high computational cost. It also makes the objective discontinuous or constant in large regions, making gradient - based optimization ineffective. • Distributional-Shift Challenge: It is important to note that RS often faces severe distribution shifts due to evolving user preference ( Wang et al. 2022 ) or data collection biases ( Chen et al. 2023a ; Chen et al. 2021 ; Gao et al. 2023 ; Lin et al. 2025 ) . Loss functions that are robust to such shifts have been shown to be essential for RS performance ( Wu et al. 2024a ) . Table 1.1 . Empirical analyses of the inconsistency between AUC/LLPAUC/NDCG/NDCG@ K and Top- K accuracy across arbitrary pairs of ranking lists on real-world datasets. Metric Gowalla Beauty Games Electronics Precision@20 Recall@20 Precision@20 Recall@20 Precision@20 Recall@20 Precision@20 Recall@20 AUC 33.17% 33.89% 34.67% 35.46% 35.17% 34.19% 33.32% 34.58% LLPAUC 18.53% 18.65% 23.81% 22.95% 23.30% 22.34% 23.30% 22.25% NDCG 26.70% 26.88% 29.65% 29.52% 29.52% 28.02% 29.11% 28.53% NDCG@ K 19.01% 18.24% 22.02% 22.55% 21.14% 22.21% 17.65% 17.51% To address these challenges, we propose Talos, a new loss function specifically designed for optimizing Top- K recommendation accuracy ( e.g., Precision@ K and Recall@ K ). To overcome the ranking-dependence, we introduce the quantile ( Koenker 2005 ; Hao and Naiman 2007 ; Shao 2008 ) to reformulate Top- K selection into simple comparisons between item scores and a learned score threshold. Items with scores above the threshold constitute the Top- K , avoiding explicit sorting and thus significantly facilitating optimization. However, this threshold-based strategy also raises two further questions: 1) Threshold estimation : The valid thresholds vary per user, requiring efficient and accurate estimation; 2) Convergence concern : Thresholds evolve during training, raising concerns about training convergence and stability. Particularly, we observe score inflation phenomenon that both predicted scores and thresholds rise excessively. We resolve these by: 1) Developing a sampling - based