Bursting Filter Bubble: Enhancing Serendipity Recommendations with Aligned Large Language Models

Yunjia Xi 1∗† , Muyan Weng 1∗† , Wen Chen 2‡ , Chao Yi 2 , Dian Chen 2 , Gaoyang Guo 2 , Mao Zhang 2 , Jian Wu 2 , Yuning Jiang 2 , Qingwen Liu 2 , Yong Yu 1 , Weinan Zhang 1‡ · 2025

Read Bursting Filter Bubble: Enhancing Serendipity Recommendations with Aligned Large Language Models by Yunjia Xi 1∗† , Muyan Weng 1∗† , Wen Chen 2‡ , Chao Yi 2 , Dian Chen 2 , Gaoyang Guo 2 , Mao Zhang 2 , Jian Wu 2 , Yuning Jiang 2 , Qingwen Liu 2 , Yong Yu 1 , Weinan Zhang 1‡ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13539.txt.

Introduction

Yunjia Xi and co-authors present a recommendation framework that uses large language models to suggest items users did not expect but still like, in a paper from 2025. Standard recommenders loop on their own past picks, which narrows what users see. Surprise picks can break that bubble, but models must judge surprise as humans do.

Their system first compresses each user's history into layered profiles. A tuned model then learns human surprise judgments from enriched training data. A nearline step fits the model into a live shopping platform without slowing it. Online tests on a major app raised surprise item views, clicks, and purchases, with little effect on total revenue. The system is now fully deployed there.

Catalog record

CREATORYunjia Xi 1∗† , Muyan Weng 1∗† , Wen Chen 2‡ , Chao Yi 2 , Dian Chen 2 , Gaoyang Guo 2 , Mao Zhang 2 , Jian Wu 2 , Yuning Jiang 2 , Qingwen Liu 2 , Yong Yu 1 , Weinan Zhang 1‡
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13539

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bursting Filter Bubble: Enhancing Serendipity Recommendations with Aligned Large Language Models Yunjia Xi 1∗† , Muyan Weng 1∗† , Wen Chen 2‡ , Chao Yi 2 , Dian Chen 2 , Gaoyang Guo 2 , Mao Zhang 2 , Jian Wu 2 , Yuning Jiang 2 , Qingwen Liu 2 , Yong Yu 1 , Weinan Zhang 1‡ Abstract . Recommender systems (RSs) often suffer from the feedback loop phenomenon, i.e. , RSs are trained on data biased by their recommendations. This leads to the filter bubble effect that reinforces homogeneous content and reduces user satisfaction. To this end, serendipity recommendations, which offer unexpected yet relevant items, are proposed. Recently, large language models (LLMs) have shown potential in serendipity prediction due to their extensive world knowledge and reasoning capabilities. However, they still face challenges in aligning serendipity judgments with human assessments, handling long user behavior sequences, and meeting the latency requirements of industrial RSs. To address these issues, we propose SERAL ( Se rendipity R ecommendations with A ligned L arge Language Models), a framework comprising three stages: (1) Cognition Profile Generation to compress user behavior into multi-level profiles; (2) SerenGPT Alignment to align serendipity judgments with human preferences using enriched training data; and (3) Nearline Adaptation to integrate SerenGPT into industrial RSs pipelines efficiently. Online experiments demonstrate that SERAL improves exposure ratio (PVR), clicks, and transactions of serendipitous items by 5.7%, 29.56%, and 27.6%, enhancing user experience without much impact on overall revenue. Now, it has been fully deployed in "Guess What You Like" of Taobao App homepage. DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 † † footnotetext: * Equal contribution † † footnotetext: †Work done while interning at TaoBao † † footnotetext: ‡Corresponding author 1. Introduction Nowadays, recommender systems (RSs) play an indispensable role in alleviating information overload and delivering personalized recommendations ( Fu et al., 2023a ; Li et al., 2023a ) . These systems predominantly rely on deep learning algorithms trained on users’ historical interaction data and emphasize user preferences ( Zhou et al., 2018 ; Xi et al., 2022 ; Qin et al., 2020 ) . However, due to the feedback loop phenomenon, the content users encounter is largely determined by the system’s prior recommendations, in turn narrowing down the training data that RSs can utilize. In other words, RSs are trained on data biased by its recommendations ( Li et al., 2023a ; Krauth et al., 2022 ; Mansoury et al., 2020 ; Chen et al., 2023a ) , as shown in Figure 1 (a). The feedback loop, coupled with an over-specialization in user recent preferences, drives the system’s recommendations and user behavior to converge around a narrow subset of homogeneous content, commonly called the filter bubble effect ( Fu et al., 2023a ; Aridor et al., 2020 ; Nguyen et al., 2014 ) . As a result, RSs will persistently offer users familiar, homogeneous content, leading to user boredom and significantly diminishing user satisfaction ( Fu et al., 2023a ; Niu and Al-Doulat, 2021 ; Niu, 2018 ) . Figure 1 . The comparison between (a) traditional recommender system and (b) our serendipity recommender system. To address the challenges posed by the filter bubble, serendipity recommendation is advocated by many researchers, which aims to recommend items that provide users with unexpected yet appealing experiences ( Fu et al., 2023a ; Ziarani and Ravanmehr, 2021 ; Kotkov et al., 2016 ) . A serendipitous item should exceed users’ expectations and counteract content homogenization while still capturing their interest, which encompasses two key factors: unexpectedness and relevance ( Fu et al., 2023a ; Kotkov, 2024 ) . In recent years, serendipity recommendations have predominantly been driven by deep learning techniques ( Fu et al., 2023a ; Fu et al., 2023b ; Li et al., 2020a ; Li et al., 2020b ; Zhang et al., 2021 ; Wang et al., 2023 ; Cheng et al., 2017 ; Liu et al., 2023a ) , and have achieved promising results. However, due to the scarcity of serendipity data, which often relies on user surveys, they have to adopt smaller models and depend on biased recommendation data for augmentation. This may reinforce feedback loops, making it challenging to burst filter bubbles and accurately identify serendipitous items. Recently, large language models (LLMs) have showcased remarkable proficiency in various domains, strikingly close to human-level performance ( Bubeck et al., 2023 ; Achiam et al., 2023 ) . Notably, LLMs possess extensive world knowledge and exhibit remarkable comprehension and reasoning abilities. This enables them to incorporate external knowledge and intervention into RSs, break the feedback loop, and identify serendipitous items effectively, as shown in Figure 1 (b). Moreover, LLM-based recommenders demonstrate sample efficiency and can attain superior performance with limited training data ( Lin et al., 2025 ) . Preliminary work has attempted to apply LLMs to serendipity recommendations and achieve considerable results ( Tokutake and Okamoto, 2024 ; Fu and Niu, 2024 ) , but they still suffer from the following issues, which limit their effectiveness and deployment. Firstly, serendipity judgments from LLMs are not aligned with human assessments. Preliminary work leverages LLMs to evaluate item serendipity in a zero-shot manner and finds LLMs’ judgments are not well-aligned with human assessments ( Tokutake and Okamoto, 2024 ) . Serendipity relies heavily on personal context – what feels serendipitous to one user may not to another ( Kotkov, 2024 ) . LLMs without fine-tuning do not develop a deep understanding of individual user preferences. Moreover, human perceptions of serendipity involve relevance and unexpectedness ( Fu et al., 2023a ) . Prompts may not be sufficient to guide LLMs toward accurately identifying the nuanced and subjective nature of serendipity because they offer limited control over how the model interprets unexpectedness and relevance, leading to misalignment with human expectations. Therefore, without dedicated alignment, LLMs may lack the tailored understanding of users and an accurate grasp of serendipity to align with human judgments. Secondly, the length of user history that LLMs can utilize is limited, which poses a challenge in achieving a deep understanding of users. SOTA recommendation models show that long user sequences are crucial for understanding user preferences ( Hou et al., 2024 ; Si et al., 2024 ; Feng et al., 2024 ) . Similarly, serendipity recommendation relies on sufficient user history to identify serendipity, as it hinges on a nuanced understanding of an individual’s unique interests, surprises, and discoveries. However, LLMs struggle to comprehend long user behavior sequences, even when those sequences fall well within their context window ( Lin et al., 2024a ) . Studies exploring LLMs for serendipity also indicate their performance peaks with medium-length user sequences ( Tokutake and Okamoto, 2024 ) . Given that user behavior histories in RSs are often considerably longer, even reaching 10,000 ( Hou et al., 2024 ; Si et al., 2024 ) , LLMs’ inability to incorporate long sequences brings an insufficient understanding of the user’s nuanced preferences, obstructing them from identifying serendipitous items. Lastly, the current LLM-based serendipity recommendation poses challenges for

Read the complete text