SimTok: Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agents
Nicholas Sukiennik, Haoyu Wang, Zailin Zeng, Chen Gao, Yong Li · 2025
Read SimTok: Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agents by Nicholas Sukiennik, Haoyu Wang, Zailin Zeng, Chen Gao, Yong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08742.txt.
Introduction
Nicholas Sukiennik and four co-authors built a simulation to watch filter bubbles form on short-video platforms, in a 2025 paper. Recommender systems can narrow what users see until their feed becomes homogeneous, but the feedback loop behind that is hard to observe in the wild. The team's framework, SimTok, uses language-model agents as stand-in users reacting to real short-video data.
Large simulations showed the agents reproduced realistic user-recommender dynamics, and bubbles formed through identifiable mechanisms. Demographic traits and strong category attraction made homogenization worse. The team tested fixes, including cold-start tweaks and feedback weighting, and measured real reductions. They also examined how biases inside the language models themselves can spread through recommendations.
Catalog record
| CREATOR | Nicholas Sukiennik, Haoyu Wang, Zailin Zeng, Chen Gao, Yong Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08742
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SimTok: Simulating Filter Bubble on Short-video Recommender System with Large Language Model Agents Nicholas Sukiennik, Haoyu Wang, Zailin Zeng, Chen Gao, Yong Li Abstract An increasing reliance on recommender systems has led to concerns about the creation of filter bubbles on social media, especially on short video platforms like TikTok. However, their formation is still not entirely understood due to the complex dynamics between recommendation algorithms and user feedback. In this paper, we aim to shed light on these dynamics using a large language model-based simulation framework. Our work employs real-world short-video data containing rich video content information and detailed user-agents to realistically simulate the recommendation-feedback cycle. Through large-scale simulations, we demonstrate that LLMs can replicate real-world user-recommender interactions, uncovering key mechanisms driving filter bubble formation. We identify critical factors, such as demographic features and category attraction that exacerbate content homogenization. To mitigate this, we design and test interventions including various cold-start and feedback weighting strategies, showing measurable reductions in filter bubble effects. Our framework enables rapid prototyping of recommendation strategies, offering actionable solutions to enhance content diversity in real-world systems. Furthermore, we analyze how LLM-inherent biases may propagate through recommendations, proposing safeguards to promote equity for vulnerable groups, such as women and low-income populations. By examining the interplay between recommendation and LLM agents, this work advances a deeper understanding of algorithmic bias and provides practical tools to promote inclusive digital spaces. 1 Introduction The filter bubble is a phenomenon that has received much attention since the dawn of recommender systems being used filter content on social media platforms, notably being employed as early as 2011 to personalize the Facebook feed Leung 2013 . The filter bubble is typically defined as the state of being exposed to a narrow scope of content or that which covers only limited set of categories, representing only a small fraction of the possible categories that exist on the platform Pariser 2011 . Filter bubbles are concerning due to their implications on both user satisfaction, which has effects on user retention and platform engagement, as well as for their potential to lock users into an echo chamber of information Nguyen 2020 , which could lead to political polarization Lazovich 2023 . The latter has been cited as a major threat to the normal democratic functioning of society, which is typically premised upon an equitable and free flow of information Santos et al. 2021 ; Vasconcelos et al. 2021 . The impact that filter bubbles have on users, platforms, and society at large explains why many works have been dedicated to tackling this issue, whether through preventing it or interrupting it during its process of formation. The filter bubble has been examined in relation to both traditional social media platforms , long-form video platforms Aridor et al. 2020 and e-commerce platforms Ge et al. 2020 . More recently, however, examination of the filter bubble has converged around a new central point, that of short-video platforms, such as TikTok and Kuaishou. In contrast to traditional platforms, which usually have closed friend or following loops that also serve to personalize a user’s feed, short video platforms have exploded in popularity due to their ability to recommend desirable content from across all the users of the platform. To make this possible, these platforms have developed expansive use of recommender systems, thereby leading to more potential for the creation of filter bubbles. Several works that have addressed the filter bubble on short video platforms have aimed to characterize the phenomenon Piao et al. 2023 ; Li et al. 2022 ; Fu et al. 2024 , as well as remediate it through recommender system and algorithm design strategies Li et al. 2023a ; Li et al. 2024b . As diversity is often viewed as the antithesis to the filter bubble, many works have focused on increasing diversity of recommendations while trying to avoid the trap of the accuracy-diversity dilemma Lu and Tintarev 2018 ; Zheng et al. 2021 ; Zhou et al. 2010 ; Yang et al. 2023 ; Chen et al. 2018 . More recently, the rise of large language models (LLMs) has posed new opportunities to gain insights into the workings of social and technical systems, and recommendation is no different. On the social side, recent works have used LLMs to develop simulations of macro-scale political scenarios such as coalition building Moghimifar et al. 2024 and diplomacy during wartime situations Hua et al. 2024 , whereas on the micro-scale, they have been used to simulate teamwork scenarios for workplace ideation Shaer et al. 2024 ; He et al. 2024 , collaboration Guo et al. 2024 ; Wang et al. 2024b as well as for primary education Liu et al. 2024 . Meanwhile, they have facilitated simulation of technical systems such as social network behavior Jiang and Ferrara 2023 ; Gao et al. 2023 ; Wang et al. 2024a and recommender systems Shu et al. 2024 ; Wang et al. 2024a ; Zhang et al. 2023 . While works such as Wang et al. 2023 and Zhang et al. 2023 However, as yet, no works have been dedicated primarily towards the simulation of the filter bubble as an outcome of the interaction between the recommender system and user feedback. In light of the implications of this newfound avenue for behavioral simulation provided by LLMs, this work fills the gap by simulating the user-recommender interface with special focus on the mechanisms that give rise to the filter bubble. LLMs with their complex, often human-like reasoning, can serve as user-agent who can provide realistic feedback in a recommender system scenario, emulating the dynamics of a real system without the need for extensive online testing or real-world datasets. Due to short-video platforms being the foremost media of content recommendation with the rise of TikTok, Kuaishou, Reels, and YouTube shorts, we focus on simulating the formation of the filter bubble in the short-video scenario. Specifically, our work makes the following contributions: • We propose and implement a simulation framework that integrates real-world short-video data, recommendation algorithms, and artificial user-agents to reproduce the dynamics filter bubble as an outcome of the recommender-user feedback interface. • We conduct extensive analysis across dimensions to discover whether and how well the LLM simulation can give rise to realistic filter bubble and how it it influenced by various factors including both user and item characteristics. • We implement a set of recommender system strategies that can serve to alleviate the occurrence of the filter bubble in the simulated scenario, which can, in turn, be used to suggest designs for implementation in real world recommender systems. 2 Dataset and Methodology (a) Unique categories. (b) Average child categories. Figure 1 : Item data statistics. Figure 2 : The overview of our simulation framework, which is composed of two major components, the LLM module, which acts as a user-agent, and the recommender module, which generates video suggestions for the user to react to. 2.1 Dataset Items. The item dataset is adapted from an open-source real-world dataset from one of the top short-video platforms in China. It consists of over 4000 videos with tags, titles, and categories. Each video has three levels of categories, which are arranged in hierarchical structure, where the lower