Balancing Benefits and Risks: RL Approaches for Addiction-Aware Social Media Recommenders

Luca Bolis, Stefano Livella, Sabrina Patania, Dimitri Ognibene, Matteo Papini, Kenji Morita · 2025

Read Balancing Benefits and Risks: RL Approaches for Addiction-Aware Social Media Recommenders by Luca Bolis, Stefano Livella, Sabrina Patania, Dimitri Ognibene, Matteo Papini, Kenji Morita (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05322.txt.

Introduction

Luca Bolis and co-authors present a 2025 paper on social media recommenders that guard against addiction. Feeds give users news, friends, and fun, but their pull can lead to overuse and harm. The team studies how a recommender can keep the benefits of a platform while curbing compulsive use, and still keep the service viable.

They ask how well overuse can be foreseen from the signals a recommender can see. A learning-based framework models how habits form over time, including shifting tastes. The design adapts to each user rather than applying one rule to all. Insights aim at a next round of recommenders that put well-being first.

Catalog record

CREATORLuca Bolis, Stefano Livella, Sabrina Patania, Dimitri Ognibene, Matteo Papini, Kenji Morita
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE10 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05322

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Balancing Benefits and Risks: RL Approaches for Addiction-Aware Social Media Recommenders Luca Bolis, Stefano Livella, Sabrina Patania, Dimitri Ognibene, Matteo Papini, Kenji Morita Abstract Social media platforms provide valuable opportunities for users to gather information, interact with friends, and enjoy entertainment. However, their addictive potential poses significant challenges, including overuse and negative psychological or behavioral impacts [ 4 , 2 , 8 ] . This study explores strategies to mitigate compulsive social media usage while preserving its benefits and ensuring economic sustainability, focusing on recommenders that promote balanced usage. We analyze user behaviors arising from intrinsic diversities and environmental interactions, offering insights for next-generation social media recommenders that prioritize well-being. Specifically, we examine the temporal predictability of overuse and addiction using measures available to recommenders, aiming to inform mechanisms that prevent addiction while avoiding user disengagement [ 7 ] . Building on RL-based computational frameworks for addiction modelling [ 6 ] , our study introduces: • A recommender system adapting to user preferences, introducing non-stationary and non-Markovian dynamics. • Differentiated state representations for users and recommenders to capture nuanced interactions. • Distinct usage conditions—light and heavy use—addressing RL’s limitations in distinguishing prolonged from healthy engagement. • Complexity in overuse impacts, highlighting their role in user adaptation [ 7 ] . Simulations demonstrate how model-based (MB) and model-free (MF) decision-making interact with environmental dynamics to influence user behavior and addiction. Results reveal the significant role of recommender systems in shaping addiction tendencies or fostering healthier engagement. These findings support ethical, adaptive recommender design, advancing sustainable social media ecosystems [ 9 , 1 ] . Keywords: multi-agent systems, recommender systems, addiction, social media 1 Introduction Social media platforms have transformed communication but raise concerns about compulsive use and addiction, driven by recommendation systems optimising engagement at the cost of well-being [ 8 , 3 ] . Unlike pharmacological addiction, social media overuse stems from cognitive limitations and the inability to balance immediate rewards with long-term benefits [ 7 , 6 ] . Reinforcement Learning (RL) frameworks capture these behaviours, modelling interactions between model-based (MB) and model-free (MF) decision-making. However, current models often neglect the adaptive, non-stationary influence of recommender systems on user engagement [ 8 ] . This study enhances RL addiction models by explicitly representing recommender systems, incorporating non-Markovian dynamics, differentiated state representations, and scenarios of light and heavy use. Simulations reveal interactions between MF and MB systems and recommender policies, offering strategies to mitigate addiction while promoting healthier engagement. 2 Methods We define a multi-agent system consisting of a user and a recommender system operating within a shared environment of psycho-physical states. 2.1 User modeling The user is represented by a dual RL system combining a Model-Free (MF) approach, implementing habitual behaviors using Q-learning to maximize cumulative rewards based on past experiences, and a Model-Based (MB) approach: Simulates planning and problem-solving using Q-Value Iteration, leveraging an internal representation of the environment for goal-directed decision-making. A parameter (Model Based Updates per Step) that determines how many updates of Q-Values are made at each iteration. The two approaches were tested both individually and in combination. 2.2 Recommender System modelling The recommender system in this study is implemented as a non-stationary multi-armed bandit (MAB) model, allowing it to dynamically adapt to user preferences through a balance of exploration and exploitation. Each arm of the bandit corresponds to a content recommendation, with rewards derived from user interactions—positive for acceptance and negative or neutral for rejection, reflecting evolving user behavior. This dynamic adaptation is crucial for simulating realistic interactions, as user preferences are often non-static. The non-stationary dynamics are modeled using an exponentially weighted average to prioritize recent interactions while discounting older data, enabling the recommender to adjust to temporal shifts in user behavior [ 9 , 1 ] . Moreover, distinct configurations differentiate short-term and prolonged social media usage. Short-term interactions yield moderate rewards with minimal penalties, while prolonged usage risks significant aftereffects, incorporating a feedback loop between user states and recommender policies. This approach captures the complexity of user-recommender interactions and underscores the potential for recommender systems to influence user behavior subtly but significantly over time. 2.3 Environment design Figure 1: Representation of states and actions for the simplified environment (left) and the advanced environment with refined recommender system (right). The environment models user states ( Healthy , Neutral , Recommender Interaction , and Aftereffects ), actions, and transitions. Three levels of complexity were implemented: 1. Simplified: a minimal structure for debugging and theoretical validation. 2. Advanced: a detailed structure reflecting real-world variability. 3. Refined Recommender System: differentiating short and prolonged social media usage to capture nuanced behavioral impacts (see Figure 1 ). 3 Results To study the performance of our models, 900 simulations were performed for each parameter combination and we considered the average of the individual tests. To analyze the simulation results, two charts were created, focusing on the key entities: the User and the Recommender System. • Evolution of agents: This graph aims to show how many users at a given iteration have developed a suboptimal policy and are, therefore, addicted. An agent that does not follow the optimal policy is defined as an addicted agent. • Q-values of the recommender system: This graph exposes one of the key components of the recommendation system choice process, the Q-values. It shows which content (arm) is preferred by the agent; in particular, for each iteration we can see the amount of reward the recommender system expects to get if it were to present it. 3.1 Key differences in model parameterization: A Dual RL model system comprises two components, Model-Free (MF) and Model-Based (MB), that cooperate to identify the optimal policy. The impact of MF and MB on the expected rewards is determined by a parameter \beta . The Q-Values for the Dual RL model ( Q_{M} ) are calculated as: Q_{M}(s,a)=\beta Q_{MB}(s,a)+(1-\beta)Q_{MF}(s,a). In the simplified, advanced and refined environment, increasing the value of \beta results in a higher number of non-addictive agents as you can see in the Figure 2 , since it’s fully capable of building the entire model of the environment. MBUS (Model Based Updates per Step) is a parameter that determines how many updates of Q-Values are made at each iteration. A higher value increases the time required to complete the operation but results in more reliable estimates and improvement in performance. 3(a) shows the comparison between two simulations performed with the same value of \beta ( \beta = 0.5) and different MBUS values, 1 in blue and 50 in a lighter shade of blue. We can see that the curve for agents that identified the optimal policy grows faster at the beginning with MBUS = 50, an indication that on average users need fewer steps to find the best policy. In the refined environment, the recommender system has to discover which one of the four arms gives the user the best rewards. As you can see in the 3(b) produced in the analysis of the results, it is fully capable of doing so and, therefore, influence the user towards an addictive behavior. (a) \beta =0.25 (b) \beta =0.75 Figure 2: Number of agents who identified the optimal policy in the environment with the refinement of the recommender system.

Read the complete text