A Closer Look on Gender Stereotypes in Movie Recommender Systems and Their Implications with Privacy Falguni Roy, Yiduo Shen, Na Zhao, Xiaofeng Ding, Md. Omar Faruk Abstract The movie recommender system typically leverages user feedback to provide personalized recommendations that align with user preferences and increase business revenue. This study investigates the impact of gender stereotypes on such systems through a specific attack scenario. In this scenario, an attacker determines users’ gender—a private attribute—by exploiting gender stereotypes about movie preferences and analyzing users’ feedback data, which is either publicly available or observed within the system. The study consists of two phases. In the first phase, a user study involving 630 participants identified gender stereotypes associated with movie genres, which often influence viewing choices. In the second phase, four inference algorithms were applied to detect gender stereotypes by combining the findings from the first phase with users’ feedback data. Results showed that these algorithms performed more effectively than relying solely on feedback data for gender inference. Additionally, we quantified the extent of gender stereotypes to evaluate their broader impact on digital computational science. The latter part of the study utilized two major movie recommender datasets: MovieLens 1M and Yahoo!Movie. Detailed experimental information is available on our GitHub repository: https://github.com/fr-iit/GSMRS.git [orcid=0000-0002-0427-5760] [orcid=0000-0001-5054-8515] keywords Recommender Systems,Gender Stereotypes,User Preferences,Threat Model,Gender Inference,Machine Learning,Privacy 1 Introduction Nowadays, recommender systems are widely used to manage the overwhelming amount of information on the web. They help users by finding what they require while providing economic benefits to service providers. The recommender system even increases the decision-making efficiency of the users by delivering precise recommendations [ 1 , 2 ] . A recommender system (RS) typically consists of two major components, data and algorithm, which work together to produce recommendations. The data component provides the required formatted data for the algorithm. The algorithm then ranks items based on their relevance to users. Once users receive the ranked list of items, they interact with it by clicking, browsing, rating, or reviewing. These interactions, collectively called user feedback, become new data for the RS. This new data is combined with the existing data to improve future recommendations. The main workflow of the RS is cyclic. User feedback is categorized as implicit or explicit [ 3 , 4 ] . Implicit feedback includes the frequency of item views, clicks, and purchases [ 5 ] and is usually assumed to represent positive user feedback. Conversely, explicit feedback includes ratings, reviews, and likes or dislikes provided directly by users. Explicit feedback reflects users’ true feelings and is often considered more accurate than implicit feedback due to the active participation of users [ 6 ] . Additionally, explicit feedback can capture users’ positive and negative, high and low preferences. For example, in the context of the 1-5 rating range, the rating values 5 , 3 , and 1 for an item k indicate the user’s high, neutral, and low preference on the item k , respectively. Similarly, for the like and dislike feedback method, a user’s ”like” or ”dislike” for an item k denotes their positive and negative preference toward the item. Among explicit feedback approaches, ratings are the most widely used form [ 7 , 8 ] . Furthermore, the data component of the RS has two main functions. First, it provides the resources needed to run the algorithm. Second, it publishes data for research purposes [ 9 ] . For example, websites such as MovieLens 1 1 1 https://movielens.org/ , Yahoo 2 2 2 https://www.yahoo.com/entertainment/movies/ , and Netflix 3 3 3 https://www.netflix.com/ are not only popular movie recommender systems but also publish their data 4 4 4 https://grouplens.org/datasets/movielens/ , 5 5 5 https://webscope.sandbox.yahoo.com/ , 6 6 6 https://www.kaggle.com/datasets/netflix-inc/netflix-prize-data for research purposes. Even without publishing the dataset by the RS, the dataset can be created by crawling users’ actions within the system [ 10 ] , using transfer learning in cross-domain applications [ 11 , 12 ] or bridging domain-specific information to target users [ 13 ] . A simple demonstration of how a Recommender System works is presented in Figure 1 . Figure 1: Simple Representation of Recommender System Process Usually, two types of information can be derived from user feedback: the user - item interaction matrix and the user’s behavior history. The user - item interaction matrix contains implicit information about users, such as interaction patterns, demographic details, and personality traits [ 14 , 11 ] . This implicit information creates a privacy vulnerability that adversaries can exploit to access sensitive user data. In the context of the movie recommender system (MRS), the user - item interaction matrix typically includes the user ID, item ID, and a numerical value representing the user’s feedback. This feedback indicates the user’s preference for the corresponding item. Implicit information can be extracted from the user - item interaction matrix by applying inference techniques with machine learning classifier algorithms [ 14 , 15 ] . Conversely, gender stereotypes (GSs) refer to the shared beliefs about specific genders regarding their consumption patterns, preferences, personality traits, proficiency, and behavior [ 16 , 17 ] . These stereotypes not only influence expectations around gender-specific traits but also extend to the types of products, hobbies, and media content deemed suitable for each gender. In the context of movies, specific common beliefs exist regarding gender-oriented movie genre consumption and preferences [ 16 ] . These beliefs, denoted as GSs, are deeply rooted in societal norms and are reinforced through marketing strategies, media portrayal, and cultural expectations, collectively shaping film production and consumption patterns. Gender stereotypes in movie preferences refer to the widely held assumptions about the types of movies men and women are expected to enjoy based on their gender. Societal norms often amplify these stereotypes, creating biases influencing how films are marketed, perceived, and consumed. These stereotypes can be conceptualized as interconnected networks linking gender and movie genres, where specific genres are strongly associated with either masculinity or femininity [ 18 ] . Given the presence of gender stereotypes in movie preferences, this study aims to investigate how these stereotypes manifest in the context of movie recommendations and user behavior. Specifically, it seeks to answer the following questions: • RQ1: What are the gender stereotypes in the case of movie preference? • RQ2: Does the gender stereotype exist in the movie recommender system? – RQ2.1: If so, what is the magnitude of the presence of gender stereotypes in the movie recommender system? In answering these questions, the paper makes the following four-fold contributions: • We define the gender stereotypes of movie preferences with the updated list of genres by conducting a user study with 630 samples 7 7 7 The authors can provide the original questionnaires & anonymized data upon request . • We investigate gender stereotypes’ existence in the movie recommender system with magnitudes of the GS’s presence on the two popular publicly available datasets named MovieLens 1M (ML1M) and Yahoo!Movie by the state-of-the-art machine learning classifiers. We have chosen rating as the users’ explicit behavior. • We also state the implications of gender stereotypes’ presence in the context of privacy and bias issues of the recommender system. • Our final contribution is sharing the experimental code used in our study. This allows other researchers to easily recreate our results and employ them as a standard for comparison. The rest of the sections are outlined as follows: Section 2 demonstrates a list of existing literature that aligns with the present work. Section 3 explains the study’s methodology. The experimental details with the results of the research questions are manifested in Section 4 . In the last Section 5 , we conclude the study by summarizing the findings and limitations by discussing the potential avenues for future research. 2 Related Work 2.1 Research on Gender Stereotypes Researchers have investigated various domains to determine whether gender stereotypes (GSs) exist in the corresponding areas of study. They have identified a strong presence of GSs across diverse contexts, from surgeons and robots to daily life scenarios such as workplaces, homes, and digital behavior [ 19 , 20 , 21 , 18 , 22 , 16 ] . For example, Fabris et al. 2020 examined the presence and impact of GSs on information retrieval systems and search engines. They explored gender bias encoded in word embeddings and its influence on the search results. Gender stereotypes were measured by applying implicit association tests on word embeddings. Word embeddings typically capture well-known stereotypes related to gender, and the genderedness score of a word is used to measure its association with masculinity or femininity. According to their analysis, models utilizing biased word embeddings for semantic analysis are highly susceptible to reinforcing GSs. However, neural models relying on original word representations can minimize this effect. Similarly, Ahn et al. 2022 investigated the interactions between users and artificial intelligence (AI) agents in e-commerce, focusing on the effects of GSs on the perceived reliability of AI recommendations. Their findings indicated that individuals tend to associate competence with male AI agents and warmth with female AI agents. Additionally, in e-commerce, users express greater satisfaction with recommendations from female AI agents for hedonic products, while perceived male AI agents are more persuasive for valuable products. They also concluded that trust in AI recommendations varies based on the perceived gender of the AI agent. Furthermore, Lange et al. 2021 examined GSs in digital gaming and found that males prefer achievement-oriented, competitive, and aggressive games, while females favor music and dance games, quiz games, and educational games. According to their study, GSs regarding digital game genre preferences exist and can harm players by preventing them from pursuing their individual preferences. While some stereotypes in this context reflect fundamental differences between genders, others are inaccurate in size or scope. Moreover, Wühr et al. 2017 explored GSs in movie genre preferences, noting that males prefer aggressive, conflict-driven genres, whereas females prefer movies emphasizing social relationships. Their study confirmed the existence of GSs in digital media, particularly in movie preferences, and claimed that these stereotypes are accurate in direction. 2.2 Research on Private Data Inference Many researchers have studied and identified the correlation between individuals’ public and private data in the digital domain. Public data typically refers to browsing or purchase history, ratings, reviews, and like or dislike information on the web. Conversely, private data refers to information that individuals do not willingly share or disclose online, such as income, age, gender, or political opinions. Most people remain unaware of the link between their public and private information [ 24 ] . A study by Kosinski et al. 2013 demonstrated that using Facebook likes, a wide range of sensitive information about a user, such as age, gender, personality traits, intelligence, happiness, and parental separation, can be predicted with 85-95% accuracy. Similarly, Bi et al. 2013 investigated the acquisition of demographic traits, such as age, gender, and even political and religious views, from search queries, achieving up to 80% accuracy. Additionally, Feng et al. 2014 showed that users’ private data can be identified from their implicit viewing history on online video systems. However, private data may vary among individuals. For instance, some people share their living location on social networks, while others consider it private. Jia et al. 2017 illustrated that it is possible to infer a user’s private attributes, such as location and interests, using data from a fraction of other users who share this information on social networks by applying regression algorithms. Furthermore, the context of private data may differ across recommender systems. For example, a user might disclose personality information in a tourism recommender system to receive precise recommendations but may choose not to reveal the same data on an e-commerce website. Nevertheless, it is possible to gain the user’s private data by applying transfer learning knowledge in the cross-domain. Wang et al. 2021 proposed a framework to solve the personality trait classification problem in a cross-domain setting using predictive text embedding for transfer learning. The authors deduced users’ personality traits in the target domain by leveraging transfer learning from the source domain. They further suggested utilizing this information to enhance the performance of target recommender systems by improving prediction accuracy. In some cases, users’ private data can be inferred using only the rating values they provide in a system, which indicate their degree of preference and satisfaction with consumed items. Weinsberg et al. 2012 pioneered the study of private data inference, focusing on gender as private data, and achieved 80% inference accuracy. They also proposed a solution to address privacy threats identified in their study. Later, Feng et al. 2015 extended this approach to infer users’ gender and age and developed a module between users and recommender systems to preserve privacy. Similarly, Salamatian et al. 2015 applied inference algorithms to detect users’ political views based on their history of watching political or TV shows and their ratings. Following this approach, Slokom et al. 2021 focused on inferring users’ gender from rating data and proposed a solution to preserve the privacy of the entire user-item interaction matrix. Existing studies on recommender systems mainly focus on enhancing recommendation performance in terms of accuracy by integrating users’ public and private data or addressing privacy concerns through proposed solutions. However, limited attention has been given to understanding the root causes of privacy vulnerabilities while users’ public and private data contain strong correlations. As a consequence, this study aims to fill this gap by investigating whether GSs embedded in movie preferences can be leveraged to infer users’ private attributes, such as gender, from their interaction data within Movie Recommender Systems (MRS). Unlike previous works, which often propose solutions for privacy preservation of the system, this research focuses solely on identifying the existence and extent of the problem. To achieve this, we first identified potential GSs associated with various movie genres through a user study. Then, we verified their presence as the preference of the items consumed by users, using explicit ratings as feedback to compile users’ interaction data. Afterward, we quantified the prevalence of GSs within the system to determine their impact on user privacy. Our findings indicate that the existence of GSs in MRS data increases the likelihood of adversaries inferring users’ private data by correlating stereotypes with their preferences. While this study does not propose solutions, it provides a critical foundation for future research to develop privacy-preserving mechanisms by considering the risks posed by GSs in recommender systems. 3 Study Design & Methodology This section contains three subsections. In the first subsection, we set gender-wise hypotheses to measure the movie genre preferences as GSs. In the consecutive subsection, we apply the output of the previous subsection in the different inference algorithms to find the presence of GSs in the MRS, and the magnitude of the presence of GSs is measured in the last subsection. 3.1 Gender Stereotypes Detection for Movie Preference Watching movies is one of the most popular forms of entertainment that people often select for amusement. Usually, movies contain strong characteristics that can impact audiences by providing a social message and introducing moral values and cultural differences. Additionally, movies can be a tool for quickly learning and understanding different languages and may even play a role in psychotherapy [ 30 ] . The existing literature shows that movie selection primarily depends on people’s demographic (gender, age, and personality) differences, genre preferences, consumption frequency, and cognitive and affect elements, such as psychographics [ 31 ] . In addition, demographic information is an important parameter for advertising and marketing campaigns, as it aids in understanding genre preferences and consumption frequency [ 32 ] . Typically, for watching a movie, females are supposed to watch romance, relationships, and emotional themes movies, which focus on interpersonal relationships, love stories, and personal growth. These preferences reflect an inclination toward movies focusing on emotional connections between characters. Conversely, males are perceived to watch ”guy flicks” movies. The ”guy flicks” movies are generally focused on fast-paced action sequences and fear enjoyment, such as car chases, explosions, physical feats, and shocking visuals that raise fear feelings [ 16 , 31 , 33 , 34 ] . Genre preferences are most strongly influenced by gender, often aligning with traditional GSs [ 35 ] . The approximate origins of GSs in movie preferences can be attributed to media content, biological factors, and social theory [ 16 ] . For example, by considering biological accounts, testosterone, a hormone predominantly found in males, is associated with behaviors characterized by dominance [ 36 ] . This correlation could explain why males are more interested than females in movies centered around competition and action-adventure themes. On the other hand, the oxytocin hormone, primarily associated with females, is believed to foster pair bonding and generate feelings of love in humans [ 36 ] . From a neurobiological standpoint, this distinction might underlie females’ heightened inclination toward relationships and love story category’ movies. Accordingly, we set the following hypotheses to define the GSs for movie genre preference to determine the answer to the RQ1 . • H1: Females prefer movies centered on social relationships more than males, especially those affiliated with romance, drama, and family genres. • H2: Males prefer movies centered on aggressive conflicts & dominant themes more than females, particularly in genres such as horror, action, adventure, fantasy, crime, and war. 3.2 Gender Inference Algorithm Generally, when selecting a movie to watch, users first choose a genre and then select a movie within that genre [ 31 , 37 ] . Additionally, demographic factors, such as gender, significantly influence the selection of movie genres [ 31 , 38 ] . Based on these observations, we propose the following threat model: Adversary: A party interested in users’ private attributes could include advertisers, banking institutions, insurance companies, or cybercriminals [ 28 ] . Threat Model: Assume that the adversary has access to a gender classifier and the necessary data, along with gender stereotypes, to train the classifier. The adversary’s objective is to infer users’ gender attributes. To achieve this, the adversary constructs a user-item interaction matrix using the available data. By leveraging the interaction matrix and gender stereotypes, the adversary can potentially deduce the target users’ gender information. DEFINITION: ( Gender Inference Problem ) . Suppose an adversary has 1) binary gender attributes, 2) user-item interaction data, 3) names or genres of items, 4) knowledge about gender stereotypes of movie preferences, 5) a set of target users, and 6) a classifier. The gender inference aims to deduce whether the gender of each target user is male or female. The mathematical formulation of the gender inference problem is shown in Equation 1 : \begin{matrix}[R_{UI}\;|\;GS_{M,F}]\xrightarrow[u\in U]{classifier}u_{G}\;\;\;\;\;\;\;where,\;\;\;G\;\in\;M\;||\;F\\ \\ GS_{M,F}=d_{M}\cup d_{F}\end{matrix} (1) Here, R_{UI} denotes user-item interaction data. GS_{M,F} indicates GSs of movie preferences for the users and u_{G} expresses the gender of the target user, which can be either male ( M ) or female ( F ). U implies the set of target users. Furthermore, to detect the existence of GSs in the MRS by taking into account the threat model (Equation 1 ), we first measure the degree of male and female genre preference ( d_{M} and d_{F} ) as per GSs in all rated movies for a user by using the Equation 2 . Actually, d_{M} and d_{F} indicate the extent to which a user consumes items from genres associated with the corresponding GSs. Afterward, the degree of male and female genre preferences and the user-item interaction matrix are used as feature vectors to train the gender classifier. \begin{matrix}d_{M}=\sum_{i=1}^{I}g_{i}\cap g_{GS_{M}}\\ \\ d_{F}=\sum_{i=1}^{I}g_{i}\cap g_{GS_{F}}\end{matrix} (2) Here, I denotes the consumed items set, and i indicates each item, where i\in I , respectively. g_{i} defines the list of genres belonging to item i , whereas g_{GS_{M}} and g_{GS_{F}} denote the list of genres associated with GS of male and female. 3.3 GSs Presence Measurement in RS The value of the area under the curve (AUC) ranges between 0 and 1. If the AUC value for the gender inference algorithm is greater than 0.50, it indicates that the algorithm can distinguish between the classes. This also suggests that the data implicitly contains GSs related to movie preferences. To assess the degree of GS presence, we compare the proportions of male and female genre preferences with the actual gender data of the users using Equation 3 . \begin{matrix}u_{GS}=(1-\frac{K}{U})*100\;\;\;\;where\\ \\ K=\sum_{k=1}^{U}g((k_{G}=F\land d_{M_{k}}>d_{F_{k}})\lor(k_{G}=M\land d_{M_{k}}