Stereotypical gender actions can be extracted from Web text This is a preprint of an article accepted for publication in Journal of the American Society for Information Science and Technology copyright ©2011 (American Society for Information Science and Technology).

Amaç Herdağdelen, Marco Baroni · 2025

Read Stereotypical gender actions can be extracted from Web text This is a preprint of an article accepted for publication in Journal of the American Society for Information Science and Technology copyright ©2011 (American Society for Information Science and Technology). by Amaç Herdağdelen, Marco Baroni (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02740.txt.

Introduction

Amaç Herdağdelen and Marco Baroni show that stereotypical gender actions can be extracted from Web text. Their paper mines large corpora and Twitter for the actions people link to men and women.

A commonsense knowledge base supplied actions tied to daily life, keeping the focus practical. Gender signals came from Twitter user data and from pronoun and name patterns in Web text. Corpus-based predictions correlated well with a human gold standard, and predicted its polarity with fair accuracy. The authors conclude that natural text can augment commonsense repositories with stereotypical expectations. They also release a dataset of hundreds of actions rated by human judges.

Catalog record

CREATORAmaç Herdağdelen, Marco Baroni
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02740

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stereotypical gender actions can be extracted from Web text This is a preprint of an article accepted for publication in Journal of the American Society for Information Science and Technology copyright ©2011 (American Society for Information Science and Technology). Amaç Herdağdelen, Marco Baroni Abstract We extracted gender-specific actions from text corpora and Twitter, and compared them to stereotypical expectations of people. We used Open Mind Common Sense (OMCS), a commonsense knowledge repository, to focus on actions that are pertinent to common sense and daily life of humans. We use the gender information of Twitter users and Web-corpus-based pronoun/name gender heuristics to compute the gender bias of the actions. With high recall, we obtained a Spearman correlation of 0.47 between corpus-based predictions and a human gold standard, and an area under the ROC curve of 0.76 when predicting the polarity of the gold standard. We conclude that it is feasible to use natural text (and a Twitter-derived corpus in particular) in order to augment commonsense repositories with the stereotypical gender expectations of actions. We also present a dataset of 441 commonsense actions with human judges’ ratings on whether the action is typically/slightly masculine/feminine (or neutral), and another larger dataset of 21,442 actions automatically rated by the methods we investigate in this study. Introduction Online social networks and micro-blogging services are no longer limited to the followers of the latest technologies or teenagers, as might once have been expected. Such technology and services are becoming widely adopted by the mainstream population as an integral part of their daily lives ( Fox et al. 2009 ) . A very prominent example of such an application is Twitter, a micro-blogging service. Twitter lets its users post very short (at most 140-character) messages – which are called tweets – about what they have been doing or thinking, or what they want to share with their friends and other people. Everyday, tens of millions of tweets are posted by users worldwide. The proliferation of publicly available, user-generated content is a vast source of social data and is already shaping the field of computational social science ( Lazer et al. 2009 ; Thelwall et al. 2010a ) . Another field which enjoys the abundance of Web-based text is knowledge extraction and automated ontology building. An example application is KNEXT ( Kn owledge Ex traction from T ext) – a system proposed for extracting “general world knowledge from miscellaneous texts, including fiction” ( Schubert and Tong 2003 ) . Web-based text is increasingly used as a source for everyday knowledge (frequently referred as commonsense knowledge ). The diversity and sheer amount of text coming from blogs, Web pages, discussions in newsgroups and other social media (e.g. Twitter, Facebook) allows one to cover a wide array of domains and extract a great number of facts. A natural way to move forward in this line of research is to augment the Web text with metadata about the users who created them. The highly personal nature of Web-text data, coupled with the rich metadata that are available on sites such as Twitter, promise to add a new dimension to traditional text-based commonsense knowledge extraction. In this study, we are interested in enriching commonsense knowledge with stereotypical expectations of actions. In a nutshell, our methodology is first to identify verb phrases in a corpus that correspond to commonsense activities, and then extract gender features for a given verb phrase to compute the gender bias of the action, which quantifies whether it is a masculine or feminine action. We compare the predicted bias to the stereotypical expectations of people, collected in a rating task. This allows us to evaluate the performance of our prediction methods. We focus on two methods to predict the gender bias of a given action. The first one relies on the metadata-guessed gender of Twitter users and their tweets. In this case, our assumption is that, in Twitter, people talk about the topics and actions that matter to them. In particular, we assume that if an action is frequently mentioned by one gender, this constitutes strong evidence that the action is a typical behavior of that gender. The second method employs a heuristic based on the gendered pronouns and names occurring with the actions observed in a large corpus of Web documents. In this case, the assumption is that if a particular gender is reported to be carrying out an action frequently, then that action is typically associated with that gender. Background Common sense The holy grail of AI is achieving, if not surpassing, human intelligence, and there is broad consensus that an explicit representation of commonsense knowledge will play an essential role in accomplishing this aim ( Lieberman 2008 ) . Commonsense knowledge has already been exploited in very practical application areas like assisting users of an image retrieval application, by employing knowledge about commonsense activities that relate the terms they search for ( Gordon 2001 ) . Commonsense knowledge consists of the simple facts that nearly every person knows but almost never states explicitly because of the very assumption that it is already shared by everyone. Some examples are that mountains are taller than buildings, grocery has a price, or rivers flow downhill. The assumption that commonsense knowledge is shared is what allows us to communicate with other people and interact with our surroundings in an efficient and natural way. Therefore, an AI system needs to possess common sense if it aims to interact with people in a natural way. In recognition of this problem, the task of providing the computers with the most basic but essential bits of everyday knowledge has become a very hot topic of research in AI and stimulated a number of research projects such as Cyc and Open Mind Common Sense (OMCS) ( Lenat 1995 ; Speer 2007 ) . These projects endeavor to create a repository of common sense that is represented in a computationally accessible manner. Prejudices and stereotypical knowledge present an intriguing aspect of common sense. As human beings, we rely on (and possibly suffer from) stereotypical expectations. Obviously, we would not want to engineer an AI with its own prejudices and stereotypes, but on the other hand, if an AI system is to relate to humans, it should know about the stereotypical expectations as well – whether it’s right or wrong, an AI should know that (we expect that) women like shopping and men like football . Without an explicit knowledge of the stereotypes, such beliefs can be implicit, hidden and intermixed with other “objective” facts in a knowledge base. To quote Sherron (2000) – who talked about Cyc in particular – “Cyc’s common sense might very well ‘believe’ certain stereotypical ideas about women, gender, sexual orientation, etc., and then make inferences based on those ‘beliefs’. Without a strong challenge a homogenizing effect occurs, solidifying the original stereotype among users of the program.” ( Sherron 2000 ) . We believe our work may help to make such knowledge explicit, thus enabling us to deal with the problem of stereotypical beliefs in commonsense repositories. Corpus-based Gender modeling In her influential paper of 1973, Robin Lakoff characterizes some distinguishing aspects of women’s speech as being about trivial issues, apologetic, and

Read the complete text