Exploration and Evaluation of Bias in Cyberbullying Detection with Machine Learning

Andrew Root, Liam Jakubowski, Dr. Mounika Vanamala · 2024

Read Exploration and Evaluation of Bias in Cyberbullying Detection with Machine Learning by Andrew Root, Liam Jakubowski, Dr. Mounika Vanamala (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00609.txt.

Introduction

Andrew Root, Liam Jakubowski, and Mounika Vanamala probe, in 2024, how bias creeps into machine learning systems that flag cyberbullying. A model is only as fair as its training data, and the team studies three popular datasets. Differing definitions of bullying and differing collection methods already skew what the models learn.

Expansion tricks, which fetch new posts similar to old ones, can deepen the skew. When models trained on one dataset were tested on another, accuracy fell hard, by about twenty-two points on average. The authors argue careful dataset building and cross-dataset testing are essential before such tools are trusted in the real world.

Catalog record

CREATORAndrew Root, Liam Jakubowski, Dr. Mounika Vanamala
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-00609

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploration and Evaluation of Bias in Cyberbullying Detection with Machine Learning Andrew Root, Liam Jakubowski, Dr. Mounika Vanamala Abstract It is well known that the usefulness of a machine learning model is due to its ability to generalize to unseen data. This study uses three popular cyberbullying datasets to explore the effects of data, how it’s collected, and how it’s labeled, on the resulting machine learning models. The bias introduced from differing definitions of cyberbullying and from data collection is discussed in detail. An emphasis is made on the impact of dataset expansion methods, which utilize current data points to fetch and label new ones. Furthermore, explicit testing is performed to evaluate the ability of a model to generalize to unseen datasets through cross-dataset evaluation. As hypothesized, the models have a significant drop in the Macro F1 Score, with an average drop of 0.222. As such, this study effectively highlights the importance of dataset curation and cross-dataset testing for creating models with real-world applicability. The experiments and other code can be found at https://github.com/rootdrew27/cyberbullying-ml. Keywords cyberbullying detection \cdot machine learning \cdot cross-dataset evaluation \cdot biased data collection \cdot dataset expansion methods 1 Introduction Detecting cyberbullying with machine learning (ML) involves dealing with many subtle facets. These facets include but are not limited to, differing definitions of cyberbullying [ 1 ] , varying labeling schemes, and biased data collection [ 2 ] [ 3 ] , all of which introduce bias in the ML models created. Many attempts have been made to address these different forms of bias [ 4 ] [ 5 ] [ 6 ] , but removing bias altogether remains difficult, if achievable. Regardless, measuring and understanding bias remains important for understanding when an ML model is useful. This study takes as its primary concern, the bias introduced from cyberbullying datasets and the applicability of ML for cyberbullying detection. The experiments done in this study are referred to as cross-dataset evaluations, which evaluate ML models on datasets unseen during the training process. These tests are beneficial when there is potential for introducing bias in the data collection and labeling steps of ML. This paper reiterates and explicitly shows that many cyberbullying datasets are only useful so long as the models trained with them make predictions on data points from that same dataset: this is a major concern. When a dataset isn’t useful for creating ML models that perform well on other datasets, this indicates a fundamental difference in the understanding of the task at hand, bias in the dataset, or an error in the methodology. The identification of cyberbullying is a subjective task, as it is dependent upon the labeler and the definition of cyberbullying that the labeler uses. Definitions such as “willful and repeated harm inflicted through the medium of electronic text” used by Reynolds et al. [ 7 ] and “an aggressive, intentional act carried out by a group or individual, using electronic forms of contact, repeatedly and over time, against a victim who cannot easily defend him or herself” used by Van Hee et al. [ 8 ] , have notable differences. More definitions observed in the literature are documented in [ 1 ] . Unsurprisingly, these differences impact the labeling process and the models themselves. With regard to the labeling scheme, many datasets are incompatible due to the nature of the labeling process. For example, one study assigned labels to Twitter users rather than individual tweets [ 9 ] . This level of variation makes it difficult to utilize multiple datasets without major refactoring or relabeling. Often though, the variation in labeling schemes can be as simple as referring to cyberbullying as harassment [ 10 ] . A less explicit form of bias is the bias from data collection methods. Data collection methods used to curate cyberbullying datasets frequently rely on a lexicon of keywords (e.g. the Hatebase.org lexicon) to obtain tweets that include offensive words [ 10 ] [ 2 ] [ 5 ] [ 11 ] , which are believed to be associated with cyberbullying. This leads to an over-emphasis on the keywords and disregards nuanced, less explicit forms of cyberbullying. For example, one study used knowledge of tweets they had currently labeled to pick 17 keywords relevant to cyberbullying and queried for more tweets containing these words [ 12 ] . This clearly brings additional bias into the dataset and unfortunately, this dataset has continued to see usage without acknowledgment of the bias [ 3 ] [ 13 ] . Furthermore, bias in data can also come from semi-supervised learning, or automated dataset expansion methods, as they not only collect data based on keywords but potentially apply a label to the new data points [ 3 ] . This approach is formulated and discussed in greater detail in the Materials and Methods section. A significant challenge in this field is the poor cross-dataset performance, where performance declines substantially when models are applied to datasets different from those on which they were trained. This issue stems primarily from the lexicon-based data collection methods frequently used in cyberbullying research. Lexicons, or predefined lists of offensive terms, are commonly used to capture explicit abusive language. However, this reliance tends to overfit models to the specific language patterns of a single dataset, making them less effective on datasets where abusive language may be more nuanced or context-dependent. For example, Pitsilis et al. [ 14 ] used recurrent neural networks combined with word frequency vectors and user-based features, achieving strong results within their original dataset but facing limitations when attempting to detect nuanced hate speech in others. Similarly, Ruwandika and Weerasinghe [ 4 ] observed that lexicon-dependent models performed well in binary hate/non-hate classifications in local datasets but struggled with non-explicit forms of cyberbullying in different contexts. These examples demonstrate that models highly attuned to one dataset’s language profile often fail to generalize to other datasets, highlighting the need for adaptable data collection strategies beyond lexicons to improve cross-dataset applicability. Improving the real-world applicability of machine learning models is the ultimate goal of this study and preventing, measuring, and interpreting bias throughout the machine learning process is an essential component of this goal. After analyzing many studies and experiments performed, we deemed it necessary to explore the causes and impacts of bias in machine learning, particularly with respect to bias in the data, as we believe this contributes to the goal of creating real-world applicable models. 2 Materials and Methods 2.1 Datasets There are many important aspects of datasets, but this study focuses on the data collection process, the labeling process, and any augmentations that are applied. This section will briefly cover each of these aspects, for each dataset, and direct readers to additional information about the datasets. Furthermore, properties of the dataset relevant to the experiments performed in this study are highlighted. Aside from their differences, the datasets are all composed of Tweets from the social media platform Twitter, and the curators of each dataset were all attempting to detect, what can broadly be described as, cyberbullying. 2.1.1 Dataset 1 This dataset is an aggregate of seven cyberbullying datasets, with additional data points curated via an algorithmic process [ 3 ] . The creation dates

Read the complete text