Context-Aware Content Moderation for German Newspaper Comments
Felix Krejca, Tobias Kietreiber, Alexander Buchelt, Sebastian Neumaier · 2025
Read Context-Aware Content Moderation for German Newspaper Comments by Felix Krejca, Tobias Kietreiber, Alexander Buchelt, Sebastian Neumaier (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20963.txt.
Introduction
Felix Krejca, Tobias Kietreiber, Alexander Buchelt and Sebastian Neumaier test context-aware moderation of German newspaper comments in their 2025 arXiv paper. Hate speech tools are well studied for social media, but German newspaper forums are not, and most tools ignore context such as user history and article theme.
Working with a corpus of one million posts from the Austrian newspaper Der Standard, they trained LSTM and CNN classifiers and also tried ChatGPT in zero-shot mode. Adding context improved the neural models, making them competitive with state-of-the-art methods. ChatGPT, by contrast, gained nothing from context and lagged behind, a caution about general chatbots for moderation.
Catalog record
| CREATOR | Felix Krejca, Tobias Kietreiber, Alexander Buchelt, Sebastian Neumaier |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20963
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Context-Aware Content Moderation for German Newspaper Comments Felix Krejca, Tobias Kietreiber, Alexander Buchelt, Sebastian Neumaier Abstract The increasing volume of online discussions requires advanced automatic content moderation to maintain responsible discourse. While hate speech detection on social media is well-studied, research on German-language newspaper forums remains limited. Existing studies often neglect platform-specific context, such as user history and article themes. This paper addresses this gap by developing and evaluating binary classification models for automatic content moderation in German newspaper forums, incorporating contextual information. Using LSTM, CNN, and ChatGPT-3.5 Turbo, and leveraging the One Million Posts Corpus from the Austrian newspaper Der Standard, we assess the impact of context-aware models. Results show that CNN and LSTM models benefit from contextual information and perform competitively with state-of-the-art approaches. In contrast, ChatGPT’s zero-shot classification does not improve with added context and underperforms. 1 Introduction With the rising quantity of text data in different kinds of media, the theoretical understanding and the practical implications of automatic content moderation based on machine learning techniques is more important than ever. Recent developments, such as the EU Digital Services Act (DSA) and other regulatory efforts, highlight the growing pressure on platforms to implement transparent and effective content moderation systems. 1 1 1 https://digital-strategy.ec.europa.eu/en/policies/dsa-impact-platforms#ecl-inpage-lo5phy1n , last accessed 2025-02-05 Manual moderation, while thorough, often exposes moderators to distressing material, leading to significant emotional and psychological challenges. Studies have documented that content moderators frequently encounter graphic and harmful content, resulting in conditions such as post-traumatic stress disorder, anxiety, and depression [ 27 ] . AI-driven moderation has the potential to diminish the emotional toll on moderators by handling straightforward decisions, thereby reducing their exposure to harmful material. While much of the recent research has focused on detecting hate speech and offensive language in social media (e.g., [ 1 , 16 , 19 ] ), limited studies have explored automated content moderation within German-language newspaper forums. Moreover, most existing research in this area does not utilize platform-specific context information, such as user posting history or details about the article under which a comment is posted (e.g., [ 2 , 25 , 26 , 31 , 21 , 13 , 12 ] ). This paper contributes to this branch of research by providing novel approaches for binary automatic content moderation with new ways of using platform-specific contextual information, to decide if a comment should stay online (0) or be removed (1), for German newspaper comments, using LSTM, CNN and LLM (ChatGPT: GPT-3.5-Turbo) 2 2 2 https://platform.openai.com/docs/models/gpt-3-5-turbo/ , last accessed 2025-02-06 models. We compare the models and prompts to the state-of-the-art classification models for automatic content moderation and offensive language classification of German newspaper comments (e.g., [ 2 , 26 , 29 ] ). We address the following central research question: How do LSTM, CNN, and LLM models incorporating contextual information perform in binary automatic content moderation tasks for German newspaper comments compared to previous classification approaches? To explore this question, we use the One Million Posts Corpus [ 26 ] , which comprises 1,000,000 posts from the Austrian newspaper Der Standard. 3 3 3 https://www.derstandard.at/ , last accessed 2025-02-06 Our findings show that CNN and LSTM models enhanced with contextual information achieve competitive performance compared to state-of-the-art transformer-based models such as BERT [ 2 , 31 , 21 , 12 ] . However, we also demonstrate that incorporating contextual information does not significantly improve the zero-shot classification performance of ChatGPT 3.5 Turbo in terms of accuracy and F1-score. The remainder of this paper is structured as follows: Section 2 provides a review of the relevant literature and theoretical foundations, defining key concepts and presenting a taxonomy of existing methods in the field. Section 3 outlines the methodology, including data preprocessing, the architectures of the CNN and LSTM models, and the prompt configurations used for ChatGPT. Section 4 presents the results, comparing our findings to existing studies. Finally, Section 5 concludes the paper by summarizing key insights and highlighting directions for future research. 2 Background & Related Work 2.1 Hate Speech, Offensive Language, and Platform Guidelines In line with existing literature, we define automatic content moderation as the use of computational decision programs to determine whether user-generated content (e.g., a post) complies with platform-specific rules. Based on this assessment, an appropriate moderation action is taken (e.g., the post is removed) [ 7 ] . In contrast, manual content moderation refers to human moderators making these decisions instead of an automated system. In the literature, several terms are closely linked to content moderation decisions, including hate speech [ 5 , p. 85] , abusive language, cyberbullying, and offensive language [ 30 ] . Understanding these concepts is essential for analyzing recent research and, in particular, the annotation guidelines used for manual labeling in content moderation studies [ 5 , 30 ] . Fortuna & Nunes [ 5 ] provide an overview of various hate speech definitions, highlighting key aspects: (1) targeting specific groups based on characteristics like ethnicity or religion, (2) intent to incite violence or hatred, (3) language that demeans or attacks these groups, and (4) challenges in distinguishing hate speech from humor, particularly on platforms like Facebook. Waseem et al. [ 30 ] define abusive language along two dimensions: (1) whether it targets individuals or generalized groups, and (2) whether the abuse is overt or implicit. Explicit abuse includes clear slurs, while implicit abuse is often obscured by sarcasm or ambiguous language, making detection more challenging. Since hate speech is a subset of abusive language, broader definitions such as offensive language may be more applicable in content moderation. Zampieri et al. [ 32 ] define offensive language as “any form of non-acceptable language (profanity) or a targeted offense, whether veiled or direct.” Hate speech and offensive language are just one part of content moderation, which in newspaper forums often follows platform-specific rules. For example, Der Standard moderates not only for offensiveness but also for relevance, spam, personal data, and legal compliance. 4 4 4 Der Standard Community Guidelines, https://www.derstandard.at/communityrichtlinien , last accessed 2025-02-06 This work explores how machine learning can be trained to reflect such platform-specific guidelines for more effective automated moderation. 2.2 Datasets for Automatic German Newspaper Moderation The One Million Posts Corpus [ 26 ] is a German-language dataset featuring user comments from the Austrian newspaper DerStandard, annotated for content moderation. It includes 1,000,000 binary-labeled posts (online/offline) and 11,773 multi-labeled posts, categorized by professional moderators based on factors such as sentiment, relevance (on-/off-topic), inappropriate language, discrimination, feedback, personal stories, and argumentation. The dataset provides rich contextual information, including comment structure, timestamps, article metadata, and user interactions. The dataset is widely used in research on automated moderation in German newspaper forums [ 26 , 2 , 31 ] . Given its large-scale binary-labeled data, it serves as a robust benchmark for training and evaluating models in this study. The Rheinische Post dataset [ 2 ] consists of user comments from the Rheinische Post website, 5 5 5 https://rp-online.de/ , last accessed 2025-02-06 annotated by moderators and crowdworkers using a custom labeling schema that includes offensive categories (e.g., sexism, racism, insults) and organizational labels (e.g., advertisement, meta-discussions). Unlike the One Million Posts Corpus, the Rheinische Post dataset lacks contextual information for the