What’s Taboo for You? An Empirical Evaluation of LLMs Behavior Toward Sensitive Content

Alfio Ferrara, Sergio Picascia, Laura Pinnavaia, Vojimir Ranitovic, Elisabetta Rocchetti, Alice Tuveri · 2025

Read What’s Taboo for You? An Empirical Evaluation of LLMs Behavior Toward Sensitive Content by Alfio Ferrara, Sergio Picascia, Laura Pinnavaia, Vojimir Ranitovic, Elisabetta Rocchetti, Alice Tuveri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23319.txt.

Introduction

Language models quietly soften taboo text even when not told to, Alfio Ferrara and co-authors test in a 2025 paper. A small commercial model was asked to paraphrase sensitive sentences. Its rewrites were then scored for how much harshness they lost.

The model shifted text toward milder classes on its own, with sharp drops in insult and taboo terms. The team also tests how well models sort sentences by sensitivity with no training examples. Scores are compared with classic text methods. Hidden softening can distort research data and user voice alike, the authors warn. Knowing the drift exists helps teams decide when a faithful rewrite matters more than a polite one.

Catalog record

CREATORAlfio Ferrara, Sergio Picascia, Laura Pinnavaia, Vojimir Ranitovic, Elisabetta Rocchetti, Alice Tuveri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23319

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What’s Taboo for You? An Empirical Evaluation of LLMs Behavior Toward Sensitive Content Alfio Ferrara, Sergio Picascia, Laura Pinnavaia, Vojimir Ranitovic, Elisabetta Rocchetti, Alice Tuveri Abstract Proprietary Large Language Models (LLMs) have shown tendencies toward politeness, formality, and implicit content moderation. While previous research has primarily focused on explicitly training models to moderate and detoxify sensitive content, there has been limited exploration of whether LLMs implicitly sanitize language without explicit instructions. This study empirically analyzes the implicit moderation behavior of GPT-4o-mini when paraphrasing sensitive content and evaluates the extent of sensitivity shifts. Our experiments indicate that GPT-4o-mini systematically moderates content toward less sensitive classes, with substantial reductions in derogatory and taboo language. Also, we evaluate the zero-shot capabilities of LLMs in classifying sentence sensitivity, comparing their performances against traditional methods. Disclaimer : This paper includes examples of sensitive and very offensive language solely to illustrate the behavior of LLMs navigating sensitive language. 1 Introduction Recent progress in the development of large language models (LLMs) has substantially transformed the way humans and machines communicate. These systems understand context and even perceive emotional cues, making conversations with machines feel much more natural and human ( Liu 2024 ) . One evident characteristic of these models is their tendency toward politeness, formality, and content moderation (unless prompted otherwise). Users interacting with ChatGPT often notice responses characterized by respectfulness and refinement, regardless of the tone used in the user’s prompt. Besides outright refusals, usually triggered by inputs that violate OpenAI’s community guidelines and policies 1 1 1 https://openai.com/policies/usage-policies ( OpenAI 2024a ) , there is an indication that proprietary GPT-based models subtly sanitize or moderate content even when no explicit violation occurs. State-of-the-art LLMs are trained using alignment techniques (e.g., Reinforcement Learning from Human Feedback, RLHF) to follow ethical guidelines and avoid harmful language ( Ouyang et al. 2022 ) . With that in mind, if such a model is asked to paraphrase text containing sensitive content, it might instinctively sanitize the output by, for example, removing slurs, aggressive tones, or profanity. While this kind of transformation could be highly beneficial from a content moderation perspective, limited research has quantified this implicit sanitization effect during paraphrasing. We empirically investigate and quantify content moderation within the context of paraphrasing. Specifically, we examine whether LLMs autonomously sanitize content during text generation and assess the extent to which this occurs through expert human judgment. Additionally, we explore how well LLMs can replicate human judgment in identifying problematic content. To this end, we set up an annotation task that classifies content into four sensitivity categories, listed here from least to most sensitive: Formal/Polite , Informal , Derogatory , and Taboo . We compare human expert annotations with the zero-shot classification output from LLMs to evaluate how closely LLMs’ perception of sensitivity aligns with that of humans. Furthermore, we trained traditional text classifiers on the expert annotations and compared their performance to that of the LLMs, providing an extra baseline for evaluating LLMs performance. This evaluation also offers the added benefit of determining whether a lightweight local model or traditional methods can reliably predict the same categories and detect sensitivity shifts as effectively as human annotators, potentially serving as a cost-effective alternative for monitoring LLM behavior at scale ( Kumar et al. 2024a ; Dementieva et al. 2024 ) . In summary, our study is driven by the following research questions (RQ): (RQ1) Do proprietary LLMs perform implicit content moderation during paraphrasing, and if so, how significant are the changes in sensitivity compared to the original content? (RQ2) How closely do LLMs’ sensitivity perceptions align with humans, and how effectively can automated methods replicate human annotations and detect changes in sensitivity during paraphrasing? The paper is structured as follows: Section 2 reviews research on LLM alignment, moderation, and their use in content moderation and text detoxification; Section 3 outlines our experimental design, including dataset construction, human annotations and automated classification, and evaluation methods; Section 4 presents our findings; Section 5 discusses the limitations of this work; Section 6 offers final thoughts. 2 Related Work Our work sits at the intersection of alignment, content moderation, and text refinement in LLMs, examining how an aligned paraphrasing model navigates sensitive language. Alignment and moderation in LLMs. As LLMs gain popularity, researchers have focused on techniques to reduce harmful outputs. OpenAI uses fine-tuning and reinforcement learning from human feedback (RLHF, Ouyang et al. 2022 ) to mitigate toxicity and bias, with GPT-4 showing an 82% reduction in disallowed content compared to GPT-3.5 and a significant drop in toxic output from 6.48% to 0.73% on the RealToxicityPrompts dataset ( OpenAI 2024a ; Gehman et al. 2020 ) . In contrast, Anthropic’s “Constitutional AI” method employs NLP rules for self-critiquing and revising responses, improving harmlessness without heavy human annotations ( Bai et al. 2022 ) . These approaches enable models to act as their own content moderators, either rejecting or modifying harmful outputs. LLMs as content moderators. Recent research has also evaluated LLMs as content moderators on user-generated text ( Gilardi et al. 2023 ; Kumar et al. 2024b ; Vargas Penagos 2024 ) , leveraging their understanding of context. In particular, Vargas Penagos 2024 explores whether LLMs can automate decisions about what online content should be removed or allowed. It emphasizes that content moderation is not solely about removing illegal posts, but also about handling “lawful but awful” content, material that may be offensive yet legally protected. This poses unique challenges in balancing users’ rights with the need to maintain a safe public discourse. LLMs for text detoxification and politeness transfer. Style transfer for polite rephrasing (also known as text detoxification) focuses on transforming text to remove or reduce offensive content while preserving meaning. One approach combines paraphrasing with style control to eliminate toxicity, such as using T5 ( Raffel et al. 2020 ) for paraphrasing and GPT-2 ( Radford et al. 2019 ) to replace toxic words ( Dale et al. 2021 ) . They also explore methods where BERT ( Devlin et al. 2019 ) is used to substitute offensive words with neutral synonyms. Som et al. 2024 proposes an in-context learning approach to offensive content paraphrasing, noting that paraphrasing can be a preferable alternative to the outright removal of toxic posts. Niu and Bansal 2018 demonstrates that a model can generate responses using a politeness classifier in a feedback loop during generation. Tag-and-generate approaches have been proposed to transform rude sentences into polite ones ( Madaan et al. 2020 ) . These studies typically use parallel data or carefully curated datasets to ensure that the content remains the same while the style changes. Our work empirically examines text sanitization and shifts in sensitivity without relying on explicit detoxification instructions, as seen in prior research. This allows us to observe potential sensitivity changes driven by the implicit style transfer of LLMs. Additionally, our approach is unique in that the parallel data is generated implicitly by the LLM itself, which paraphrases a selection of sentences. 3 Experimental Design In this section, we present the process designed for studying the behavior of LLMs toward sensitive language, exploiting their paraphrase and zero-shot classification capabilities. Firstly, Section 3.1 discusses the collection of the original sentences and

Read the complete text