LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models

\authorblockN Ryutaro Oshima \authorrefmark 1 and Yuya Hosoda \authorrefmark 2 and Youji Iiguni \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Osaka, Japan Email: [email protected] \authorblockA \authorrefmark 2 Ritsumeikan University, Japan E-mail: [email protected] · 2026

Read LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models by \authorblockN Ryutaro Oshima \authorrefmark 1 and Yuya Hosoda \authorrefmark 2 and Youji Iiguni \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Osaka, Japan Email: [email protected] \authorblockA \authorrefmark 2 Ritsumeikan University, Japan E-mail: [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04654.txt.

Introduction

Ryutaro Oshima, Yuya Hosoda, and Youji Iiguni build a speech recognizer that censors as it transcribes, in a 2026 arXiv paper. The design welds a speech model's encoder to a language model's decoder, so one system produces the transcript and simultaneously masks hate-related words, limiting exposure to harmful content. The obstacle is data: teaching the masking behaviour needs annotated hate speech audio, which barely exists.

Their workaround manufactures the data. A language model drafts text samples with chain-of-thought prompting guided by cultural context and examples; speech synthesis voices them. And a filtering step keeps only samples that text classifiers agree are genuinely hateful, with the agreement threshold setting the dataset's hate level for a gradual curriculum. The trained system masked hate words with accuracy near fifty-nine percent, beating previous baselines, and the curriculum improved both transcription and censorship.

Catalog record

CREATOR\authorblockN Ryutaro Oshima \authorrefmark 1 and Yuya Hosoda \authorrefmark 2 and Youji Iiguni \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Osaka, Japan Email: [email protected] \authorblockA \authorrefmark 2 Ritsumeikan University, Japan E-mail: [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04654

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models \authorblockN Ryutaro Oshima \authorrefmark 1 and Yuya Hosoda \authorrefmark 2 and Youji Iiguni \authorrefmark 1 \authorblockA \authorrefmark 1 The University of Osaka, Japan Email: [email protected] \authorblockA \authorrefmark 2 Ritsumeikan University, Japan E-mail: [email protected] Abstract This paper proposes an automatic speech recognition (ASR) model for hate speech using large language models (LLMs). The proposed method integrates the encoder of the ASR model with the decoder of the LLMs, enabling simultaneous transcription and censorship tasks to prevent the exposure of harmful content. Instruction tuning of the LLM to mask hate-related words with specific tokens requires an annotated hate speech dataset, which is limited. We generate text samples using an LLM with the Chain-of-Thought (CoT) prompting technique guided by cultural context and examples and then convert them into speech samples using a text-to-speech (TTS) system. However, some of them contain non-hate speech samples with hate-related words, which degrades the censorship performance. This paper filters the samples which text classification models correctly label as hate content. By adjusting the threshold for the number of correct answer models, we can control the level of hate in the generated dataset, allowing us to train the LLMs through curriculum learning in a gradual manner. Experimental results show that the proposed method achieves a masking accuracy of 58.6% for hate-related words, surpassing previous baselines. We also confirm that the curriculum training contributes to the efficiency of both transcription and censorship tasks. This paper includes offensive or hateful contents but does not refer to any particular group or individual. 1 Introduction Streaming systems on audio-based social network service (SNS) platforms, such as YouTube and TikTok, have shaped the global real-time communication style. Emotional connections influence purchase intentions for viewers, highlighting streaming media as a vital position in digital marketing [ 4 , 23 ] . Besides these benefits, platforms must contend with the challenge that harmful content can rapidly spread across borders. Hate speech, targeting individuals or groups based on attributes such as race and religion, remains a societal issue. Exposure to hate speech inflicts psychological harm on victims and also diminishes empathy for observers beyond direct victims [ 21 , 6 ] . Without proper safeguards, these behaviors could become accepted in everyday interactions [ 19 ] . Censorship mechanisms for hate speech are crucial to preserving the integrity of a healthier commerce environment and protecting human rights. Researchers have developed various detection methods for inappropriate text content, such as sarcasm [ 7 , 11 ] and privacy information [ 14 , 5 ] . Since context understanding is crucial, natural language processing models have been utilized for detecting hate speech [ 10 , 18 ] . The Bidirectional Encoder Representations from Transformers (BERT)-based model achieves identifying hate content across multilingual languages in text-based SNS platforms [ 2 ] . Sabry et al. proposed a hate language identification method using the Text-to-Text Transfer Transformer (T5)-based model, highlighting the potential for detecting hate-related words based on model explainability [ 20 ] . LLMs are superior to understanding broader contextual structures and can generate semantically consistent sentences through instruction tuning, which enables them to specialize in specific tasks [ 16 , 25 ] . It has been reported that the introduction of LLMs improves accuracy in hate speech detection [ 8 , 1 ] . Throughout this paper, we focus on detecting hateful content in spoken utterances; unless otherwise noted, the term “hate speech” therefore denotes audio (speech) that contains such expressions. Hate speech detection approaches on audio-based SNS platforms are an extension of text-based ones. Nandwana et al. [ 17 ] proposed a multimodal system for identifying hate speech in videos, with a focus on text-based detection. An et al. [ 3 ] transcribe the speech content using an ASR model and classify it using the BERT model. Local Interpretable Model-agnostic Explanations (LIME) for the classification model provide insight into how individual words contribute to the results, allowing for the identification of hate-related words. However, LIME is challenging in correctly identifying idiomatic expressions or nuanced contexts. Also, it cannot detect multiple hate-related words within a single utterance as their contributions to the classification result are distributed. This paper proposes an automatic hate speech recognition model utilizing LLMs, which are capable of detecting multiple hate-related words within a single sentence. Due to content filters, explicit hate speech expressions are often restricted, making it difficult to transcriptions with hate-related words into LLMs directly. The proposed method focuses on a multitask model that integrates the encoder of the ASR model into LLMs as the decoder [ 26 , 22 ] . Since hate-related words are implicitly input into LLMs, the integrated model enables simultaneous transcription and censorship tasks to mask them with specific tokens. Instruction tuning requires much speech samples due to their large parameter sizes, but the annotated audio datasets are limited. We generate text samples using an LLM and then convert them into speech samples using a text-to-speech (TTS) model. However, they may contain non-hate speech samples including hate-related words, which degrades the censorship performance. We exclude them by scoring the hate level using text classification models. The contributions of this paper are as follows: 1. We define the concept of hate speech through the CoT prompting technique, using example sentences, the backgrounds, and targets of discrimination, allowing us to generate more realistic hate speech texts including specified hate-related words. 2. The proposed method can control the hate level of the generated dataset through the threshold process, allowing us to train the the integrated ASR model through curriculum learning in a gradual manner. 3. Experimental results demonstrate that the proposed method simultaneously achieves the transcription and censorship processes, highlighting that the fine-tuning processes of the encoder and decoder impact their performance. 2 Methods 2.1 Annotated Hate Speech Dataset Generation We employ data augmentation to address the shortage of annotated datasets for hate speech. HateXplain [ 15 ] contains 20,148 sentences sourced from the text-based SNS platforms X (formerly Twitter) and Gab to analyze the language expressions contributing to the perception of hate speech. Three annotators independently annotate each sentence to judge the category (”Hateful,” ”Offensive,” ”Normal,” or ”Undecided”). When a sentence contains hateful content, they also annotate the target, such as ”Women” and ”African,” and highlight words that support their decision. 5,945 sentences are unanimously labeled as ”Hateful” by all three annotators, which is the core data for generating hate speech samples. However, some samples contain slangs and visual symbols such as emoticons, which are difficult for ASR models to transcribe accurately. We manually selected 602 sentences without them as the original dataset. First, we extract high-frequency words from the hateful sentences and then select keywords using five state-of-the-art text classification models [ 13 , 2 , 24 , 3 ] . They are pre-trained on different datasets to identify topics with two labels: ”hate” and ”normal”. This paper defines a word as a hate-related keyword when at least three out of the five models are classified as hate to enhance the reliability of the selected keywords. Second, we utilize Qwen2.5-1.5B-Instruct to generate hate speech samples, including those with specified keywords. The text generation process follows a CoT prompting strategy

Read the complete text