Gradient Masters at BLP-2025 Task 1: Advancing Low-Resource NLP for Bengali using Ensemble-Based Adversarial Training for Hate Speech Detection

Syed Mohaiminul Hoque *, Naimur Rahman *, Md Sakhawat Hossain * · 2025

Read Gradient Masters at BLP-2025 Task 1: Advancing Low-Resource NLP for Bengali using Ensemble-Based Adversarial Training for Hate Speech Detection by Syed Mohaiminul Hoque *, Naimur Rahman *, Md Sakhawat Hossain * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18324.txt.

Introduction

Syed Mohaiminul Hoque, Naimur Rahman, and Md Sakhawat Hossain report the Gradient Masters system for a shared task on hate speech in Bangla YouTube comments. The task splits in two: naming the type of hate and naming the group it targets. Bangla is a low-resource language for such tools, so strong results are hard won. The team fine-tunes a Bangla language model as an ensemble with adversarial training, a method that hardens the model against tricky inputs.

The system places sixth on hate-type sorting and third on target-group sorting, with scores near seventy-three percent on both. The authors also compare model variants, probe robustness across the build, and study the patterns in its mistakes. Their analysis aims to help future low-resource hate speech work, where data are thin and errors carry social weight.

Catalog record

CREATORSyed Mohaiminul Hoque *, Naimur Rahman *, Md Sakhawat Hossain *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-18324

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gradient Masters at BLP-2025 Task 1: Advancing Low-Resource NLP for Bengali using Ensemble-Based Adversarial Training for Hate Speech Detection Syed Mohaiminul Hoque *, Naimur Rahman *, Md Sakhawat Hossain * Abstract This paper introduces the approach of "Gradient Masters" for BLP-2025 Task 1: "Bangla Multitask Hate Speech Identification Shared Task". We present an ensemble-based fine-tuning strategy for addressing subtasks 1A (hate-type classification) and 1B (target group classification) in YouTube comments. We propose a hybrid approach on a Bangla Language Model, which outperformed the baseline models and secured the 6th position in subtask 1A with a micro F1 score of 73.23% and the third position in subtask 1B with 73.28%. We conducted extensive experiments that evaluated the robustness of the model throughout the development and evaluation phases, including comparisons with other Language Model variants, to measure generalization in low-resource Bangla hate speech scenarios and data set coverage. In addition, we provide a detailed analysis of our findings, exploring misclassification patterns in the detection of hate speech. 1 1 1 Our code and models are available at https://github.com/SyedT1/Shared_Task1_HateSpeech 1 Introduction Both positive discourse and harmful language are amplified by social media where automatic detection of hate speech is crucial. For low-resource languages such as Bangla, practical moderation is made harder by limited labeled data, extreme class imbalance, and noisy user text which includes mixed scripts, transliteration, and frequent typos. The BLP-2025 Task 1 provides a challenging, fine-grained annotation scheme over YouTube comments comprising both (a) hate-type categories (e.g., Abusive, Political Hate, Sexism) and (b) target groups (e.g., Individual, Organization, Community). In this work we try to present an ensemble-based fine-tuning pipeline designed to improve robustness and generalization on this task. Our design choices respond to two task-specific challenges: • Noise & Orthography: Bangla social text shows spelling variation and mixed scripts. To tackle this we apply a lightweight rule-based normalization to reduce orthographic variance. before tokenization. • Adversarial/noisy input: User comments often contain typos, slang, or misspellings. In order to improve model resilience, we apply adversarial fine-tuning using FGSM, perturbing token embeddings during training which simulates realistic input variations. Our contributions are: 1. A reproducible ensemble pipeline for robust Bangla hate speech detection. 2. Empirical analysis of adversarial fine-tuning and normalization effects under severe class imbalance. 3. Error analysis and per-class metrics that identify concrete failure modes for minority categories. 2 Related works Recent work on hate speech detection in low resource languages has evolved significantly. Ghosh and Senapati (2022) analyze transformer-based monolingual and cross-lingual models (e.g., BERT, ALBERT, RoBERTa, DistilBERT, MuRIL) on datasets in Hindi, Marathi, Bangla, Assamese, and new Assamese and Bodo corpora, showing multilingual models generalize better to unseen low-resource languages, though performance varies by language family (Assamese–Bodo vs. Indo-Aryan). Das et al. (2024) surveys hate speech detection in low-resource languages worldwide, cataloging datasets, features, and methods, highlighting dataset scarcity and linguistic variation as key barriers. In code-mixed settings, C V et al. (2024) introduce a multitask framework with XLM-RoBERTa for misinformation and hate speech in Hindi–English posts, demonstrating effectiveness of cross-lingual transformers with tweaks. For Bangla, Al Maruf et al. (2024) survey linguistic nuances (e.g., dialect, script, informal speech) and challenges in hate speech detection. Faria et al. (2024) compare LLMs (GPT-3.5 Turbo, Gemini 1.5 Pro) with traditional classifiers in Bangla via zero- and few-shot learning, achieving gains over SVM baselines. New datasets like BIDWESH Fayaz et al. (2025) and BanTH Haider et al. (2025) provide multi-dialect or transliterated Bangla corpora with fine-grained labels for hate presence, type, and targets (e.g., gender, religion, origin). Earlier Bangla datasets by Karim et al. (2020) ; Romim et al. (2021) ; Romim et al. (2022) offer 30–50K comments for binary or categorical classification. BLP-2023 shared tasks Raihan et al. (2023) ; Tariquzzaman et al. (2023) ; Fahim (2023) advance robust systems: Raihan et al. (2023) use a two-step pipeline for Non-Violence, Passive-Violence, and Direct-Violence with back-translation and multilinguality; Tariquzzaman et al. (2023) combine Informal Bangla FastText embeddings with BiLSTM for cost-effective performance near transformers; Fahim (2023) enhance BanglaBERT via in-task pretraining, adversarial perturbation, and ensembles for sentiment, applicable to multi-task hate classification. Our work builds on these by integrating type, target, and severity in Bangla YouTube comments, emphasizing fine-grained labels and efficient models for low-resource settings. 3 Dataset Description The dataset for this task Hasan et al. (2025b) ; Hasan et al. (2025a) exhibits significant class imbalance across both subtasks, with the "None" label constituting the majority in both training and development sets. Table 1 presents the distribution for Subtask 1A (Type of Hate) and Table 2 shows the distribution for Subtask 1B (Target Group). Label Train Dev Dev Test Test None 19,954 1,451 1,447 5,751 Abusive 8,212 564 549 2,312 Political Hate 4,227 291 283 1,220 Profane 2,331 157 185 709 Religious Hate 676 38 40 179 Sexism 122 11 8 29 Total 35,522 2,512 2,512 10,200 Table 1: Subtask 1A (Type of Hate) Dataset Distribution Label Train Dev Dev Test Test None 21,190 1,536 1,528 6,093 Individual 5,646 364 391 1,571 Organization 3,846 292 292 1,152 Community 2,635 179 159 759 Society 2,205 141 142 625 Total 35,522 2,512 2,512 10,200 Table 2: Subtask 1B (Target Group) Dataset Distribution 0 0 footnotetext: Dev – public development set (hyper-parameter tuning); Dev Test – blind validation set (used for leaderboard); Test – official blind test set (final ranking). This footnote applies to both Table 1 and Table 2 . Distribution analysis reveals consistent patterns between training and development sets, indicating proper data splitting. In particular, severe class imbalance poses challenges for model training, particularly for minority classes in Subtask 1A such as Sexism (0. 34% in training) and Religious Hate (1.90% in training). Similarly, in Subtask 1B, the None class constitutes 59.66% of the training set, with minority classes like Society (6.21%) and Community (7.42%). 4 Method Description 4.1 Adversarial Fine-tuning (FGSM) We use the Fast Gradient Sign Method (FGSM) ( Goodfellow et al., 2014 ) as a light-weight adversarial fine-tuning mechanism to improve robustness to small input perturbations (typos, obfuscation, or transliteration noise common in YouTube comments). FGSM perturbs token embeddings in the direction of the loss gradient: \Delta=\epsilon\cdot\mathrm{sign}(\nabla_{\Theta}J(x,y;\Theta)) (1) and we minimize a combined loss: \tilde{J}(x,y)=\alpha J(x,y)+(1-\alpha)J(x+\Delta,y). (2) In our experiments we used \epsilon=0.1 and \alpha=0.5 , applying FGSM on perturbed embeddings every other epoch during fine-tuning. We report these hyperparameters and ablate FGSM vs. standard fine-tuning in Section 5. FGSM is applied in embedding space only (not at token substitution level), which is computationally inexpensive compared to stronger iterative attacks. While stronger iterative methods like Projected Gradient Descent (PGD) Geisler et al. (2024) and Adversarial Weight Perturbations(AWP) Wu et al. (2020) could yield more robust perturbations, we selected FGSM for its single-step efficiency, reducing training time by 50% compared to PGD and 57% compared to AWP respectively(based on preliminary trials). 4.2 Data Augmentation To enhance our model’s performance,we applied external augmentation by collecting multiple labeled hate speech samples from public datasets such as WoNBias Aupi et al. (2025) and Bangla Hate Speech Detection Dataset Romim et al. (2021) for subtask 1A. These datasets were specifically selected to address categories like sexism, religious hate, and political hate. Initially, training on this combined dataset yielded improved accuracy on the development

Read the complete text