cantnlp@DravidianLangTech 2026: organic domain adaptation improves multi-class hope speech detection in Tulu
Andrew Li, Sidney Wong · 2026
Read cantnlp@DravidianLangTech 2026: organic domain adaptation improves multi-class hope speech detection in Tulu by Andrew Li, Sidney Wong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09795.txt.
Introduction
Li and Wong entered the DravidianLangTech-2026 shared task on hope speech in code-mixed Tulu, a low-resource language of southern India. Hope speech means supportive, encouraging, and empathetic expressions online, and spotting it can help foster healthier discourse. Code-mixed Tulu comments blend languages and scripts, which strains standard classifiers trained on limited labeled data.
Their system built on XLM-RoBERTa, a multilingual text model, further adapted on organically collected Tulu social media text with code-mixed and mixed-script variation. On the development set, the adapted model beat their baseline. On the official test set, results were more modest, but the team reads the pattern as evidence that organic adaptation helps hope-speech detection in Tulu.
Catalog record
| CREATOR | Andrew Li, Sidney Wong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09795
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
cantnlp@DravidianLangTech 2026: organic domain adaptation improves multi-class hope speech detection in Tulu Andrew Li, Sidney Wong Abstract This paper presents our systems and results for the Hope Speech Detection in Code-Mixed Tulu Language shared task at the Sixth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages (DravidianLangTech-2026). We trained an XLM-RoBERTa-based text classification system for detecting hope speech in code-mixed Tulu social media comments. We compared this organically adapted hope speech detection model with our baseline model. On the development set, the organically adapted model outperformed the baseline system. While our submitted systems performed more modestly on the official test set, these results suggest that further adapting XLM-RoBERTa on organically collected Tulu social media text containing code-mixed and mixed-script variation can improve hope speech detection in code-mixed Tulu. 1 Introduction There has been increasing interest in detecting different forms of language on social media, including hate speech, offensive language, and other emotionally meaningful content. More recently, researchers have also begun to study hope speech, which includes supportive, encouraging, and empathetic expressions in online communication ( 7 ; 12 ). Detecting hope speech is useful for promoting healthier online discourse, identifying constructive engagement, and supporting research on emotional wellbeing in low-resource communities 5 . These goals become more difficult in under-resourced languages, where limited labeled data and strong linguistic variation can reduce the effectiveness of standard text classification systems. This challenge is especially apparent in code-mixed settings, where multiple languages and scripts may appear within the same comment. In this paper, we describe our system for the Hope Speech Detection in Code-Mixed Tulu shared task at DravidianLangTech-2026 26 . The purpose of this shared task is to develop a multi-level hope speech classification system in code-mixed Tulu. Our approach used XLM-RoBERTa as a transformer-based text classifier 8 . Furthermore, we extended a similar fine-tuning strategy used in prior shared task work 27 . Our primary motivation was to account for the script-switching phenomena observed in the training data to ensure that we account for the orthographic (and linguistic) context. We further adapt the model using additional organic Tulu social media text containing code-mixed and mixed-script variation to better match the linguistic patterns found in real Tulu social media text. 2 Related Works The first shared task to explored hope speech detection in YouTube comments across three language conditions: English, Tamil, and Malayalam 4 . In descending order, the best performing hope speech detection models based on weighted average F_{1} -score were for English at 0.93, Malayalam at 0.85 15 , and Tamil at 0.61 23 . Unsurprisingly, the best performing hope speech detection models utilized variants of the Bidirectional Encoder Representations from Transformers (BERT) model architecture 9 . This contrasts earlier detection systems which relied on shallow classifiers 6 . Successive shared tasks focusing on hope speech detection would expand to other language conditions. The second shared task, also with YouTube comments, included Kannada and Spanish 3 . Meanwhile, the third shared task focused on three Indo-European languages: Bulgarian, English, Hindi, and Spanish 17 . Using data from X, formerly known as Twitter, the best performing model for English achieved a weighted average F_{1} -score of 0.50 using shallow classifiers ( 18 ; 25 ). Related shared tasks, such as Hope 2024 11 and PolyHope 2 , have explored hope speech detection in English and Spanish across binary and multi-class classification conditions. Some common challenges observed across the systems include class imbalance, code-mixing and script-switching, and sociolinguistic differences 2 . It is clear from existing literature that hope speech detection is treated as a text classification problem 16 . With a focus on optimizing model architectures, 22 found that an ensemble approach offered the best model performance by combining the architectures of Long Short-Term Memory (LSTM; 14 ), mBERT 9 , and XLM-RoBERTa 8 achieving an impressive weighted average F_{1} -score of 0.93 for English. However, solely focusing on model architectures fails to account for linguistic contexts beyond lexical structures 19 . We are now only observing approaches that account for the linguistic context, such as translation-based techniques 1 , but research within this area remain limited. 3 Methodology With approximately 2.5 million speakers, Tulu is an under-resourced language 24 . In contrast to other Dravidian languages, such as Kannada, Malayalam, and Tamil, resources for natural language processing remain scarce. Therefore, the primary purpose of Hope Speech Detection in Code-Mixed Tulu Language shared task was to develop multi-level hope speech classification systems in code-mixed Tulu. We treat this shared task as a classification problem 16 . We used XLM-RoBERTa as the base pre-trained language model (PLM) for our system 8 . To summarize, XLM-RoBERTa embeddings were trained on 2.5 TB of filtered web-crawled data containing 100 languages. However, it is important to note that Tulu was not one of these languages. Encoder-decoder transformer-based PLMs were used because of their ability to support domain adaptation, meaning that we can continue training a pretrained language model on additional in-domain data without the need to train a new PLM from scratch. The shared task was broken down into two sub-tasks which we refer to as Task 1 and Task 2 26 . For Task 1, the goal was to classify each comment into one of four coarse-grained categories: encouraging , discouraging , uninvolved , and blended tone . For Task 2, the goal was to classify hope-related content into five fine-grained categories: optimistic hope , realistic hope , inspiring hope , fading hope , and hopelessness . For each task, we first developed a baseline system and then developed organically adapted candidate systems by further training XLM-RoBERTa on organically collected Tulu social media text containing code-mixed and mixed-script variation before downstream fine-tuning on the labeled shared-task data. For submission, we selected the best performing candidate system in each task based on development set macro average F_{1} -scores. 3.1 Training Data Table 1: Coarse-Grained Training Class Labels Class Count Blended Tone 895 Discouraging 711 Encouraging 1895 Uninvolved 2490 Table 2: Fine-Grained Training Class Labels Class Count Fading Hope 236 Hopelessness 937 Inspiring Hope 1129 Optimistic Hope 380 Realistic Hope 503 The organizers of the Hope Speech Detection in Code-Mixed Tulu shared task provided labeled training, development data, and a test set consisting of social media comments in code-mixed Tulu 26 . The training data was split into coarse-grained hope tone classification (Task 1) and fine-grained hope type classification (Task 2). These datasets formed the basis of our baseline system development and evaluation. The labeled training data was used to train the classification models, the development set was used for validation and model comparison, and the official test set was used only for final shared-task submission and evaluation. The distribution of target class labels in the training data is shown in Table 1 for the coarse-grained task and Table 2 for the fine-grained task. There is noticeable class imbalance across labels in both tracks. For the coarse-grained task, uninvolved and encouraging account for most of the training examples, while discouraging and blended tone appear less frequently. For the fine-grained task, inspiring hope and hopelessness are the most common labels, while fading hope , optimistic hope , and realistic hope are less represented. 3.2 Domain