Fake News Classification in Urdu: A Domain Adaptation Approach for a Low-Resource Language CCS: Computing methodologies Language resources

Muhammad Zain Ali, Bernhard Pfahringer, Tony Smith · 2025

Read Fake News Classification in Urdu: A Domain Adaptation Approach for a Low-Resource Language CCS: Computing methodologies Language resources by Muhammad Zain Ali, Bernhard Pfahringer, Tony Smith (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22778.txt.

Introduction

Muhammad Zain Ali, Bernhard Pfahringer, and Tony Smith work on detecting fake news written in Urdu, a language with far fewer labeled resources than English. A standard recipe fine-tunes a multilingual language model, but such models often stumble over domain-specific words in news text. The team tests whether extra pretraining on Urdu news, called domain adaptation, fixes that weakness before fine-tuning for classification.

They adapt two widely used multilingual models, XLM-RoBERTa and mBERT, on a public Urdu news corpus, then evaluate on four public Urdu fake news datasets. Domain-adapted XLM-RoBERTa beats its plain version consistently across the datasets. The adapted mBERT gives mixed results, sometimes helping and sometimes not. The findings suggest staged training is a practical route for misinformation detection in low-resource languages, though the benefit depends on the base model chosen.

Catalog record

CREATORMuhammad Zain Ali, Bernhard Pfahringer, Tony Smith
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fake News Classification in Urdu: A Domain Adaptation Approach for a Low-Resource Language CCS: Computing methodologies Language resources Muhammad Zain Ali, Bernhard Pfahringer, Tony Smith Abstract . Misinformation on social media is a widely acknowledged issue, and researchers worldwide are actively engaged in its detection. However, low-resource languages such as Urdu have received limited attention in this domain. An obvious approach is to utilize a multilingual pretrained language model and fine-tune it for a downstream classification task, such as misinformation detection. However, these models struggle with domain-specific terms, leading to suboptimal performance. To address this, we investigate the effectiveness of domain adaptation before fine-tuning for fake news classification in Urdu, employing a staged training approach to optimize model generalization. We evaluate two widely used multilingual models, XLM-RoBERTa and mBERT, and apply domain-adaptive pretraining using a publicly available Urdu news corpus. Experiments on four publicly available Urdu fake news datasets show that domain-adapted XLM-R consistently outperforms its vanilla counterpart, while domain-adapted mBERT exhibits mixed results. 1 1 1 Our data, models and code are available at https://github.com/zainali93/DomainAdaptation . 1. Introduction Fake news refers to any statement or piece of text that is verifiably false and contradicts established truths ( 5 ) . While the author’s intention behind such content is often debated, its societal impact is undeniable. Although fake news has existed for centuries, its prevalence has dramatically increased due to the rise of the internet and social media. This proliferation is largely driven by the public’s tendency to share unverified information online, leading to adverse effects, including influencing public opinion, undermining trust in media, and even altering election outcomes ( 31 ) . Studies have shown that fake news spreads significantly faster than truthful information, making its detection an important area of research ( 37 ) . To tackle the challenge of misinformation detection, researchers have explored diverse feature sets, including content , social , temporal , and hybrid ( 49 ) , as well as a wide range of learning architectures, from traditional models like decision trees ( 35 ) to deep learning methods such as LSTMs and RNNs ( 41 ) , and more recently, large pretrained language models ( 33 ) . These features and architectures are discussed in detail in the Related Works section. Despite extensive research on fake news detection for resource-rich languages like English ( 3 ) , studies focusing on Urdu, a low-resource language, remain scarce ( 1 ; 44 ) . Consequently, there is a lack of both datasets and automated methods for detecting fake news in this language ( 6 ) . Detecting fake news in Urdu is particularly important due to its approximately 232 million speakers ( 28 ) , its status as the national language of Pakistan 2 2 2 https://en.wikipedia.org/wiki/Urdu , and its growing use in social media communication ( 53 ) . This widespread use increases the risk of people believing and sharing fake news, highlighting the pressing need for automated detection solutions for Urdu. Existing efforts to detect fake news in Urdu often simplify the problem as text classification, relying on surface-level linguistic features, such as vocabulary usage ( 47 ; 34 ) . The advent of pre-trained language models has made it feasible to leverage complex hidden features within fake news datasets, enabling the development of more sophisticated classifiers ( 48 ; 26 ) . However, there is a notable absence of Urdu-specific pre-trained language models. While some multilingual models can process Urdu, they are predominantly trained on resource-rich languages like English, with Urdu constituting only a small fraction of their training data ( 7 ; 10 ) . As a result, these multilingual models often struggle to understand Urdu-specific terms and nuances. Moreover, these models face challenges in specific domains due to their general-purpose training on diverse, non-specific datasets, a phenomenon referred to as domain shift in NLP and dataset shift in machine learning, where the training and test distributions do not align ( 18 ) . Fine-tuning such models on domain-specific datasets can lead to domain shifts, where the model struggles with out-of-distribution generalization , resulting in suboptimal performance ( 17 ) . To address these problems, we perform domain adaptation on two widely used multilingual pre-trained language models, XLM-RoBERTa (XLM-R) ( 10 ) and mBERT ( 13 ) , using a publicly available corpus of one million Urdu news articles. This approach offers several advantages: (i) it enables the model to update its weights for domain-specific terms and learn their contextual usage, and (ii) it enhances their handling of Urdu vocabulary, which is often underrepresented in multilingual pretraining. Additionally, by exposing the models to authentic Urdu news content during the domain adaptation phase, we aim to help them learn latent domain-specific features that may improve performance in downstream tasks such as fake news detection. To evaluate the impact of domain adaptation, we fine-tune both adapted and vanilla versions of XLM-R and mBERT on four publicly available Urdu fake news datasets. Our results show that the domain-adapted XLM-R consistently outperforms its vanilla counterpart across all datasets. In contrast, mBERT shows mixed results, with only marginal gains in some cases and no improvement or slight degradation in others. These findings highlight the potential of domain adaptation for improving fake news detection in low-resource languages, while also emphasizing the importance of model choice in this setting. Dataset #Examples Labels Content Application Urdu 1M Dataset ( 25 ) 1,038,340 S : 454,335 E : 253,730 B : 251,170 T : 79,105 Articles Domain Adaptation Ax-to-Grind ( 20 ) 10,083 F : 5,053 R : 5,030 Headlines UFN2023 ( 15 ) 4,097 F : 2,455 R : 1,642 Headlines Classifier Training UFN2021 ( 2 ) 2,000 F : 968 R : 1,032 Articles UrduFake2021 ( 6 ) 1,300 F : 550 R : 750 Articles Table 1. Summary of datasets used in training. Labels: S = Sports, E = Entertainment, B = Business, T = Technology, F = Fake, R = Real. 2. Related Works This section reviews previous work on fake news detection, including studies focused on Urdu, as well as prior research on domain adaptation. Fake News Detection Existing works on fake news detection can be categorized by the features used to train classifiers and the learning architectures employed ( 3 ) . Feature sets include content, social, temporal, or their combinations. Content features rely on the use of linguistic cues such as grammar, vocabulary, and sentiment ( 46 ) . Social Features leverage post-related meta-information and user-data from social media, such as post-likes, user followers, and followed pages ( 8 ) . Temporal Features use time-based heuristics extracted from post timestamps ( 36 ) . Classifier architectures have evolved from simple machine learning models ( 35 ) like Decision Trees to advanced deep learning architectures including LSTMs and RNNs ( 41 ) , and more recently to fine-tuned pretrained language models and LLMs ( 33 ) . For instance, 14 proposed a Generative BERT framework combining GPT and BERT features for fake news detection, reporting improved results on two public datasets. Recent studies have focused on detecting AI-generated fake news: 51 fine-tuned BERT to identify GPT-generated articles, while ( 52 ; 4 ) developed

Read the complete text