Multilingual Financial Fraud Detection Using Machine Learning and Transformer Models: A Bangla–English Study

Mohammad Shihab Uddin 1 , Md Hasibul Amin 2 , Nusrat Jahan Ema 1 , Bushra Uddin 1 , Tanvir Ahmed 1 , and Arif Hassan Zidan 1 · 2026

Read Multilingual Financial Fraud Detection Using Machine Learning and Transformer Models: A Bangla–English Study by Mohammad Shihab Uddin 1 , Md Hasibul Amin 2 , Nusrat Jahan Ema 1 , Bushra Uddin 1 , Tanvir Ahmed 1 , and Arif Hassan Zidan 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11358.txt.

Introduction

Mohammad Shihab Uddin and coauthors detect fraud in Bangla-English messages. Most fraud research is built on English alone, though Bangla has hundreds of millions of speakers. They compare classical models on TF-IDF features, logistic regression, a linear support vector machine, and ensembles, against transformer architectures. The tests use stratified cross-validation. The linear support vector machine wins on accuracy and F1 by two percentage points. The transformer recalls more fraud but raises more false positives. Scam messages prove longer, more urgent, and dense with links and phone numbers.

Catalog record

CREATORMohammad Shihab Uddin 1 , Md Hasibul Amin 2 , Nusrat Jahan Ema 1 , Bushra Uddin 1 , Tanvir Ahmed 1 , and Arif Hassan Zidan 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20102
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11358

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multilingual Financial Fraud Detection Using Machine Learning and Transformer Models: A Bangla–English Study Mohammad Shihab Uddin 1 , Md Hasibul Amin 2 , Nusrat Jahan Ema 1 , Bushra Uddin 1 , Tanvir Ahmed 1 , and Arif Hassan Zidan 1 Abstract Financial fraud detection has emerged as a critical research challenge amid the rapid expansion of digital financial platforms. Although machine learning approaches have demonstrated strong performance in identifying fraudulent activities, most existing research focuses exclusively on English-language data, limiting applicability to multilingual contexts. Bangla (Bengali), despite being spoken by over 250 million people, remains largely unexplored in this domain. In this work, we investigate financial fraud detection in a multilingual Bangla–English setting using a dataset comprising legitimate and fraudulent financial messages. We evaluate classical machine learning models (Logistic Regression, Linear SVM, and Ensemble classifiers) using TF-IDF features alongside transformer-based architectures. Experimental results using 5-fold stratified cross-validation demonstrate that Linear SVM achieves the best performance with 91.59% accuracy and 91.30% F1 score, outperforming the transformer model (89.49% accuracy, 88.88% F1) by approximately 2 percentage points. The transformer exhibits higher fraud recall (94.19%) but suffers from elevated false positive rates. Exploratory analysis reveals distinctive patterns: scam messages are longer, contain urgency-inducing terms, and frequently include URLs (32%) and phone numbers (97%), while legitimate messages feature transactional confirmations and specific currency references. Our findings highlight that classical machine learning with well-crafted features remains competitive for multilingual fraud detection, while also underscoring the challenges posed by linguistic diversity, code-mixing, and low-resource language constraints. I Introduction The rapid growth of digital financial services, including online banking, mobile payment platforms, and electronic commerce, has significantly increased the scale and complexity of financial transactions. While these technologies improve efficiency and accessibility, they also introduce new opportunities for fraudulent activities such as phishing scams, deceptive financial advertisements, and fraudulent transaction descriptions. Financial fraud continues to cause substantial economic losses worldwide, making automated fraud detection an essential research problem for modern financial systems. Machine learning and natural language processing (NLP) techniques have been widely adopted to detect fraudulent behavior from transactional records and text-based financial data. Prior studies have demonstrated that textual features extracted from transaction descriptions, customer messages, and online financial communications can effectively capture fraud-related patterns. However, most existing financial fraud detection systems are developed and evaluated primarily on English-language datasets, which limits their applicability in multilingual environments. In many real-world settings, particularly in South Asia, financial communication frequently involves multiple languages or mixed-language usage. Bangla (Bengali), spoken by over 250 million people worldwide, is commonly used alongside English in digital financial platforms, informal transaction messages, and online advertisements. Despite its widespread usage, Bangla remains a low-resource language in NLP, especially for domain-specific tasks such as financial fraud detection and prior research shows that model performance often correlates strongly with available training resources in low-resource languages [ 29 , 9 , 5 ] . The scarcity of labeled datasets, complex morphology, and frequent code-mixing with English pose additional challenges that are not addressed by English-centric models [ 5 , 29 ] . Recent advances in deep learning, particularly transformer-based architectures, have significantly improved performance across a wide range of NLP tasks by enabling deep contextual representation learning through self-attention mechanisms [ 45 , 18 , 48 ] . Multilingual transformer models further allow shared representations across languages and have demonstrated strong cross-lingual transfer capabilities across diverse linguistic settings [ 14 , 10 , 36 ] . Nevertheless, the effectiveness of these models for financial fraud detection in Bangla–English multilingual data remains largely unexplored. This paper aims to address this gap by investigating financial fraud detection in a multilingual Bangla–English setting. We evaluate classical machine learning approaches using TF-IDF features as well as transformer-based architectures to analyze their performance across languages. Our study provides empirical insights into the challenges posed by linguistic diversity, data sparsity, and code-mixed text, and highlights the importance of multilingual modeling for robust financial fraud detection in low-resource environments. The main contributions of this work are summarized as follows: • We study financial fraud detection in a multilingual Bangla–English context, an under-explored research area. • We compare classical machine learning models with transformer-based architectures for multilingual fraud detection. • We analyze the impact of linguistic characteristics and low-resource constraints on model performance. II Related Work This section reviews prior research to position the present work and identify gaps motivating multilingual financial fraud detection. II-A Financial Fraud Detection Financial fraud detection has long been important due to substantial losses across banking and digital payments. Early rule-based and statistical methods [ 35 , 21 , 20 ] often failed to generalize to evolving fraud patterns. Supervised learning algorithms have since demonstrated strong performance across diverse domains [ 38 , 44 , 40 ] , with classical methods showing strong predictive performance for fraud detection [ 32 , 11 , 13 , 33 , 42 ] . Studies have also addressed class imbalance [ 17 , 46 ] and evaluation bias [ 16 ] . However, most research focuses on structured numerical records and assumes monolingual English data. II-B Text-Based Fraud Detection NLP applications for fraud detection use bag-of-words, n-grams, and TF-IDF representations [ 41 , 39 , 12 , 15 ] , with classical classifiers remaining widely used [ 28 , 19 , 23 ] . Deep learning and transformer-based models [ 3 , 45 , 18 ] demonstrate state-of-the-art performance in detecting subtle linguistic patterns [ 6 , 47 ] , though most studies focus exclusively on English datasets. II-C Multilingual and Cross-Lingual NLP Multilingual NLP enables cross-lingual transfer [ 29 , 24 , 27 ] , with specialized Indic language models improving South Asian performance [ 30 , 31 ] . Multilingual transformers learn language-agnostic representations [ 14 , 22 ] , encoding both universal and language-dependent features [ 36 ] and supporting zero-shot transfer [ 10 ] . However, performance degrades for low-resource languages [ 29 , 34 ] . II-D Code-Mixed and Low-Resource Language Challenges Real-world multilingual communication involves code-mixing and transliteration, with benchmarks highlighting modeling difficulties [ 1 ] . Low-resource languages pose challenges due to limited annotated datasets [ 29 ] . II-E Bangla Language Processing Bangla remains underrepresented despite being widely spoken. Studies focus on sentiment analysis and text classification [ 5 , 37 , 4 ] , while domain-specific applications like financial fraud detection remain unexplored. II-F Research Gap Key limitations include: (1) fraud detection focusing on structured data; (2) text-based studies using only English; (3) multilingual NLP rarely addressing domain-specific applications; (4) Bangla lacking domain-specific benchmarks. The success of ML-driven systems [ 43 , 25 , 26 , 7 ] motivates this study evaluating classical ML and transformer models for multilingual Bangla-English fraud detection. III Methodology This section describes the feature extraction and classification models for financial fraud detection in a multilingual Bangla–English setting. III-A Term Frequency–Inverse Document Frequency (TF-IDF) TF-IDF is a widely used feature representation technique that remains a strong baseline in text classification [ 41 , 28 , 8 ] . It transforms textual data into numerical vectors by weighting terms based on document frequency and corpus distribution [ 41 ] . The TF-IDF weight for term t in document d is:

Read the complete text