AraFinNews: Arabic Financial Summarisation with Domain-Adapted LLMs

1 st Mo El-Haj, 2 nd Paul Rayson · 2025

Read AraFinNews: Arabic Financial Summarisation with Domain-Adapted LLMs by 1 st Mo El-Haj, 2 nd Paul Rayson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01265.txt.

Introduction

Mo El-Haj and Paul Rayson introduce AraFinNews, a data set for summarizing Arabic financial news. The data set holds two hundred twelve thousand five hundred article and headline pairs. They are drawn from a decade of reporting, from 2015 to 2025. The authors describe it as the largest publicly available resource of its kind for Arabic.

Using the data set, they test how domain adaptation affects abstractive summarization with large language models. Three transformer systems are compared: two general multilingual or Arabic models, and FinAraT5, a version adapted to finance. The domain adapted model produced more coherent summaries, especially in handling numbers and named entities, which are exactly where financial summaries fail most dangerously. The data set is released freely for non-commercial research.

Catalog record

CREATOR1 st Mo El-Haj, 2 nd Paul Rayson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01265

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AraFinNews: Arabic Financial Summarisation with Domain-Adapted LLMs 1 st Mo El-Haj, 2 nd Paul Rayson Abstract We introduce AraFinNews , the largest publicly available Arabic financial news dataset to date, comprising 212,500 article–headline pairs spanning a decade of reporting from 2015 to 2025. Designed as an Arabic counterpart to major English summarisation corpora such as CNN/DailyMail, AraFinNews provides a realistic benchmark for evaluating domain-specific language understanding and generation in financial contexts. Using this resource, we investigate the impact of domain specificity on abstractive summarisation of Arabic financial texts with large language models (LLMs). In particular, we evaluate transformer-based models—mT5, AraT5, and the domain-adapted FinAraT5—to examine how financial-domain pretraining influences accuracy, numerical reliability, and stylistic alignment with professional reporting. Experimental results show that domain-adapted models generate more coherent summaries, especially in their handling of quantitative and entity-centric information. These findings highlight the importance of domain-specific adaptation for improving narrative fluency in Arabic financial summarisation. The dataset is freely available for non-commercial research at https://github.com/ArabicNLP-uk/AraFinNews . I Introduction Arabic, spoken by more than 300 million people across over twenty countries [ 42 ] , plays a central role in religious, political, and cultural communication throughout the Arab world. Yet, despite its global significance, the language remains underrepresented in Natural Language Processing (NLP). Efforts such as ACL SIGARAB 1 1 1 https://www.sigarab.org/ have increased visibility and coordination across the community, but the development of robust, domain-specific Arabic language models and datasets continues to lag behind progress in high-resource languages such as English and Chinese [ 15 ] . This gap is driven by persistent data scarcity and the linguistic characteristics of Arabic itself. The language is diglossic, spanning Classical Arabic, Modern Standard Arabic (MSA), and a wide range of regional dialects that vary lexically, morphologically, and syntactically. In addition, its right-to-left script, lack of capitalisation, and frequent omission of diacritics—short vowel markers that help disambiguate homographs—create further difficulties for tokenisation, parsing, and semantic interpretation [ 19 ] . Recent advances in Arabic NLP—through models such as AraBERT [ 4 ] , ARBERT, MARBERT [ 2 ] , and generative models like AraBART and AraT5 [ 13 , 36 ] —have substantially improved general text understanding. However, these models are typically trained on broad web or news data and therefore lack consistent exposure to specialised financial or technical language. By contrast, English NLP has benefited from domain-adapted architectures such as FinBERT [ 44 ] and BioBERT [ 31 ] , which have demonstrated clear gains in financial and biomedical tasks. The absence of similar domain adaptation efforts for Arabic underscores the need for targeted pretraining strategies capable of capturing the linguistic and conceptual characteristics of financial discourse. This need is amplified by the rapid expansion of the Arab financial sector over the past two decades, with markets such as Tadawul 2 2 2 https://www.saudiexchange.sa , the Dubai Financial Market (DFM) 3 3 3 https://www.dfm.ae , and the Abu Dhabi Securities Exchange (ADX) 4 4 4 https://www.adx.ae now ranking among the world’s most active [ 49 ] . The resulting increase in Arabic financial narratives—corporate disclosures, regulatory filings, market analyses, and news reports—has produced texts that are long, information-dense, and stylistically formal, making them well suited to automatic summarisation [ 47 ] . Yet most Arabic summarisation systems continue to focus on general news, leaving financial text underexplored despite its demand for accuracy, numerical precision, and stylistic clarity [ 17 , 46 , 45 ] . To address this gap, we introduce AraFinNews —the largest publicly available Arabic financial news dataset, comprising 212,500 article–headline pairs from reputable financial media sources. Designed as the Arabic equivalent of major English summarisation benchmarks such as CNN/DailyMail, AraFinNews provides a rich domain-specific resource for abstractive summarisation and related financial NLP tasks. It is freely available for research at https://github.com/ArabicNLP-UK/AraFinNews . Using this dataset, we evaluate transformer-based architectures—including FinAraT5, AraT5, and mT5—on Arabic financial summarisation. This work contributes to advancing domain-specific Arabic NLP, demonstrating the benefits and challenges of adapting large language models to one of the world’s most linguistically complex and economically dynamic languages. II Related Work Text summarisation has long been a core task in Natural Language Processing (NLP), particularly within journalism and information retrieval. Early systems were largely extractive, relying on sentence ranking and statistical heuristics such as term frequency, cue words, and sentence position [ 23 , 7 ] . Although these methods captured surface-level salience, they struggled to produce coherent, concise outputs and often generated redundant summaries. The shift to neural encoder–decoder architectures marked a turning point. Recurrent models with attention mechanisms enabled systems to generate novel text rather than simply selecting existing sentences. One of the earliest demonstrations of fluent headline generation using LSTM-based architectures was presented in [ 33 ] . Subsequent improvements incorporated coverage mechanisms and reinforcement learning to reduce redundancy and improve factual consistency [ 40 , 9 ] . Transformer-based models such as BART and T5 further advanced abstractive summarisation. Their text-to-text formulation supported strong generalisation across languages and tasks [ 38 ] , while multilingual variants like mT5 [ 43 ] extended these capabilities to low-resource settings through cross-lingual transfer. However, these broadly pretrained models often struggle in specialised domains—such as finance—where numerical reasoning, formal style, and domain-specific terminology require more targeted adaptation. Recent developments in Arabic NLP have mirrored these global trends. Large-scale pretrained models such as AraBERT [ 4 ] , ARBERT and MARBERT [ 2 ] have become standard baselines for classification and sentiment analysis, addressing challenges related to rich morphology and dialectal variation. Generative models including AraBART and AraT5 [ 13 , 36 ] , and more recent efforts such as Jasmine [ 1 ] , have extended these capabilities to summarisation and text generation tasks. A growing body of research now focuses specifically on Arabic abstractive summarisation. [ 25 ] demonstrated the benefits of fine-tuning multilingual transformers for Arabic news summarisation, while [ 35 ] proposed transformer-based architectures that improved coherence and fluency over earlier systems. Other work has integrated linguistic information or auxiliary objectives- for example, [ 22 ] combined named entity recognition with summarisation to improve factual preservation, and [ 21 ] developed a hybrid RNN–Transformer model to enhance grammatical consistency. Collectively, these studies highlight the feasibility of generative approaches for Arabic, though most efforts remain centred on general news rather than specialised professional domains. Despite the progress, current Arabic language models are still predominantly general-purpose. Models such as AraBERT, ARBERT, MARBERT, AraBART, and AraT5 are trained on broad web or news corpora and therefore have limited exposure to financial or technical text. A notable exception is FinAraT5 [ 48 ] , a domain-adapted variant further pretrained on large Arabic financial corpora. However, such efforts remain rare compared with English NLP, where models like FinBERT [ 44 ] and BioBERT [ 31 ] demonstrate the effectiveness of targeted pretraining for specialised tasks. The scarcity of comparable domain-specific resources for Arabic reinforces the need for focused pretraining and systematic evaluation in financial summarisation. II-A Datasets for Arabic Summarisation and Financial Corpora Research in Arabic summarisation has been supported by a range of corpora covering both extractive and abstractive paradigms. Early resources such as Kalimat [ 14 ] , a 20,000-article Omani newspaper corpus,

Read the complete text