Enhancing Scientific Discourse: Machine Translation for the Scientific Domain

Dimitris Roussis, Sokratis Sofianopoulos, Stelios Piperidis · 2026

Read Enhancing Scientific Discourse: Machine Translation for the Scientific Domain by Dimitris Roussis, Sokratis Sofianopoulos, Stelios Piperidis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20912.txt.

Introduction

D. Roussis, S. Sofianopoulos, and S. Piperidis develop parallel and monolingual corpora for machine translation in the scientific domain. Growing research volume demands communication across language barriers. Yet scientific text poses unique challenges from specialized words and complex sentence structures. Their corpora target Spanish-English, French-English, and Portuguese-English pairs, three major pairs. For each pair, they create a large general scientific corpus plus four smaller corpora focused on cancer, energy, brain science, and transport research.

Catalog record

CREATORDimitris Roussis, Sokratis Sofianopoulos, Stelios Piperidis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32799
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20912

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Scientific Discourse: Machine Translation for the Scientific Domain Dimitris Roussis, Sokratis Sofianopoulos, Stelios Piperidis Abstract The increasing volume of scientific research necessitates effective communication across language barriers. Machine translation (MT) offers a promising solution for accessing international publications. However, the scientific domain presents unique challenges due to its specialized vocabulary and complex sentence structures. In this paper, we present the development of a collection of parallel and monolingual corpora for the scientific domain. The corpora target the language pairs Spanish-English, French-English, and Portuguese-English. For each language pair, we create a large general scientific corpus as well as four smaller corpora focused on the domains of: Cancer Research, Energy Research, Neuroscience, and Transportation research. To evaluate the quality of these corpora, we utilize them for fine-tuning general-purpose neural machine translation (NMT) systems. We provide details regarding the corpus creation process, the fine-tuning strategies employed, and we conclude with the evaluation results. 1 Introduction The growth of scientific research across disciplines has intensified the need for efficient communication and international collaboration that transcends language barriers. While English is the dominant language of scientific publications [ 1 ] , a substantial volume of valuable academic work is produced in other languages. According to a 2019 study [ 21 ] , almost 40% of the articles of non-anglophone researchers are submitted in a language other than English. [ 1 ] . Machine translation (MT) offers a compelling solution, providing access to a vast pool of international research and fostering seamless collaboration among researchers worldwide. Advancements in Neural Machine Translation have significantly improved the quality of translations in various domains, largely driven by the application of the Transformer architecture [ 25 ] . Transformers revolutionized NMT by enabling efficient parallel processing of entire sequences, leading to significant improvements in translation quality and fluency. However, the performance of NMT models often suffers when translating specialized domains due to the presence of specific terminology and sentence structures. Translating scientific text presents unique challenges distinct from general language translation [ 5 ] . Scientific domains are characterized by: • Specialized Lexicon: These domains employ a rich vocabulary of technical terms and abbreviations often absent from general language corpora. • Syntactic Complexity: Scientific writing frequently utilizes complex sentence structures to convey precise relationships and subtle meanings. • Domain-Specific Discourse: Each scientific domain possesses its own unique discourse patterns and conventions that are critical to understand for accurate translation. • Indeterminacy: The division of scientific areas into numerous sub-disciplines and the existence of multidisciplinary works further complicate the definition of what a scientific domain encompasses. These factors can significantly impair the performance of generic NMT models, leading to mistranslations or loss of scientific meaning. To address these challenges, this paper presents the development of domain-specific corpora for scientific research and their application towards creating NMT models for four academic domains. We aimed at using the open-source NMT models which exhibit the best generic performance as base models and fine-tune them on these domain-specific corpora, so as to achieve translations that are not only fluent but also accurate and faithful to the scientific content. We focus on the Spanish–English (ES–EN), French–English (FR–EN), and Portuguese–English (PT–EN) translation directions, creating parallel corpora for each, alongside monolingual corpora for the respective languages (i.e., English, Spanish, French, and Portuguese). Our corpora encompass a large general scientific corpus and smaller sub-corpora dedicated to the research areas of: • Cancer Research • Energy Research • Neuroscience • Transportation Research We begin by presenting our dataset creation process which exploits the wealth of parallel titles and abstracts from bachelor and master theses, doctoral dissertations, and other scientific publications (such as published books and articles). Next, we outline the methodology of fine-tuning pre-trained NMT models using the aforementioned datasets. Finally, we evaluate the resulting models’ performance by contrasting their output with the translations received from the original general-purpose NMT models as well as Google Translate. 2 Related Work Even though there is a plethora of parallel corpora in the ever-growing OPUS collection [ 23 ] , there is a shortage of those which aim at addressing parallel data acquisition for the scientific and academic domains, relatively to the importance and challenges of scientific translation. In OPUS, there are 2 parallel datasets of note, namely CAPES [ 20 ] and SciELO [ 19 ] . CAPES originates from the database of the Theses and Dissertations Catalog (TDC) and contains approximately 1.2 million sentence pairs for the EN–PT language pair [ 20 ] , mined from theses and dissertation abstracts of students in post-graduate programs across Brazilian universities. Similarly, the SciELO parallel corpus has been extracted through the use of the SciELO database, which contains a broad range of open-access scientific articles. SciELO consists of approxiately 3.3 million parallel sentences and metadata for English, Spanish, and Portuguese, some of which are trilingually aligned (i.e., EN–ES–PT) [ 19 ] . Both corpora are evaluated manually, as well as automatically by training and evaluating MT systems. In order to address the parallel data gap for scientific texts among underrepresented European languages, the SciPar corpus [ 17 ] was created and made publicly availabe via the ELRC-SHARE repository. 1 1 1 https://elrc-share.eu/ SciPar contains 9.17 million sentence pairs in 31 language pairs and has been constructed from the titles and abstracts of bachelor and master theses, doctoral dissertations, and other scientific publications. It has been constructed through collecting, parsing, and processing metadata from 86 institutional repositories, digital libraries of universities, and national archives. The Translations and Open Science project focused on building EN–FR NMT systems for three pilot domains: (a) Climatology and Climate Change, (b) Neurosciences, and (c) Human Mobility, Environment, and Space. Fiorini et al. [ 7 ] collected 316,701 parallel segments and 1,112 bilingual terms for these three domains, trained a generic NMT model from scratch, and the fine-tuned it on the collected datasets. The paper describes the manual and automatic evaluation and comparison that was conducted to determine domain-specific translation quality, while it also shows that adding data from SciPar results in further improvements. Domain EN–ES EN–PT EN–FR Cancer 57,226 123,357 49,112 Energy 107,710 205,662 87,918 Neuroscience 40,467 85,717 45,650 Transp/tion 26,795 35,181 19,151 Gen. Scient. 3,913,214 5,255,552 1,648,200 Total 4,145,412 5,705,469 1,850,031 Table 1: Parallel Corpora Sizes per Language Pair and Domain 3 Dataset Creation In this section, we outline the end-to-end pipeline used for mining high-quality parallel and monolingual corpora from the titles and abstracts of theses and dissertations. First, we detail the strategy used to process approximately 9.3 million records from 62 academic repositories to extract 11,700,912 sentence pairs. A detailed list of the repositories can be seen at Table 4 of Appendix A. Then, we present the sizes of the parallel and monolingual corpora which resulted after applying various filtering methods, and, finally, we provide a brief documentation of the process used to create benchmark developer and test sets. EN ES FR PT Cancer 393,488 76,296 6,933 33,947 Energy 342,144 228,818 9,479 66,654 Neuroscience 262,618 47,112 5,380 19,640 Transp/tion 33,509 65,374 2,934 13,376 Gen. Scient. 13,187,215 10,512,255 753,487 3,335,615 Total 14,218,974 10,929,855 778,213 3,469,232 Table 2: Monolingual Corpora Sizes per Language Pair and Domain 3.1 Repository Processing Our strategy is directed toward structured metadata extraction and

Read the complete text