Building and Aligning Comparable Corpora
Motaz Saad, David Langlois, Kamel Smaïli · 2025
Read Building and Aligning Comparable Corpora by Motaz Saad, David Langlois, Kamel Smaïli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02555.txt.
Introduction
Motaz Saad, David Langlois, and Kamel Smaïli describe how to build collections of same-topic documents across languages that are not translations of each other, in a 2025 paper. Such comparable corpora help multilingual tools when true parallel text is scarce, and they show how one topic is covered in different tongues. The team harvested material from Wikipedia and the Euronews site in English, French, and Arabic.
They then tested two ways to match documents across languages automatically: a bilingual dictionary method and a latent semantic method. The semantic method aligned documents better, even down to single events, as shown on BBC and Al Jazeera news sets. The authors present the pipeline as a practical route to multilingual corpora.
Catalog record
| CREATOR | Motaz Saad, David Langlois, Kamel Smaïli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-02555
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Building and Aligning Comparable Corpora Motaz Saad, David Langlois, Kamel Smaïli Abstract Comparable corpus is a set of topic aligned documents in multiple languages, which are not necessarily translations of each other. These documents are useful for multilingual natural language processing when there is no parallel text available in some domains or languages. In addition, comparable documents are informative because they can tell what is being said about a topic in different languages. In this paper, we present a method to build comparable corpora from Wikipedia encyclopedia and EURONEWS website in English, French and Arabic languages. We further experiment a method to automatically align comparable documents using cross-lingual similarity measures. We investigate two cross-lingual similarity measures to align comparable documents. The first measure is based on bilingual dictionary, and the second measure is based on Latent Semantic Indexing (LSI). Experiments on several corpora show that the Cross-Lingual LSI (CL-LSI) measure outperforms the dictionary based measure. Finally, we collect English and Arabic news documents from the British Broadcast Corporation (BBC) and from ALJAZEERA (JSC) news website respectively. Then we use the CL-LSI similarity measure to automatically align comparable documents of BBC and JSC. The evaluation of the alignment shows that CL-LSI is not only able to align cross-lingual documents at the topic level, but also it is able to do this at the event level. \setcode utf8 Keywords : Building comparable corpora; Natural language processing; Cross-lingual information retrieval 1 Introduction Multilingual texts (parallel or comparable) are useful in several NLP applications such as bilingual lexicon extraction [ Li2010 ] , cross-lingual information retrieval [ Knoth2011 ] and machine translation [ Delpech2011 ] . A parallel corpus is a collection of aligned sentences, which are translations of each other. Parallel corpora are acquired using human translators, but this is time consuming and requires a lot of human being efforts. Comparable corpora can be obtained easily from the web. The emergence of Web 2.0 technologies enlarged web contents in many languages. Newspaper websites and Encyclopedias are ideal for collecting comparable documents. But aligning these texts is a challenging task. Figure 1 shows an example of English-French Wikipedia comparable documents related to a biography of a person. It can be noted from the figure that the first paragraph in the English document is longer than the French one, it also provides more information about the person. It can be also noted that the English and the French texts of these comparable documents have different views to this person. Another example of comparable documents is the news articles from EURONEWS shown in Figure 2 . The news article is related to a report about transparency and corruption in the world. Despite the documents are related to the same news story, the translations of their titles are different. Furthermore, the first paragraph in the English and in the French documents are different. The French document also has an additional paragraph that describes the position of France in this report. This paragraph does not exist in the English document. Figure 1: English-French comparable documents from Wikipedia Figure 2: English-French comparable news article from EURONEWS Comparable corpora can be a good alternative to parallel corpora, when this resource is not available or not enough for specific domains or languages. It can be noted from comparable document examples presented in Figures 1 and 2 , that comparable documents are informative when one is interested in what is being said about a topic in the other languages. So retrieving comparable documents can be useful in many applications beyond enriching language resources. For example, a journalist may be interested in what is being said about a news event covered in local and foreign news agencies, or a customer may be interested in exploring a product reviews written in different languages. In this paper, we present in Section 3 a method to build comparable corpora from Wikipedia encyclopedia 1 1 1 www.wikipedia.org and EURONEWS 2 2 2 www.euronews.com websites In Arabic, French, and English languages [ Saad2013cilc ] . Such resources does not exist publicly for researchers, so they are important and useful for the research community. We put the Wikipedia corpus online for research purposes 3 3 3 http://sourceforge.net/projects/crlcl/ . Then in Section 4 , we present two cross-lingual similarity measures [ Saad2014poltal ] that are used in this work for two tasks: (1) document pair retrieval, and (2) aligning comparable documents (Section ). In the first task, the corpus is already aligned and the objective is to retrieve the target document by providing the source document as a query. In this task we apply the similarity measures on several corpora and we compare their performance, then we choose the best measure of the two measures to achieve the second task. In the second task, the corpus is not aligned, and the objective is to automatically align comparable source and target documents which are related to the same context. The resultant English-Arabic comparable news documents do not exist in research community, so our corpus is interesting and very useful for other researchers and they open new research directions. 2 Related Words 2.1 Comparable Corpora Non-parallel corpora can have different levels of comparability. In [ Fung2004 ] , the authors proposed three levels for non-parallel corpora. These levels are noisy-parallel , comparable and quasi-comparable corpora. Texts in the noisy-parallel corpus have many parallel sentences roughly in the same order. Texts in the comparable corpus have topic aligned documents, which are not necessarily translations of each other. As for the quasi-comparable corpus, it has bilingual documents that are not necessarily related to the same topic. Most of researchers are interested in comparable corpora because they can be used to extract parallel texts for different purposes. This interest continues to receive increasing attention from the research community. For example, ACCURAT 4 4 4 www.accurat-project.eu project [ ACCURAT2012 , ACCURAT2012b ] is a research project dedicated to find methods and techniques to overcome the problem of lacking linguistic resources for under-resourced languages and narrow domains. The ultimate objective is to exploit comparable data to improve the quality of machine translation for such languages. The ACCURAT project researches for methods to measure comparable corpora and use them to achieve the project’s objective. The project also research methods for alignment and extraction of lexical resources. Other researchers also considered comparable corpora to improve the quality of machine translation such in [ Smith2010 , AbdulRauf2011 ] and to extract bilingual lexicons such in [ Li2010 ] . Many researchers collected comparable corpora in many languages. For instance, authors of [ Barron2015 ] extracted Spanish-English comparable corpus, [ CHU2014 ] constructed a Chinese-Japanese corpus, [ Otero2009 ] collected Spanish-Portuguese-English corpus, and [ Ion2010 ] collected English-Romanian corpus. In this paper we build Arabic-French-English comparable corpora, and we make it available publicly for the research community. Such resources are important and useful because they are not available freely for the research community. In the next section, we review some cross-lingual similarity measures, which are proposed to measure comparable corpora. 2.2 Cross-lingual Similarity Measures A document similarity measure is a function that quantifies the similarity between the content of two documents [ IRbook ] . This function gives a numerical score