TMT: A Simple Way to Translate Topic Models Using Dictionaries CCS: Information systems Document topic models CCS: Information systems Content analysis and feature selection CCS: Information systems Multilingual and cross-lingual retrieval

Felix Engl, Prof. Dr. Andreas Henrich · 2025

Read TMT: A Simple Way to Translate Topic Models Using Dictionaries CCS: Information systems Document topic models CCS: Information systems Content analysis and feature selection CCS: Information systems Multilingual and cross-lingual retrieval by Felix Engl, Prof. Dr. Andreas Henrich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00822.txt.

Introduction

Felix Engl and Andreas Henrich introduce Topic Model Translation, or TMT. The method moves a topic model from one language to another. Training multilingual topic models is a hard task. It needs sophisticated algorithms and topic-aligned corpora. Manual evaluation is also required. All this is harder when the developer lacks the target language.

TMT uses dictionaries to do the translation. It needs no metadata, embeddings, or aligned corpora. The method is designed to be robust and transparent. It suits cases where target-language corpora are small or unusable. It also suits cases where manual translation is not feasible. Broad evaluation uses both quantitative and qualitative methods. Results show semantically coherent and consistent topic translations. Existing topic models can thus be reused across languages.

Catalog record

CREATORFelix Engl, Prof. Dr. Andreas Henrich
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-00822

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TMT: A Simple Way to Translate Topic Models Using Dictionaries CCS: Information systems Document topic models CCS: Information systems Content analysis and feature selection CCS: Information systems Multilingual and cross-lingual retrieval Felix Engl, Prof. Dr. Andreas Henrich Abstract . The training of topic models for a multilingual environment is a challenging task, requiring the use of sophisticated algorithms, topic-aligned corpora, and manual evaluation. These difficulties are further exacerbated when the developer lacks knowledge of the target language or is working in an environment with limited data, where only small or unusable multilingual corpora are available. Considering these challenges, we introduce TMT ( TMT ), a novel, robust and transparent technique designed to transfer topic models (e.g., LDA ( LDA ) based topic models) from one language to another, without the need for metadata, embeddings, or aligned corpora. TMT enables the reuse of topic models across languages, making it especially suitable for scenarios where large corpora in the target language are unavailable or manual translation is infeasible. Furthermore, we evaluate TMT extensively using both quantitative and qualitative methods, demonstrating that it produces semantically coherent and consistent topic translations. DRY Don’t Repeat Yourself API Application Programming Interface UML Unified Modeling Language IR Information Retrieval BDE Binary Direction Enhancement FIMO finite iterable mathematical object IIMO infinite iterable mathematical object HD Hamming Distance DCG discounted cumulative gain MAP mean average precision GMAP geometric mean of (per-topic) average precision LDA Latent Dirichlet Allocation LSA Latent Semantic Analysis LSI Latent Semantic Indexing NLP Natural Language Processing ML machine learning SVD singular value decomposition TF term frequency IDF inverse term frequency CLIR Cross Language Information Retrieval TMT Topic Model Translation SMT statistical machine translation NLTK Natural Language Toolkit NLP Natural Language Processing CLTM Cross-language topic modeling NDCG normalized discounted cumulative gain LLM Large Language Model RR reciprocal rank TP translation pair 1. Introduction The task of training topic models in a multilingual setting is challenging, especially when the data or expertise on the target language is limited. Existing methods for compensating these challenges usually rely on complex algorithms or large multilingual corpora, rendering the process demanding in various regards like available data or manual evaluation. In response, we introduce TMT , a transparent, resource-efficient way to transfer topic models (e.g., LDA -Models) from one language to another. In short, TMT is a robust algorithm that excels in scenarios where a given, ready-to-use monolingual topic model needs to cover multiple languages, or where only one language has a sufficient amount of training data and extensive parallel corpora are not available. This is done by, topic-wise, translating a monolingual topic model into another language via basic dictionaries and selecting the appropriate translations based on topical relevance, derived by voting techniques from expert search. We will also showcase a method to quantifying the consensus of the source and translated topic models by using established metrics like recall, precision and the NDCG ( NDCG ). The qualities of TMT are particularly useful in digital humanities, enabling cross-linguistic comparisons of historical texts or training topic models for topics, where the target language has no sufficient data for training. The rest of the publication is structured as follows: Section 2 reviews related works. Section 3 introduces TMT and Section 4 describes the experimental setup. Section 5 discusses the experimental results and classifies the findings. The conclusions are stated in Section 6. 2. Background and Related Work TMT belongs to the field of CLTM ( CLTM ), but differs substantially from typical cross-lingual methods. Prior studies in this area, including Hao and Paul 2018 , primarily rely on large bilingual or multilingual corpora ( Søgaard et al. 2015 ; Jagarlamudi and Daumé 2010 ; Boyd-Graber and Blei 2009 ) , specialized datasets with meta information ( Zhao and Xing 2006 ) , cross-lingual topic-linked corpora ( Yang et al. 2019 ) , or modifications to the underlying topic modeling algorithms ( Andrzejewski et al. 2009 ; Dennis 1991 ; Bianchi et al. 2021 ) . More recent approaches further integrate document relations ( Wang et al. 2020 ; Terragni et al. 2020 ) , word embeddings ( Debora Nozza et al. 2016 ; Li et al. 2016 ; Zhao et al. 2017 ; Dieng et al. 2020 ) , or pre-trained multilingual models such as BERT ( Devlin et al. 2019 ; Vo 2022 ) . In contrast, TMT requires only a machine-readable dictionary that maps words between languages, and does not rely on additional metadata, contextualized datasets, or modifications to the topic modeling algorithm itself. This distinguishes TMT as a more lightweight approach. The approach most closely related to TMT is described by Preiss 2012 , who uses a machine translation service to translate a topic model for evaluation purposes. However, this method is not described in detail and does not constitute a core contribution of that work. 3. Methodology This section explains TMT by means of a step-by-step example (see Fig. 1 ), followed by an introduction to the used terminology and voting models, as well as a detailed description of the TMT algorithm. Figure 1. An example translation of an English LDA topic model into German using TMT . The translated topic 1 is about aviation. The curly brackets indicate the algorithms and models used. The second half of the figure shows the translation and re-translation process (including fan-out) as well as the voting and normalization step for three candidate terms in more detail. Exemplary translation of an English topic model for topic about aviation, the top four words are plane, aircraft, pilot, and radio. The process describes the translation of plane, aircraft , the steps are described in detail in the section Methodology - Abstract Algorithm. 1. Translate: plane is translated to Flugzeug, Fläche, Flieger, Tragfläche. These are the candidates. 2. Re-Translate a. Flugzeug is re-translated to: plane, aircraft, and airplane. b. Flieger is re-translated to: plane, area, surface, and plain. 3. Create Topic-Specific Voters a. Flugzeug - plane: rank 1, prob. 0.019 - aircraft: rank 2, rob. 0.018 - airplane: rank 9, rob. 0.012 b. Fläche - plane: rank 1, prob. 0.019 - area: rank 10, prob. 0.011 - surface: rank 30, prob. 0.002 - plain: rank 40, prob. 0.001 4. Run Votings: CombSUM(4), sums up the top four voter scores for a candidate a. Flugzeug: 0.049 b. Fläche: 0.032 c. Flieger: 0.052 d. Tragfläche: 0.038 5. Refine Terms: Take three best candidates for a English term a. plane - Flugzeug: 0.049 - Flieger: 0.052 - Tragfläche: 0.038 b. aircraft (steps 1 to 5 were omitted for this term) - Flugzeug: 0.049 - Luftfahrzeug: 0.043 - Flieger: 0.042 6. Assembly of Scores - Flugzeug: 0.049, 0.049 - Flieger: 0.052, 0.042 7. Build Topic: max(scores), results in an unnormalized, German topic 1 a. Flieger: 0.052 b. Flugzeug: 0.049 8. Normalize Topic: score(term)/sumOf(all scores) a. Flieger: 0.013 b. Flugzeug: 0.012 9. Build Topic Model: Combine the translated topics to a topic model \parThe second part of the image shows the Translate, Re-Translate and Voting process in a bigger scale with more terms, to emphasize the fan-out effects. For example: The word plane translates to 11 German words. Four are related to aviation, two to geometry, two to construction, and three to

Read the complete text