Modality Matching Matters: Calibrating Language Distances for Cross-Lingual Transfer in URIEL +
York Hay Ng, Aditya Khan, Xiang Lu, Matteo Salloum, Michael Zhou, Phuong Hanh Hoang, A. Seza Doğruöz, En-Shiun Annie Lee · 2025
Read Modality Matching Matters: Calibrating Language Distances for Cross-Lingual Transfer in URIEL + by York Hay Ng, Aditya Khan, Xiang Lu, Matteo Salloum, Michael Zhou, Phuong Hanh Hoang, A. Seza Doğruöz, En-Shiun Annie Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19217.txt.
Introduction
York Hay Ng and seven co-authors argue that language distances used for cross-lingual transfer must match the kind of data behind each distance. Knowledge bases such as URIEL+ give geographic, family, and structural distances between languages. But their single fixed vectors fit the varied data poorly and lack a principled way to merge signals.
The authors build tailored representations for each kind of distance. Speaker-weighted distributions handle geography, and curved-space embeddings handle family trees. A latent variable model handles structural traits. Combined into one robust score, the distances improve zero-shot transfer choices, helping models borrow training data from the right donor languages.
Catalog record
| CREATOR | York Hay Ng, Aditya Khan, Xiang Lu, Matteo Salloum, Michael Zhou, Phuong Hanh Hoang, A. Seza Doğruöz, En-Shiun Annie Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19217
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modality Matching Matters: Calibrating Language Distances for Cross-Lingual Transfer in URIEL + York Hay Ng, Aditya Khan, Xiang Lu, Matteo Salloum, Michael Zhou, Phuong Hanh Hoang, A. Seza Doğruöz, En-Shiun Annie Lee Abstract Existing linguistic knowledge bases such as URIEL + provide valuable geographic, genetic and typological distances for cross-lingual transfer but suffer from two key limitations. One, their one-size-fits-all vector representations are ill-suited to the diverse structures of linguistic data, and two, they lack a principled method for aggregating these signals into a single, comprehensive score. In this paper, we address these gaps by introducing a framework for type-matched language distances. We propose novel, structure-aware representations for each distance type: speaker-weighted distributions for geography, hyperbolic embeddings for genealogy, and a latent variables model for typology. We unify these signals into a robust, task-agnostic composite distance. In selecting transfer languages, our representations and composite distances consistently improve performance across a wide range of NLP tasks, providing a more principled and effective toolkit for multilingual research. 1 1 footnotetext: The authors contributed equally. 1 Introduction Linguistic knowledge bases such as URIEL / URIEL + Littell et al. 2017 ; Khan et al. 2025 are foundational tools that quantify linguistic distance for over 7,000 languages. These distances fall into three modalities , or feature categories: geographic (locations of languages), genetic (linguistic family trees), and typological (linguistic features unique to each language) 1 1 1 The typological modality is also commonly referred to as featural (e.g. in Khan et al. 2025 ). , as shown in Figure 1 . These measures are widely used in cross-lingual transfer research to assess and leverage linguistic similarity between languages for tasks such as selecting optimal source languages for model training ( Lin et al. 2019 ; Lauscher et al. 2020 ; Ruder et al. 2021 ; Khiu et al. 2024 ) . As indicated by Toossi et al. 2024 , URIEL represents languages in all three modalities as high-dimensional Euclidean vectors, compared via angular distance. This uniform approach is convenient but ill-suited for the diverse structures of linguistic data. That is to say, it produces less meaningful distances and limits the effectiveness of cross-lingual transfer where accurate representations of linguistic distance is paramount. In our study, we address this issue by proposing modality-specific distances from new language representations. Figure 1: A demonstration of URIEL+ language representations versus our proposed representations, for each modality. Distance scores are shown for URIEL + (left number) and our proposed representation (right number). Lower values indicate greater similarity. Limitations in URIEL + Representations Geographic Both URIEL and URIEL + represent each language by a single Glottolog coordinate, with geographic vectors computed as great-circle distances to 299 fixed reference points. This single-point proxy misses multi-country and diaspora populations. It also reflects historical or administrative geographical locations rather than current speaker distributions which is a key determinant for language contact Nichols 1992 . For example, English, French, and Spanish are pinned near cities such as London, Paris, and Madrid, although most speakers of these languages reside elsewhere (Figure 1 , Geographic). This can result in counter-intuitive discrepancies, causing languages with large, overlapping speaker communities to appear geographically distant and providing misleading signals for transfer. Genetic The current genetic representation flattens the Glottolog tree into sparse, one-hot vectors indicating language family membership (>3700 dimensions, 99.85% zeros), losing the crucial hierarchical structure of genetic relationships. This flat representation counts shared ancestry at all levels equally. For example, the close relationship between German and English (West Germanic) is given the same weight as the far more distant relationship between German and Hindi (Indo-European) (Figure 1 , Genetic), obscuring fine-grained distinctions essential for transfer. Moreover, this representation is limited to terminal nodes (languages), failing to provide embeddings for internal nodes (language families and sub-families), which are crucial for historical linguistics. Typological High-dimensional binary feature vectors are sparse, with correlated and sometimes redundant features, weakening the ability of angular distances to capture meaningful structural similarity. For instance, features for “Subject-Object-Verb” and “Subject-Verb-Object” word order are highly correlated yet treated as independent signals, inflating distances between languages which differ on related features. Ng et al. 2025 showed that such redundancy and high dimensionality reduce the effectiveness of typological vectors in capturing meaningful structural similarity. Given the limitations in language representations in URIEL and URIEL+ (especially for cross-lingual transfer), what makes a good language distance for transfer? We claim that each modality should use a representation and distance suited to its structure. Therefore, we embed the original URIEL + vectors into a form that captures the inherent structure (e.g., the hierarchical genealogy) of each modality and compute distances on this new representation. Another fundamental limitation of URIEL + is that it cannot compute a cumulative distance using all modalities. This forces researchers to choose between signals (e.g., typology or genetics), even though a unified metric is often preferred for practical applications such as transfer language selection Ahuja et al. 2022 ; Srinivasan et al. 2021 . We address this gap by developing a composite distance: a weighted average of distances from individual modalities, providing a single value that simplifies applications in cross-lingual transfer. Our paper rectifies the aforementioned issues with the following contributions: 1. We formalize modality-matched language distances, introducing new representations and distance metrics for each modality. 2. We propose a simple composite distance that aggregates modality-specific distances. Empirically, across the LangRank setting and other transfer benchmarks, modality-matched distances consistently improve source language selection. 2 Related Research URIEL in Cross-Lingual Transfer URIEL distances serve as a strong predictor of transfer performance Khiu et al. 2024 ; Philippy et al. 2023 ; Lauscher et al. 2020 ; Tran and Bisazza 2019 between languages, performing comparably to other linguistic measures Eronen et al. 2023 . Consequently, URIEL distances have been widely applied to enhance cross-lingual transfer, particularly in predicting the performance of multilingual models Anugraha et al. 2025 ; Srinivasan et al. 2021 ; Xia et al. 2020 ; Patankar et al. 2022 , selecting transfer languages Lin et al. 2019 ; Eronen et al. 2023 , and language model regularization Adilazuarda et al. 2024 , demonstrating its indispensable role in multilingual natural language processing (NLP). Distributional Representation of Geographic Data Moving from "language as a point" to "language as a distribution" is crucial for capturing signals from language contact ( Dunn and Edwards-Brown 2024 ; Nichols 1992 ) . Empirical audits show that single-point geography can mask biases in data by under-representing where speakers actually reside ( Faisal et al. 2022 ) . A natural method for comparing speaker distributions is the Wasserstein-1 distance (or Earth Mover’s distance) ( Villani 2009 ) , which measures the minimum "work" needed to transform one distribution into another. Optimal transport has proven effective in NLP for tasks such as measuring document similarity ( Kusner et al. 2015 ) , evaluating text generation ( Clark et al. 2019 ) , and aligning word embeddings ( Zhang et al. 2017 ) , making it a well-grounded choice for our geographic modality. Sparser Representations of Typological Data Typological feature sets are often high-dimensional, redundant, and noisy Ng et al. 2025 , with inconsistent feature choices yielding wide variation across studies ( Ploeger et al. 2024 ;