Budget-Xfer: Budget-Constrained Source Language Selection for Cross-Lingual Transfer to African Languages Conference: Preprint; 2026; CCS: Computing methodologies Information extraction CCS: Computing methodologies Language resources CCS: Computing methodologies Machine learning approaches
Tewodros Kederalah Idris, Roald Eiselen, Prasenjit Mitra · 2026
Read Budget-Xfer: Budget-Constrained Source Language Selection for Cross-Lingual Transfer to African Languages Conference: Preprint; 2026; CCS: Computing methodologies Information extraction CCS: Computing methodologies Language resources CCS: Computing methodologies Machine learning approaches by Tewodros Kederalah Idris, Roald Eiselen, Prasenjit Mitra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27651.txt.
Introduction
Idris and co-authors pick source languages for cross-lingual transfer on a budget. Prior studies rarely fixed the total data volume. Budget-Xfer treats source choice as resource allocation. It picks both languages and per-language data shares. Four strategies face tests on entity and sentiment tasks. Targets are Hausa, Yoruba, and Swahili. In total, 288 experiments were run. Multi-source transfer beats single-source by a wide margin. Strategy gaps among multi-source plans stay small.
Catalog record
| CREATOR | Tewodros Kederalah Idris, Roald Eiselen, Prasenjit Mitra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23035 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27651
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Budget-Xfer: Budget-Constrained Source Language Selection for Cross-Lingual Transfer to African Languages Conference: Preprint; 2026; CCS: Computing methodologies Information extraction CCS: Computing methodologies Language resources CCS: Computing methodologies Machine learning approaches Tewodros Kederalah Idris, Roald Eiselen, Prasenjit Mitra Abstract . Cross-lingual transfer learning enables NLP for low-resource languages by leveraging labeled data from higher-resource sources, yet existing comparisons of source language selection strategies do not control for total training data, confounding language selection effects with data quantity effects. We introduce Budget-Xfer , a framework that formulates multi-source cross-lingual transfer as a budget-constrained resource allocation problem. Given a fixed annotation budget B B , our framework jointly optimizes which source languages to include and how much data to allocate from each. We evaluate four allocation strategies across named entity recognition and sentiment analysis for three African target languages (Hausa, Yoruba, Swahili) using two multilingual models, conducting 288 experiments. Our results show that (1) multi-source transfer significantly outperforms single-source transfer (Cohen’s d = 0.80 d=0.80 – 1.98 1.98 ), driven by a structural budget underutilization bottleneck; (2) among multi-source strategies, differences are modest and non-significant; and (3) the value of embedding similarity as a selection proxy is task-dependent, with random selection outperforming similarity-based selection for NER but not sentiment analysis. 1. Introduction Cross-lingual transfer learning enables NLP systems for low-resource languages by training on labeled data from higher-resource source languages. This is particularly important for African languages, which remain severely underrepresented in NLP despite serving hundreds of millions of speakers ( 10 ; 2 ) . A fundamental question is source language selection : which source languages should be used for training, and how should data be distributed among them? Several selection strategies have been explored, including typological distance from linguistic databases ( 13 ; 7 ) , embedding similarity from multilingual models ( 12 ; 8 ) , and multi-source transfer combining data from multiple sources ( 5 ; 11 ) . However, existing comparisons share a critical limitation: they do not control for total training data. Because source languages have varying dataset sizes, different strategies yield different total training examples, confounding language selection with data quantity. Lim et al. ( 11 ) addressed this by equalizing total training size, but used only uniform allocation and focused on understanding why multi-source transfer works rather than how to optimally distribute a fixed budget. The question practitioners face is concrete: “Given N labeled sentences, which languages should I annotate and how much from each?” We introduce Budget-Xfer , a framework that formulates multi-source cross-lingual transfer as a budget-constrained resource allocation problem. Given a fixed budget B , we jointly optimize which source languages to include and how much data to allocate from each. By holding the total budget constant across all strategies, we isolate the effect of language selection and allocation decisions from data quantity. We compare four allocation strategies on NER and sentiment analysis across three African target languages using two multilingual models. Our contributions are: (1) A budget-constrained formulation enabling fair comparison of allocation strategies under controlled data conditions. While prior work has controlled total data size ( 11 ) , we are the first to systematically compare allocation strategies, treating the distribution of data across sources as the variable of interest. (2) Four allocation strategies including a diversity-aware approach that balances source-target similarity with inter-source redundancy. (3) Budget-controlled experiments (288 runs) yielding actionable findings: multi-source transfer strongly outperforms single-source due to a structural budget underutilization bottleneck, differences among multi-source strategies are modest, and the value of similarity-based selection is task-dependent. 2. Related Work Source language selection for cross-lingual transfer has been studied through multiple lenses. Lin et al. ( 12 ) introduced LangRank, framing source selection as a ranking problem. Eronen et al. ( 8 ) showed that linguistic similarity metrics correlate with transfer performance and that optimal source selection yields significant gains over defaulting to English. These methods address which source to select but do not consider how to distribute a fixed budget across multiple sources. Multi-source transfer has been studied by Chen et al. ( 5 ) , who proposed an adversarial mixture-of-experts framework. Most closely related to our work, Lim et al. ( 11 ) controlled total training size across conditions and found that multi-source training increases embedding space mingling. However, they used only uniform allocation and focused on understanding the mechanism rather than optimizing the allocation itself. We build on their insight that data quantity must be controlled, and go further by treating the allocation vector as the variable to optimize. Data allocation across languages has been studied for multilingual pre-training ( 6 ) , but these approaches operate over unlabeled data and optimize for general-purpose representations. Our work addresses allocation for supervised fine-tuning , where the budget is orders of magnitude smaller, each example is costly to annotate, and the allocation directly determines downstream task performance. 3. Methodology 3.1. Problem Formulation Given a target language t , a pool of n candidate source languages \mathcal{S}=\{s_{1},\ldots,s_{n}\} , and a fixed budget B (in training sentences), we seek an allocation vector \mathbf{a}=[a_{1},\ldots,a_{n}] maximizing transfer performance: (1) \mathbf{a}^{*}=\arg\max_{\mathbf{a}}\;P(t\mid\mathbf{a})\quad\text{s.t.}\quad\sum_{i=1}^{n}a_{i}=B,\;\;a_{i}\geq 0 Since exhaustive search is infeasible, we use a pre-computed utility proxy to approximate source value. Following prior work showing cosine_gap predicts cross-lingual transfer ( \rho=0.4 – 0.6 ) ( 9 ) , we compute pairwise similarities using 1,012 parallel sentences per language from FLORES-200 ( 17 ) : (2) \text{cosine\_gap}(s,t)=\overline{\cos(\mathbf{h}_{s},\mathbf{h}_{t})}_{\text{aligned}}-\overline{\cos(\mathbf{h}_{s},\mathbf{h}_{t})}_{\text{misaligned}} 3.2. Allocation Strategies We compare four strategies (Table 1 ) varying in source selection and budget distribution. When allocations exceed a source’s available data, a cap-and-redistribute procedure ensures total training data is exactly B for all strategies. Table 1. Allocation strategies. K{=}5 for all multi-source strategies. Strategy Selection Allocation All-from-Best Top 1 by sim Entire budget Top-K-Prop. Top K by sim Proportional to sim Random-K K random Equal split Diversity-Aware Greedy diverse K Proportional to sim All-from-Best allocates the entire budget to the single most similar source ( a_{s^{*}}=B , s^{*}=\arg\max_{s}\text{sim}(s,t) ), serving as the single-source baseline. This tests whether concentrating all resources on the most promising source outperforms distributing data across multiple languages. Top-K-Proportional selects the K most similar sources and allocates proportionally to their similarity scores: (3) a_{i}=B\cdot\frac{\text{sim}(s_{i},t)}{\sum_{s_{j}\in\text{Top-}K}\text{sim}(s_{j},t)} More similar sources receive proportionally more training data, testing whether weighting by similarity improves over uniform distribution. Random-K selects K sources uniformly at random with equal allocation ( a_{i}=B/K ). This uninformed baseline uses no similarity information; if similarity-informed strategies consistently outperform Random-K , it validates the utility proxy under budget constraints. Diversity-Aware modifies source selection to penalize redundancy among chosen sources. Sources are selected iteratively by maximizing: (4) \text{score}(s)=\text{sim}(s,t)-\alpha\cdot\max_{s^{\prime}\in\mathcal{C}}\text{sim}(s,s^{\prime}) where \mathcal{C} is the set of already-selected sources and \alpha=0.5 controls the diversity penalty. When \alpha=0 , this reduces to standard top- K selection. In the first round, \mathcal{C}=\emptyset and \text{score}(s)=\text{sim}(s,t) , so the most similar source is always selected first. After selection, budget is allocated proportionally to raw similarity, separating the roles of diversity (affecting selection) and similarity (determining allocation). Comparing Diversity-Aware to Top-K-Proportional isolates the effect of diversity-based selection, since both use the same allocation rule but may select different sources. We also evaluated Top-K-Uniform and Greedy-Marginal strategies; results were consistent with the four strategies reported here. 4.