Multilinguality at the Edge: Developing Language Models for the Global South

Lester James V. Miranda, Songbo Hu, Roi Reichart, Anna Korhonen · 2026

Read Multilinguality at the Edge: Developing Language Models for the Global South by Lester James V. Miranda, Songbo Hu, Roi Reichart, Anna Korhonen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21637.txt.

Introduction

Lester James Miranda and colleagues survey the last mile where multilingual language models meet edge deployment, the small-device settings common across the Global South. Reviewing 232 papers across the full pipeline, from data collection to deployment, they map how linguistic diversity and tight hardware limits pull in opposite directions. They also explain why the two research fields have stayed largely separate. The paper closes with open questions and practical recommendations for building fairer, more inclusive language technology.

Catalog record

CREATORLester James V. Miranda, Songbo Hu, Roi Reichart, Anna Korhonen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50724
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21637

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multilinguality at the Edge: Developing Language Models for the Global South Lester James V. Miranda, Songbo Hu, Roi Reichart, Anna Korhonen Abstract Where and how language models (LMs) are deployed determines who can benefit from them. However, there are several challenges that prevent effective deployment of LMs in non-English-speaking and hardware-constrained communities in the Global South. We call this challenge the last mile : the intersection of multilinguality and edge deployment, where the goals are aligned but the technical requirements often compete. Studying these two fields together is both a need , as linguistically diverse communities often face the most severe infrastructure constraints, and an opportunity , as edge and multilingual NLP research remain largely siloed. To understand the state of the art and the challenges of combining the two areas, we survey 232 papers that tackle this problem across the language modelling pipeline, from data collection to development and deployment. We also discuss open questions and provide actionable recommendations for different stakeholders in the NLP ecosystem. Finally, we hope that this work contributes to the development of inclusive and equitable language technologies. 1 Introduction Language models (LMs) have made remarkable progress in recent years and are increasingly integrated into everyday work and life ( 102 ) . This progress is evident in both multilingual coverage, with models now speaking hundreds of languages ( 156 ; 41 ) , and in efficiency, with capable models now small enough to deploy on smartphones and other edge devices ( 154 , inter alia ) . Yet despite these advances, a wide gap persists in who can actually deploy and use these models, particularly between the Global North and the Global South ( 67 ; 70 ; 124 ) . We can point to several factors that contribute to this disparity. Most LMs are not trained on the long tail of the world’s 7,000 languages and thus lack the performance necessary for downstream applications ( 116 ) . In addition, infrastructure constraints such as limited connectivity and low smartphone penetration, especially in the Global South, further restrict the use of both cloud-based and on-device models ( 45 ; 60 ) . As LMs become central to economic productivity, these barriers threaten to widen the divide further. Requirements of the Edge (§ 2.3 ) Requirements for Multilingual Capability (§ 2.4 ) Data Collection (§ 4.2.1 ) Pretraining (§ 4.2.2 ) Post-training (§ 4.2.3 ) Inference (§ 4.2.4 ) Evaluation (§ 4.2.5 ) Figure 1 : Competing requirements at each step of the language modelling pipeline. Edge LM deployment imposes constraints on memory, compute, and energy ( 154 ; 181 ) , which can conflict with the requirements for building capable multilingual models ( 92 ; 170 ) . This survey examines how these competing demands manifest across the pipeline and reviews techniques that address them. Reaching these communities through language technology requires a holistic understanding of their contexts, specifically on whether LMs can understand their language and run on their hardware. Tackling the problems of efficiency or multilinguality in isolation has merit ( 138 ) , but it risks not addressing the actual needs of the communities left behind this widening gap. For example, research on model compression has largely focused on English, with several studies observing degradation in multilingual performance as models are made smaller ( 117 ; 108 ; 97 ) . Similarly, multilingual scaling laws ( 92 ; 50 ) reveal a power-law relationship between multilingual performance and model scale, suggesting that smaller, more deployable models struggle with low-resource languages. Approaching these lines of work in tandem is important, as 5 argue that language communities face constraints not only in terms of data, but also of compute (the “low-resource double bind”). This view is echoed by 113 , who show that “low-resourceness” pertains to technology as much as data. Building on these insights, we then ask: “(1) what challenges and methods shape multilingual edge LM development, and (2) what opportunities exist for reaching the communities that need these technologies the most?” We call this challenge the last mile , which refers to the intersection of multilinguality and edge deployment, reaching communities that need both a model that understands their language and the efficiency to run on their available hardware devices. This challenge is non-trivial, as we show that while the goals of edge deployment and multilinguality are aligned, their technical requirements often compete. In addition, decisions made during development can directly affect whether a model is deployable on constrained hardware. In this work, we define the challenge of the last mile (§ 2 ) and survey 232 papers that address this problem at different stages of the language modelling pipeline (§ 2.2 ), characterizing the state of the art and the tensions between the competing requirements of edge deployment and multilinguality. For each stage, we describe how the constraints of edge deployment ( 2.3 ) and the requirements of multilinguality ( 2.4 ) can impose competing demands, and how existing work resolves the gap (§ 4.2 ). In addition, to stimulate new work at this intersection of multilingual and edge NLP, we discuss opportunities and provide actionable recommendations for different stakeholders (§ 6 ). Finally, we hope that this work contributes to the development of equitable language technologies. 2 Multilinguality at the Edge 2.1 Why Study the Two Fields Together? While Edge LM and Multilinguality have each been studied in isolation, we observe trends suggesting that they should be studied together. Need: Multilingual communities face infrastructure constraints The first trend is that communities with the highest linguistic diversity often face the most severe infrastructure constraints. As shown in Figure 2 , countries such as Papua New Guinea, Nigeria, and Chad are linguistically diverse yet among the least active on the Internet. This compounds their disadvantage in the LM pipeline: most pretraining data are derived from web-scale text, which these communities lack due to limited Internet activity, and the dominant paradigm for serving LMs relies on cloud infrastructure (i.e., requests are sent over a network). This leads to LMs that are both unable to serve their languages and undeployable in their specific contexts. In addition, entry-level smartphones cost up to 48% of monthly income for the poorest quintile in these regions, meaning the devices that do exist are mostly low-end 45 . Of the 21 countries with more than 100 living languages, 12 are classified as low or lower-middle income ( 164 ) , showing a need for models that can run entirely on-device. Figure 2 : Countries with high linguistic diversity have the most limited network connectivity (upper left). Internet penetration is sourced from 60 , number of living languages ( \log -scale) from the Ethnologue ( 146 ) , and income groups from the 164 . Opportunity: Research in these areas tends to focus on different stages of the LM pipeline Another reason for studying these two fields in tandem is the research opportunity it presents. Figure 3 shows that individual stages of the LM pipeline tend to be dominated by one field: Data Collection and Evaluation skew toward Multilinguality, while Pretraining through Inference skew toward Edge LM development. Looking at the papers that do focus on the full LM

Read the complete text