EuroLLM-22B: Technical Report

Miguel Moura Ramos* Duarte M. Alves* Hippolyte Gisserot-Boukhlef*, João Alves Pedro Henrique Martins Patrick Fernandes José Pombal, Nuno M. Guerreiro Ricardo Rei Nicolas Boizard Amin Farajian, Mateusz Klimaszewski José G. C. de Souza Barry Haddow François Yvon, Pierre Colombo Alexandra Birch ⋄ \diam · 2026

Read EuroLLM-22B: Technical Report by Miguel Moura Ramos* Duarte M. Alves* Hippolyte Gisserot-Boukhlef*, João Alves Pedro Henrique Martins Patrick Fernandes José Pombal, Nuno M. Guerreiro Ricardo Rei Nicolas Boizard Amin Farajian, Mateusz Klimaszewski José G. C. de Souza Barry Haddow François Yvon, Pierre Colombo Alexandra Birch ⋄ \diam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05879.txt.

Description

Europe's tongues are ill-served by open language models, and Miguel Moura Ramos and 17 co-authors present EuroLLM-22B, a model trained from scratch to serve them. It covers all twenty four official European Union tongues plus eleven more. The tech report walks through the full build: word-piece design, shape, data sifting, and training steps.

Across a broad set of many-tongue tests, the model does well in reasoning, instruction following, and translation, matching models of like size. The team puts out the base and instruction tuned models, the many-tongue web training data, updated instruction data sets, and the training and test code. That openness is part of the point: Europe's research groups gain a base they can inspect and extend. The report logs choices in enough detail to redo the pipe. It should catch builders of local and public interest language models.

Catalog record

CREATORMiguel Moura Ramos* Duarte M. Alves* Hippolyte Gisserot-Boukhlef*, João Alves Pedro Henrique Martins Patrick Fernandes José Pombal, Nuno M. Guerreiro Ricardo Rei Nicolas Boizard Amin Farajian, Mateusz Klimaszewski José G. C. de Souza Barry Haddow François Yvon, Pierre Colombo Alexandra Birch ⋄ \diam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05879

Browse the full library · About the Tower of Babel