Open-Source Large Language Models as Multilingual Crowdworkers: Synthesizing Open-Domain Dialogues in Several Languages With No Examples in Targets and No Machine Translation
Ahmed Njifenjou, Virgile Sucal, Bassam Jabaian, Fabrice Lefèvre · 2025
Read Open-Source Large Language Models as Multilingual Crowdworkers: Synthesizing Open-Domain Dialogues in Several Languages With No Examples in Targets and No Machine Translation by Ahmed Njifenjou, Virgile Sucal, Bassam Jabaian, Fabrice Lefèvre (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03462.txt.
Description
Dialogue data in many languages can be made by open-source language models acting as crowdworkers, Ahmed Njifenjou and co-authors show in a 2025 paper. Open-domain dialogue work has focused on English, in both models and data sets. Crowdsourcing new data sets for fine-tuning costs much money and time, above all when several languages are needed for one project.
Instruction-tuned models can follow natural language instructions and can work in varied languages in a single thread, at times surpassing human crowdworkers. The team leverages those traits to replicate the data collection process itself. Their pipeline synthesizes dialogues in several languages with no examples in the target languages and no machine translation. Readers get a cheaper route to multilingual dialogue data.
Catalog record
| CREATOR | Ahmed Njifenjou, Virgile Sucal, Bassam Jabaian, Fabrice Lefèvre |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 140 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03462