Efficient Multilingual Dialogue Processing via Translation Pipelines and Distilled Language Models
Santiago Martínez Novoa, Nicolás Rozo Fajardo · 2026
Read Efficient Multilingual Dialogue Processing via Translation Pipelines and Distilled Language Models by Santiago Martínez Novoa, Nicolás Rozo Fajardo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-09059.txt.
Introduction
Santiago Martinez Novoa and Nicolas Rozo Fajardo build a team tool for health talk in more than one tongue. Their task was part of a shared health AI test in 2025. Talks come in Indic tongues. The tool must sum them and answer asks in them. Few tools do such work well in low resource tongues.
Their chain has three stages. First, talks are turned to English. Next, a small distilled model sums and answers. Last, results turn back to the source tongue. Each stage is lean, so the chain can run on a fair budget. A reader in health tech gets a plain chain that may serve clinics where staff and sick folk share no one tongue.
Catalog record
| CREATOR | Santiago Martínez Novoa, Nicolás Rozo Fajardo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-09059
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Multilingual Dialogue Processing via Translation Pipelines and Distilled Language Models Santiago Martínez Novoa, Nicolás Rozo Fajardo Abstract This paper presents team Kl33n3x’s multilingual dialogue summarization and question answering system developed for the NLPAI4Health 2025 shared task. The approach employs a three-stage pipeline: forward translation from Indic languages to English, multitask text generation using a 2.55B parameter distilled language model, and reverse translation back to source languages. By leveraging knowledge distillation techniques, this work demonstrates that compact models can achieve highly competitive performance across nine languages. The system achieved strong win rates across the competition’s tasks, with particularly robust performance on Marathi (86.7% QnA), Tamil (86.7% QnA), and Hindi (80.0% QnA), demonstrating the effectiveness of translation-based approaches for low-resource language processing without task-specific fine-tuning. 1 Introduction Multilingual dialogue understanding presents significant challenges, particularly for low-resource Indic languages 9 ; 10 . While recent advances in large language models (LLMs) have demonstrated impressive capabilities in English, their performance on other languages remains limited 11 ; 7 . These limitations are particularly pronounced when dealing with conversational data, which requires understanding context, speaker turns, and discourse structure 8 ; 18 . This paper describes the system developed by team Kl33n3x for the NLPAI4Health 2025 shared task 1 1 1 https://nlpai4health.com/ , which focuses on generating summaries and answering questions from multilingual dialogues across eight Indic languages (Marathi, Kannada, Gujarati, Telugu, Tamil, Bangla, Hindi, and Assamese) plus English. The key insight is that leveraging high-quality translation models combined with powerful English-centric generative models can outperform direct multilingual approaches, especially when training data quality is questionable. 2 System Architecture For the first implementation, the idea was to finetune an LLM in order to acquire a model that was trained for perfoming the tasks required. For this, two options were considered: a complete finetune of the model or a low-rank adaptation (LoRA) ( 5 ) . The first option was discarded for two main reasons: computational cost and training time, both aspects of this solution were really expensive, therefore, it was decided to continue with LoRA finetune. This solution seemed to be promising as it reduced training time. However, evaluation revealed that the LoRA-adapted model struggled with maintaining factual consistency across long dialogues and exhibited lower performance on specialized medical terminology, falling short of the required clinical accuracy standards. Because of this, it was necessary to pivot to another approach. Thus, the final implemented system comprises three main components that form a sequential pipeline. Each component is carefully chosen to maximize both quality and computational efficiency. 2.1 Forward Translation Model For translating dialogues from Indic languages to English, the system employs prajdabre/rotary-indictrans2-indic-en-dist-200M , based on the IndicTrans2 architecture. This model extends foundational sequence-to-sequence architectures like MarianMT and mBART50, optimized specifically for Indic-English language pairs. The model employs rotary position embeddings (RoPE) ( 15 ) , which improve generalization across sequence lengths and preserve positional information in continuous space. The architecture uses standard transformer self-attention and cross-attention mechanisms to encode source text into contextual embeddings and decode them into fluent English sentences. The decision to use a model to translate first is rooted in performance considerations. While multilingual summarization and question answering models exist, they may exhibit lower robustness and consistency across the different Indic languages required. In contrast, English summarization and QA models benefit from significantly larger training corpus, stronger evaluation benchmarks, and more advanced domain adaptation techniques. By first translating all dialogues into English using a highly specialized and accurate Indic to English translation model, the system can leverage English-language models for summarization and question answering. Empirically and conceptually, this pipeline yields higher overall quality than relying on a single multilingual model with a wider language coverage but weaker performance in each individual language, thereby prioritizing output accuracy and reliability in a clinical context. This translate-first approach is consistent with findings in cross-lingual NLP showing that specialized translation models followed by monolingual task-specific models often outperform end-to-end multilingual systems, particularly for low-resource languages ( 6 ; 1 ) . 2.2 Multitask Generation Model At the core of the system is a distilled version of Qwen3-4B-Instruct. Specifically, the implementation utilizes unsloth/Qwen3-4B-Instruct-2507-unsloth-bnb-4bit , which employs 4-bit quantization and optimization techniques from the Unsloth framework. The actual number of parameters in this distilled model is 2.55B, achieved through knowledge distillation techniques ( 4 ; 14 ) that compress the original 4B parameter model while retaining most of its capabilities. Knowledge distillation works by training a smaller "student" model to mimic the behavior of a larger "teacher" model, typically by matching output distributions or intermediate representations ( 3 ) . This approach allows the system to maintain strong performance while significantly reducing computational requirements and memory footprint,critical considerations for practical deployment. This single model is employed for all three tasks (narrative summarization, structured summarization, and question answering) through task-specific prompting. A decisive factor in the selection of this model is its exceptionally large context window, which supports sequences of up to approximately 256k tokens ( 17 ) . This capability is particularly critical for medical dialogue processing, as previous work has shown that models with limited context windows cannot capture entire clinical conversations ( 2 ) . Models with limited context windows would require truncation or sliding-window strategies, both of which risk losing clinically relevant information and may result in poor utilization of information in the middle of long contexts ( 12 ) . Such dialogues could become even longer after translation into English due to tokenization effects. By contrast, the large-context capacity of the Qwen architecture allows the entire conversational history to be processed in a single forward pass, enabling the model to ground its summaries and answers in the full dialogue context and to preserve discourse-level coherence and factual consistency. Finally, the use of a single pre-trained, instruction-tuned model across all tasks offers significant practical advantages over maintaining separate specialized models. The selected 4-bit quantized version reduces GPU memory requirements to approximately 6GB compared to 18-24GB for loading multiple model instances simultaneously. This approach simplifies deployment architecture and maintenance—critical considerations for resource-constrained clinical settings. While specialized models fine-tuned for individual tasks might achieve higher performance on specific benchmarks, the instruction-following capabilities of Qwen3-4B-Instruct enable it to handle diverse tasks through prompt engineering alone ( 16 ; 13 ) , making the computational and operational trade-offs favorable for our deployment scenario. 2.3 Reverse Translation Model For translating generated English outputs back to source languages, the system uses prajdabre/rotary-indictrans2-en-indic-dist-200M . This model mirrors the forward translation architecture but operates in the opposite direction. 2.4 Preprocessing Pipeline The preprocessing pipeline begins with dialogue formatting, where raw dialogue data is structured with clear speaker attribution and turn boundaries. For both translation models, special language tokens are added to indicate source and target languages following IndicTrans2 conventions (e.g., <2en> for translation to English). Text normalization includes standard procedures such as removing excessive whitespace, handling special characters, and ensuring consistent Unicode encoding. The pipeline preserves dialogue structure markers (speaker names, turn indicators) throughout the translation process to maintain conversational coherence. For the generation model, task-specific instructions are prepended to dialogues in a standardized format, informing the model whether to produce narrative summaries, structured summaries, or question-answer pairs. Maximum sequence length constraints are