From Scratch to Fine-Tuned: A Comparative Study of Transformer Training Strategies for Legal Machine Translation
Amit Barman, Atanu Mandal, Sudip Kumar Naskar · 2025
Read From Scratch to Fine-Tuned: A Comparative Study of Transformer Training Strategies for Legal Machine Translation by Amit Barman, Atanu Mandal, Sudip Kumar Naskar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18593.txt.
Description
Amit Barman, Atanu Mandal, and Sudip Kumar Naskar build translation tools for Indian law. Most legal and court documents in India are written in English, which locks out citizens who read only Hindi or other languages. Their paper, posted to arXiv in December 2025 and prepared for the JUST-NLP 2025 shared task, compares two ways to train an English-Hindi legal translator.
One strategy fine-tunes the pretrained OPUS-MT model on legal text. The other trains a transformer from scratch on the legal corpus alone. Scored with SacreBLEU, chrF++, COMET, and other metrics, the fine-tuned model wins clearly, reaching a SacreBLEU of 46.03 and beating both the baseline and the from-scratch systems. Domain adaptation, they conclude, is what makes legal machine translation good enough to widen access to justice.
Catalog record
| CREATOR | Amit Barman, Atanu Mandal, Sudip Kumar Naskar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-18593