Beyond Translation: Evaluating Mathematical Reasoning Capabilities of LLMs in Sinhala and Tamil

2026

Read Beyond Translation: Evaluating Mathematical Reasoning Capabilities of LLMs in Sinhala and Tamil (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-14517.txt.

Description

Sukumar Kishanthan and three co-authors evaluate a 2026 arXiv question: how well do language models tutor math in low-resource languages? Models show strong math reasoning in English and increasingly serve as tutoring tools, yet reliability for students in non-English languages, especially low-resource ones, remains poorly understood. The study examines Sinhala and Tamil, common tongues in South Asian schools yet thinly covered in AI research.

Six kinds of math problems were used, ranging from plain sums to hard problems where units clash or must be tuned. To dodge translation bias, each problem was written fresh in Sinhala and Tamil by mother-tongue speakers, all strong in math, with the English versions by fluent speakers. Plain sums carried across languages well, while harder thought showed big gaps, marking where multi-language tutoring still falls short.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-14517

Browse the full library · About the Tower of Babel