Investigating Bias: A Multilingual Pipeline for Generating, Solving, and Evaluating Math Problems with LLMs
Mariam Mahran, Katharina Simbeck · 2025
Read Investigating Bias: A Multilingual Pipeline for Generating, Solving, and Evaluating Math Problems with LLMs by Mariam Mahran, Katharina Simbeck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17701.txt.
Introduction
Mariam Mahran and Katharina Simbeck test language models on math problems in three languages. Their 2025 arXiv paper builds an automated pipeline that generates, solves, and grades school math. The problems follow the German K-10 curriculum, and the team produced hundreds of exercises in English, German, and Arabic versions.
Three commercial models wrote step-by-step solutions in each language. A separate panel of model judges, held out from the solvers, graded the work with a comparative framework. A steady gap appeared: English solutions scored highest, and Arabic often ranked lowest. The same model, the same problems, and the same math still yielded unequal teaching quality by language. The authors frame the result as persistent linguistic bias. They argue that equitable multilingual systems for education need direct measurement of this kind, not assumptions.
Catalog record
| CREATOR | Mariam Mahran, Katharina Simbeck |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17701
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Investigating Bias: A Multilingual Pipeline for Generating, Solving, and Evaluating Math Problems with LLMs Mariam Mahran, Katharina Simbeck Abstract Large Language Models (LLMs) are increasingly used for educational support, yet their response quality varies depending on the language of interaction. This paper presents an automated multilingual pipeline for generating, solving, and evaluating math problems aligned with the German K–10 curriculum. We generated 628 math exercises and translated them into English, German, and Arabic. Three commercial LLMs (GPT-4o-mini, Gemini 2.5 Flash, and Qwen-plus) were prompted to produce step-by-step solutions in each language. A held-out panel of LLM judges, including Claude 3.5 Haiku, evaluated solution quality using a comparative framework. Results show a consistent gap, with English solutions consistently rated highest, and Arabic often ranked lower. These findings highlight persistent linguistic bias and the need for more equitable multilingual AI systems in education. [orcid=0009-0003-0568-0172, [email protected], url=https://mariamkhmahran.github.io/connect/, ] *1 1 [orcid=0000-0001-6792-461X, [email protected], url=https://iug.htw-berlin.de, ] *1 1 keywords LLMs ,Fairness ,Education ,Language Bias ,Evaluation ,Equity † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: Accepted for presentation at edu4AI’25: 2nd Workshop on Education for Artificial Intelligence — co-located with ECAI, October 26th, 2025, Bologna, Italy † † address: HTW Berlin University of Applied Sciences, Treskowallee 8, 10318 Berlin, Germany † † corresp: Corresponding author † † These authors contributed equally. 1 Introduction As Large Language Models (LLMs) become increasingly embedded in educational tools, they are reshaping how students access academic support Yan et al. 2023 ; Gan et al. 2023 ; Li et al. 2024 . In subjects like mathematics, these models are often used to explain concepts, walk through problem-solving steps, and supplement classroom instruction Yan et al. 2023 . Nonetheless, most commercial LLMs are trained on overwhelmingly English-centric data, raising concerns about how effectively they perform in other languages Schut et al. 2025 ; Gupta et al. 2025 . In multilingual educational settings, this imbalance can have serious implications. Students interacting with the same model in different languages may receive responses that vary not only in fluency, but in clarity, accuracy, and pedagogical value Yan et al. 2023 ; Ko et al. 2025 . This variation is especially problematic in math education, where precise explanations and terminology are essential. Prior studies have highlighted significant language-related disparities in LLM outputs, particularly in educational contexts Ko et al. 2025 ; Gupta et al. 2025 . These findings underscore the importance of systematic, scalable evaluation across languages. In this paper, we present a scalable, automated pipeline for evaluating how language impacts the quality of LLM-generated math solutions. Covering generation, translation, solution, and evaluation, the framework supports consistent multilingual comparison across hundreds of exercises. Using three commercial models (GPT-4o-mini (OpenAI) OpenAI 2024 , Gemini-2.5-flash (Google) Google DeepMind 2025 , and Qwen-plus (Alibaba Cloud) Cloud 2025 ) we apply it to English, German, and Arabic to uncover persistent performance disparities in educational contexts. This work aims to drive future research toward reducing linguistic biases in AI education tools that serve learners regardless of language background. 2 LLMs in education: Use Cases & Biases LLMs are increasingly used in education to support both teachers and students. For educators, they assist with lesson planning, content creation, and assessment, helping reduce workload and improve efficiency Yan et al. 2023 ; Gan et al. 2023 . For students, they offer real-time, adaptive support that fosters independent learning, clarifies difficult concepts, and guides problem-solving Li et al. 2024 . Nonetheless, AI fairness in education is an increasing concern Simbeck 2024 . Growing evidence shows that LLMs introduce linguistic biases, particularly disadvantaging non-Western and low-resource language contexts Gupta et al. 2025 . Models often default to Western entities (i.e. names, foods, locations…etc) even when operating in non-Western languages like Arabic Naous et al. 2024 . Recent work also suggests that multilingual models often perform internal reasoning in English regardless of the prompt language Schut et al. 2025 . These tendencies raise concerns about the inclusivity and cultural relevance of AI-generated educational content. In mathematical reasoning tasks, LLMs have shown tendency to perform well in high-resource languages such as English and Chinese but struggle with languages like Korean due to difficulties processing non-English input Ko et al. 2025 . Recent work by Gupta et al. 2025 further demonstrate this gap by evaluating six LLMs on four educational tasks across six non-English languages. They find performance drops sharply in low-resource languages, correlating with training data representation. English prompts was also shown to outperform their translations across tasks. Such biases have real consequences. In grading and assessment contexts, models may favor Western argument structures, writing styles, and measurement systems placing non-Western students at a disadvantage. More broadly, the dominance of English-centric models reflects global educational inequality, as advanced AI tools remain most accessible to wealthier, English-speaking regions Yan et al. 2023 . 3 Dataset Creation 3.1 Dataset Generation & Translation This study uses a dataset of 628 math exercises spanning five topic areas and grade levels B through H (equivalent to Grades 2–10), based on the official German K–10 mathematics curriculum Ministerium für Bildung, Jugend und Sport des Landes Brandenburg und Senatsverwaltung für Bildung, Jugend und Wissenschaft des Landes Berlin 2015 . 1 1 1 Code and data are available at https://github.com/iug-htw/solution_evaluator . Exercises were generated using ChatGPT-4o (via the ChatGPT interface) in a manual, iterative process guided by curriculum-aligned topic names and learning objectives. Rather than replicating specific examples, the curriculum served as a conceptual reference to ensure broad topic coverage and grade-level appropriateness. Each item was then manually reviewed for clarity, pedagogical relevance, and alignment with the intended mathematical concept. Unclear, repetitive, or misaligned exercises were revised or removed. The resulting dataset consists of brief, one-line prompts focused on single operations or concepts, minimizing the risk for any contextual or linguistic bias. Table 1 shows example exercises. All exercises were initially written in English, then translated into German and Arabic using the GPT-4o-mini API. Given their concise and context-independent structure, the exercises were well-suited for machine translation. Nonetheless, all translations were manually audited to ensure semantic and linguistic appropriateness. Minor edits were applied as needed to maintain consistency across languages. Table 1: Examples of exercises across different topic areas and progress levels used in the study. Topic Area Topic Level Exercise Numbers and operations Understanding and representing numbers B (2nd grade) Show 28 using tens and ones. Sizes and measurement units of measurement C (4th grade) Convert 4,289 mL to liters. Geometry measuring and calculating F (8th grade) A triangle has sides 7, 24, and 25 cm. Prove it is a right triangle. Data frequencies and probabilities Compare and evaluate data E (7th grade) Which measure (mean, median, mode) best represents this data: 3, 3, 3, 4, 100? Functional relationships (patterns and structures) Linear and other simple functions H (10th) Determine the x-intercepts and asymptotes of the logarithmic function f(x) = ln(x - 2) 3.2 Solution Generation Three LLMs were used in this study: GPT-4o-mini , Gemini 2.5 Flash , and Qwen-plus . Each was prompted to generate step-by-step solutions in English, German, and Arabic. The prompts, written in the target language, asked the