EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning

Sanchit Ahuja, Praneetha Vaddamanu*, Barun Patra · 2025

Read EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning by Sanchit Ahuja, Praneetha Vaddamanu*, Barun Patra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00246.txt.

Introduction

Sanchit Ahuja, Praneetha Vaddamanu, and Barun Patra ask whether English is the leanest language for machine reasoning in this 2025 paper. Reasoning models are mostly tuned in English, yet they train on many tongues. The team tested three open models on math sets in seven diverse languages.

Reasoning in other languages used fewer tokens while keeping accuracy, they found. The savings survived translation of the traces back into English, hinting at real shifts in reasoning style, not mere word length. Gains hinged on each model's multilingual strength. The authors call for wider multilingual care in reasoning research. Code is public.

Catalog record

CREATORSanchit Ahuja, Praneetha Vaddamanu*, Barun Patra
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00246

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning Sanchit Ahuja, Praneetha Vaddamanu*, Barun Patra Abstract Despite recent advances in Reasoning Language Models (RLMs), most research focuses solely on English, even though many models are pretrained on multilingual data. In this work, we investigate: Is English the most token-efficient language for reasoning? We evaluate three open-source RLMs: DeepSeek R1 , Qwen 2.5 , and Qwen 3 , across four math datasets and seven typologically diverse languages. We find that reasoning in non-English languages not only reduces token usage, but also preserves accuracy. These gains persist even after translating the reasoning traces into English, suggesting genuine shifts in reasoning behavior rather than surface-level linguistic effects. The extent of improvement, however, depends on the model’s multilingual strength. Our findings motivate a broader view of reasoning in language models, highlighting the potential of multilingual reasoning and the importance of strong multilingual foundations. The code for our work can be found here . 1 Introduction Recent advancements have shown that increasing inference-time compute can significantly enhance the downstream performance of large language models. In particular, RLMs benefit from extended test-time computation through long chains-of-thought, resulting in improved reasoning capabilities and task performance ( DeepSeek-AI 2025 ; OpenAI et al. 2024b ) . Despite this progress, the majority of prior work has focused on reasoning in English, implicitly assuming it as the default or optimal language for thought ( Wendler et al. 2024 ) . A key limitation of current RLMs lies in the number of “thinking tokens” they consume during inference. Since test-time compute scales with the number of tokens generated, longer reasoning traces directly impact latency and cost. This inefficiency is often exacerbated by the phenomenon of overthinking ( Cuadron et al. 2025b ) , where models produce unnecessarily verbose intermediate reasoning. To address this, several works have explored length-aware rewards in reinforcement learning setups to encourage brevity in reasoning traces ( Aggarwal & Welleck 2025 ; Sui et al. 2025b ) . However, these approaches typically require model retraining, which is computationally expensive and infeasible for many practitioners. In this work, we take a different perspective on language and reasoning by asking a simple yet underexplored question: Is English the most efficient language for reasoning? We explore whether reasoning in other languages can produce shorter but equally effective reasoning traces, potentially reducing inference-time compute. This question is timely for two reasons: (1) many reasoning language models (RLMs) are multilingual by design ( Team 2025a ) ; and (2) prior work suggests that languages vary in how clearly they express mathematical ideas, affecting reasoning performance ( Han 2001 ) . Our key contributions are: - We show that across a range of mathematical reasoning datasets, reasoning in alternative languages consistently results in fewer tokens, often matching the final English accuracy. - We demonstrate that even when translated back to English, reasoning traces originally generated in other languages remain shorter than those natively generated in English. This suggests that the reduction in token count is not merely a function of tokenizer fertility or linguistic compactness, but reflects genuine differences in the characteristics of reasoning traces compared to their English counterparts. - We provide quantitative evidence that English is not always the most effective language for reasoning, with traces in other languages consistently preferred for their conciseness, clarity, and structure. Model en zh ru es TLP@4 TLC Tok. \Delta %TLP@4 TLC \Delta %Tok \Delta %TLP@4 TLC \Delta %Tok \Delta %TLP@4 TLC \Delta %Tok DeepSeek R1 0.87 1.000 3816 4.6% 1.000 21.1% 4.3% 1.000 14.1% -0.9% 0.985 29.9% Qwen 2.5 0.87 1.000 6249 3.8% 0.796 21.4% 23.3% 0.340 38.2% 82.0% 0.056 88.1% Qwen 3 0.89 0.998 6123 0.9% 0.987 27.7% -0.3% 0.996 35.8% 1.7% 0.583 73.0% (a) Model ar tr hi ko \Delta %TLP@4 TLC \Delta %Tok \Delta %TLP@4 TLC \Delta %Tok \Delta %TLP@4 TLC \Delta %Tok \Delta %TLP@4 TLC \Delta %Tok DeepSeek R1 7.4% 0.901 28.2% 8.3% 1.000 8.3% 8.0% 0.971 7.7% 9.5% 0.997 43.9% Qwen 2.5 57.2% 0.177 68.1% 29.3% 0.444 52.3% 58.3% 0.097 41.3% 81.4% 0.059 90.1% Qwen 3 15.7% 0.666 47.4% 18.5% 0.721 59.6% 16.3% 0.887 23.7% 17.1% 0.574 47.4% (b) Table 1: Performance relative to English: TLP@4 and mean token count are reported as percentage change from English; Target Language Consistency (TLC) is reported directly. en ko es zh hi ru tr ar Dataset TLP@4 Tokens \Delta %TLP@4 \Delta %Tok \Delta %TLP@4 \Delta %Tok \Delta %TLP@4 \Delta %Tok \Delta %TLP@4 \Delta %Tok \Delta %TLP@4 \Delta %Tok \Delta %TLP@4 \Delta %Tok \Delta %TLP@4 \Delta %Tok MATH500 0.77 1404.24 0.00 37.80 0.00 32.85 0.00 18.41 0.00 17.81 0.00 36.96 0.00 5.78 0.00 26.98 AMC23 1.00 3571.1 3.00 42.09 0.00 25.20 1.00 14.44 2.00 -0.83 3.00 27.22 4.00 -12.29 4.00 25.87 AIME2024 0.89 5637.27 12.36 42.40 4.49 21.95 11.24 27.07 12.36 -13.58 8.99 0.57 11.24 -11.08 11.24 17.43 AIME2025 0.81 7979.17 24.69 47.78 2.47 36.54 4.94 20.43 18.52 25.79 4.94 13.29 18.52 32.13 13.58 37.24 Table 2: Both TLP@4 and mean token count are reported as percentage changes from English. Color intensity ranges from orange to green/yellow, where brighter shades (green/yellow) indicate greater deviation from English performance, while duller shades like orange represent minimal or no deviation. 2 Experiments To assess whether reasoning in other languages can enhance thinking token efficiency, we experiment with seven typologically diverse languages: Chinese, Russian, Spanish, Hindi, Arabic, Korean, and Turkish, along with English. We prompt the reasoning models in English, instructing them to carry out their reasoning in the target language while providing the final answer in English. This setup allows us to isolate the effect of language on the reasoning process itself. For inferencing, we used the SGLang framework Zheng et al. 2024 , which facilitates the extraction of intermediate reasoning traces. 1 1 1 The exact prompt we use can be found in Appendix A . We now detail our experimental setup. Datasets : We evaluate our hypothesis in a variety of math datasets, which we categorize into easy and difficult subsets based on the complexity of the problem and the typical performance of existing models. The difficult datasets include AIME2024 Veeraboina 2023 and AIME2025 Art of Problem Solving 2025a ; Art of Problem Solving 2025b , which feature competition-level problems that require advanced reasoning. The easy datasets include AMC23 Art of Problem Solving 2023a ; Art of Problem Solving 2023b , and MATH500 Lightman et al. 2023 comprising of simpler problems. Models : We explore three open-weight reasoning models for our experiments: Deepseek R1 DeepSeek-AI 2025 , QwQ (based on the 32B variant of Qwen 2.5 ) ( Yang et al. 2024 ; Team 2025b ) , and Qwen3 (Qwen3-235B-A22B), the latest model focused on reasoning of the Qwen family Team 2025a . Evaluation : Following the evaluation setup of Deepseek R1 , we set the maximum generation length to 32,768 tokens. For response generation, we use a sampling temperature of 0.6 and a top- p value of 0.95, generating n=16 responses across all models and datasets. Metrics: Different RLMs vary in their ability to follow prompt instructions for generating reasoning traces in the indicated target language. To better evaluate multilingual reasoning performance, we introduce two complimentary metrics: Target Language Consistency (TLC), and Target Language Pass

Read the complete text