Learning to Reason in 13 Parameters

John X. Morris, Niloofar Mireshghallah, Mark Ibrahim, Saeed Mahloujifar · 2026

Read Learning to Reason in 13 Parameters by John X. Morris, Niloofar Mireshghallah, Mark Ibrahim, Saeed Mahloujifar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04118.txt.

Introduction

Thirteen numbers can teach an eight-billion-parameter model to reason. John X. Morris and 3 co-authors report that startling result in a 2026 paper on TinyLoRA. Low-rank adapters normally still need thousands of parameters. Their parametrization shrinks updates to as few as one learned number.

With thirteen trained parameters, the model reached high accuracy on grade-school math problems. Across harder benchmarks, the method recovered most of the gain of full fine-tuning with a thousand times fewer parameters. Crucially, only reinforcement learning achieved this; supervised training needed far larger updates. Reasoning, the result hints, may be a low-dimensional skill hiding inside pretrained models.

Catalog record

CREATORJohn X. Morris, Niloofar Mireshghallah, Mark Ibrahim, Saeed Mahloujifar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04118

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning to Reason in 13 Parameters John X. Morris, Niloofar Mireshghallah, Mark Ibrahim, Saeed Mahloujifar Abstract Recent research has shown that language models can learn to reason , often via reinforcement learning. Some work even trains low-rank parameterizations for reasoning, but conventional LoRA cannot scale below the model dimension. We question whether even rank=1 LoRA is necessary for learning to reason and propose TinyLoRA, a method for scaling low-rank adapters to sizes as small as one parameter. Within our new parameterization, we are able to train the 8B parameter size of Qwen2.5 to 91% accuracy on GSM8K with only 13 trained parameters in bf16 (26 total bytes). We find this trend holds in general: we are able to recover 90% of performance improvements while training 1000 ​ x 1000x fewer parameters across a suite of more difficult learning-to-reason benchmarks such as AIME, AMC, and MATH500. Notably, we are only able to achieve such strong performance with RL: models trained using SFT require 100 − 1000 ​ x 100-1000x larger updates to reach the same performance. † † affiliation: FAIR at Meta † † affiliation: Cornell University † † affiliation: Carnegie Mellon University † † date: August 10, 2026 Figure 1: Using Qwen2.5-7B-Instruct as a base model, our TinyLoRA achieves performance within 5% of full finetuning on GSM8K with only 13 parameters. Dashed lines indicate untrained and full-FT baselines. Figure 2: Using Qwen2.5-7B-Instruct as a base model, SFT works best with larger update sizes of at least 1M parameters. 1 Introduction Modern language models are post-trained to "reason" in additional thinking tokens through reinforcement learning. Training for reasoning typically takes place through reinforcement learning with verifiable rewards (RLVR) and evaluated in reasoning-intensive domains such as math and coding ( OpenAI et al. 2024 ; Shao et al. 2024 ; Luo et al. 2025 ) . Although many practitioners finetune the entire model for reasoning (typically in the billions of parameters) ( Guha et al. 2025 ) , a popular class of parameter-efficient methods such as Low-Rank Adaptation (LoRA) ( Hu et al. 2021 ) reduce this requirement from billions to just millions of "adapter" parameters, a reduction of several orders of magnitude. Even so, model updates remain large: for Llama3-8B, running LoRA at its smallest setting (rank 1) finetunes a minimum of 3M parameters ( Schulman and Lab 2025 ) . This parameter count looks surprisingly large compared to past work ( Cuccu et al. 2019 ) , which showed certain toy settings such as Atari games can be adequately solved using just six neurons. There are many advantages to training with fewer parameters. Finetuning fewer parameters reduces per-GPU memory usage as well as the communication cost of distributed training. At inference time, more LoRAs can be stored in memory: a 10x reduction in the size of an adapter allows 10x more LoRAs to be served concurrently ( Chen et al. 2023 ) , enabling efficient personalization at scale. Past work ( Biderman et al. 2024 ) also shows that low-rank model updates can mitigate forgetting by retaining important information present in the base model. Given these benefits, how can we achieve even greater parameter efficiency? Prior work has focused primarily on supervised finetuning ( Hu et al. 2021 ; Li and Liang 2021 ; Zaken et al. 2022 ; Biderman et al. 2024 ) . We observe that good performance in supervised learning requires absorbing many more bits of information into the model than in RL. Excitingly, the converse also holds: when finetuning with RL, we can achieve comparable performance with much smaller updates. This observation leads us to propose an RL-based alternative that enables finetuning with orders of magnitude fewer parameters than standard LoRA-based SFT. We consider conventional LoRA ( Hu et al. 2021 ) and the smaller LoRA-XS ( Hu et al. 2021 ) which allow us to scale update sizes from 10^{6} down to 10^{4} parameters. On math tasks, RL is much more effective than SFT in the low-parameter regime (under 1 million parameters trained). On the GSM8K dataset of math word problems, Qwen-2.5-7B-Instruct improves from 76% to 95% while training just 10,000 parameters. Since models experience such little performance degradation at 10^{4} parameters, we develop a new method (TinyLoRA) to scale LoRA down arbitrarily: our smallest update size is just a single parameter. TinyLoRA is an extra low-rank variant of LoRA that scales smoothly down to just one trained parameter. When training Qwen2.5-7B-Instruct with TinyLoRA and GRPO on GSM8K, we achieve 91% accuracy while finetuning just 13 total parameters , an update size of just 26 bytes. We show that such low-capacity model updates only succeed in the case of RL, and are not information-dense enough to work well for SFT. On GSM8K, models trained with GRPO can obtain 90% accuracy with fewer than 100 parameters, while models of this capacity trained with SFT barely outperform base models on the training set. These findings imply that RL makes fundamentally more information-dense updates than SFT and is more suitable for training in the tiny update size regime. We also evaluate TinyLoRA on more sophisticated learning-to-reason benchmarks including MATH, AIME, and AMC. We again observe strong performance in the extremely-low parameter regime. As one datapoint, finetuning Qwen-2.5-7B-Instruct for just 196 parameters retains 87% of its absolute performance improvement, averaged across six difficult math benchmarks. Figure 3: Minimal-sized parameter update to hit threshold of maximum performance vs. backbone model size. Larger models require smaller updates to reach e.g. 95% of peak performance. Figure 4: Performance ablation using Qwen2.5-3B-Instruct under extremely small update size (<1KB). Surprisingly, storing parameters in fp32 is most performant bit-for-bit. 2 Related Work Parameter-efficient finetuning. Our progress scaling LoRA to low parameter counts is part of an ongoing effort to improve low-rank adaptation as evidenced through the slew of proposed related mesthods such as VeRA ( Kopiczko et al. 2023 ) , VB-LoRA ( Li et al. 2024b ) , LoRA-XS ( Bałazy et al. 2025 ) , UniLoRA ( Li et al. 2025 ) , AdaLoRA ( Zhang et al. 2023 ) , LoRA Drop ( Zhou et al. 2024 ) , NoRA ( Lin et al. 2024 ) , WeightLoRA ( Veprikov et al. 2025 ) , and ShareLoRA ( Song et al. 2025 ) . We do not advocate for a specific initialization or even parameterization. Rather, we focus on simple methods for scaling to these techniques to low numbers of parameters (<10K), where the vast majority of other work on low-rank adaptation is done at the 10K–10M parameter scale. We show that even more efficient parameterizations are possible because we use larger models (billions of parameters) and train with RL as opposed to SFT. Learning under data and parameter constraints. Another line of work questions how much data is necessary for reasoning, finding that a thousand examples is sufficient for SFT ( Ye et al. 2025 ) and, under certain settings, RL can learn with only one example ( Wang et al. 2025 ) . Our analysis of the pareto frontier between update size and performance relates to the general principle that overparameterized models lie on a manifold of a low intrinsic dimension ( Li et al. 2018 ; Aghajanyan et al.

Read the complete text