Gradient-Based LoRA Rank Allocation Under GRPO: An Empirical Study

Yash Ganpat Sawant · 2026

Read Gradient-Based LoRA Rank Allocation Under GRPO: An Empirical Study by Yash Ganpat Sawant (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07366.txt.

Description

Yash Ganpat Sawant reports a blunt negative result: adaptive sizing of LoRA adapters, guided by gradient importance, fails under reinforcement learning fine-tuning. The same approach works well in supervised fine-tuning, where a few layers carry most gradient signal. Under the GRPO method tested here, the gradient landscape was far flatter across layers.

Giving more room to favored layers lowered the score versus uniform sizing at the same budget. Worse, uneven sizing fed on itself, as high-rank layers took still more gradient. A random-allocation control showed rank itself drives measured weight. Sawant presents the single-task finding as early evidence against importing supervised-era rules of thumb into alignment training.

Catalog record

CREATORYash Ganpat Sawant
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07366

Browse the full library · About the Tower of Babel