L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning

Pranjal Aggarwal, Sean Welleck · 2025

Read L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning by Pranjal Aggarwal, Sean Welleck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04697.txt.

Description

A reasoning model that thinks longer answers better, but no one could set the think time by the ask. Pranjal Aggarwal and Sean Welleck hand the user that knob in 2025. Their training way pays the model for right answers that land inside a word budget named in the prompt itself. The trained model, L1, slides its effort smooth from terse to deep as the budget moves.

On the standard length-control test it beat the past best way. A side find surprised the pair: squeezed models kept the habits of full-length thinkers in a fraction of the words. Their small L1 matched a flagship chat model answer for answer at the same think length. Code and models are posted.

Catalog record

CREATORPranjal Aggarwal, Sean Welleck
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04697

Browse the full library · About the Tower of Babel