DART: Difficulty-Adaptive Reasoning Truncation for Efficient Large Language Models

Ruofan Zhang, Bin Xia, Zhen Cheng, Cairen Jian, Minglun Yang, Ngai Wong, Yuan Cheng · 2025

Read DART: Difficulty-Adaptive Reasoning Truncation for Efficient Large Language Models by Ruofan Zhang, Bin Xia, Zhen Cheng, Cairen Jian, Minglun Yang, Ngai Wong, Yuan Cheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01170.txt.

Description

Ruofan Zhang and colleagues propose DART, a way to teach language models to stop thinking sooner on easy problems. Chain of thought reasoning improves accuracy, but models produce long explanations even when the problem is simple, wasting computation. Earlier reinforcement learning attempts to fix this were unstable and depended heavily on reward design.

DART is supervised instead. It distills concise reasoning patterns from stronger models, interpolates them into a continuum of reasoning styles, and curates training data that balances correctness with compactness, so the model learns when to stop. On mathematical benchmarks it preserved or improved accuracy while cutting reasoning output sharply, in one reported case by over eighty percent with more than five times faster computation.

Catalog record

CREATORRuofan Zhang, Bin Xia, Zhen Cheng, Cairen Jian, Minglun Yang, Ngai Wong, Yuan Cheng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01170

Browse the full library · About the Tower of Babel