SEAL: Steerable Reasoning Calibration of Large Language Models for Free
Runjin Chen, Zhenyu Zhang, Junyuan Hong, Souvik Kundu, Zhangyang Wang · 2025
Read SEAL: Steerable Reasoning Calibration of Large Language Models for Free by Runjin Chen, Zhenyu Zhang, Junyuan Hong, Souvik Kundu, Zhangyang Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07986.txt.
Description
Runjin Chen, Zhenyu Zhang, Junyuan Hong, Souvik Kundu, and Zhangyang Wang trim waste in model reasoning in a 2025 paper. Long chain-of-thought traces help large models solve hard tasks, but much of that text is redundant. Extra reflection and transition thoughts link strongly to failed answers, the team finds. Those thought types also sit apart in the model's hidden space.
Their method, SEAL, extracts a steering vector for good reasoning offline. At run time it nudges the hidden state along that vector, with no training. Accuracy rises by up to eleven percent across math and code benchmarks, they report, while token counts fall sharply.
Catalog record
| CREATOR | Runjin Chen, Zhenyu Zhang, Junyuan Hong, Souvik Kundu, Zhangyang Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07986