Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models

Wenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju, Zhenbo Luo, Qian Cao, Rita Cucchiara, Ruihua Song, Jian Luan · 2026

Read Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models by Wenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju, Zhenbo Luo, Qian Cao, Rita Cucchiara, Ruihua Song, Jian Luan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01698.txt.

Description

Wenhui Tan and colleagues restore exploration in reasoning models after training, where temperature sampling stops helping accuracy. Post training collapses exploration: final layer entropy falls, while middle layer entropy stays high. Their Latent Exploration Decoding adds middle outputs by cumulative sum and picks depth settings with entropy as exploration options. With no extra training, it lifts accuracy by under one point at pass one and just over one point at pass sixteen across reasoning benchmarks and models.

Catalog record

CREATORWenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju, Zhenbo Luo, Qian Cao, Rita Cucchiara, Ruihua Song, Jian Luan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56114
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01698

Browse the full library · About the Tower of Babel