Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models
Wenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju, Zhenbo Luo, Qian Cao, Rita Cucchiara, Ruihua Song, Jian Luan · 2026
Read Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models by Wenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju, Zhenbo Luo, Qian Cao, Rita Cucchiara, Ruihua Song, Jian Luan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01698.txt.
Description
Wenhui Tan and colleagues restore exploration in reasoning models after training, where temperature sampling stops helping accuracy. Post training collapses exploration: final layer entropy falls, while middle layer entropy stays high. Their Latent Exploration Decoding adds middle outputs by cumulative sum and picks depth settings with entropy as exploration options. With no extra training, it lifts accuracy by under one point at pass one and just over one point at pass sixteen across reasoning benchmarks and models.
Catalog record
| CREATOR | Wenhui Tan, Fiorenzo Parascandolo, Enver Sangineto, Jianzhong Ju, Zhenbo Luo, Qian Cao, Rita Cucchiara, Ruihua Song, Jian Luan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56114 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01698