The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates
Shaobo Wang Guo Chen Ziyue Wang Zhengyang Tang, Qingyang Liu Xingzhang Ren Dayiheng Liu Linfeng Zhang, Shanghai Jiao Tong University Qwen Team, Alibaba Group, The Chinese University of Hong Kong, Shenzhen · 2026
Read The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates by Shaobo Wang Guo Chen Ziyue Wang Zhengyang Tang, Qingyang Liu Xingzhang Ren Dayiheng Liu Linfeng Zhang, Shanghai Jiao Tong University Qwen Team, Alibaba Group, The Chinese University of Hong Kong, Shenzhen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28020.txt.
Description
Wang and colleagues wake task behavior in frozen pretrained models with no extra training. Their Energy-Based Decoding steers text with a light reward model tied to the base model's own habits. It raised one base model's instruction scores steeply and cut another's math wait sharply, giving a fairer read of raw pretrained skill.
Catalog record
| CREATOR | Shaobo Wang Guo Chen Ziyue Wang Zhengyang Tang, Qingyang Liu Xingzhang Ren Dayiheng Liu Linfeng Zhang, Shanghai Jiao Tong University Qwen Team, Alibaba Group, The Chinese University of Hong Kong, Shenzhen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46464 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28020