The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates

Shaobo Wang Guo Chen Ziyue Wang Zhengyang Tang, Qingyang Liu Xingzhang Ren Dayiheng Liu Linfeng Zhang, Shanghai Jiao Tong University Qwen Team, Alibaba Group, The Chinese University of Hong Kong, Shenzhen · 2026

Read The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates by Shaobo Wang Guo Chen Ziyue Wang Zhengyang Tang, Qingyang Liu Xingzhang Ren Dayiheng Liu Linfeng Zhang, Shanghai Jiao Tong University Qwen Team, Alibaba Group, The Chinese University of Hong Kong, Shenzhen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28020.txt.

Description

Wang and colleagues wake task behavior in frozen pretrained models with no extra training. Their Energy-Based Decoding steers text with a light reward model tied to the base model's own habits. It raised one base model's instruction scores steeply and cut another's math wait sharply, giving a fairer read of raw pretrained skill.

Catalog record

CREATORShaobo Wang Guo Chen Ziyue Wang Zhengyang Tang, Qingyang Liu Xingzhang Ren Dayiheng Liu Linfeng Zhang, Shanghai Jiao Tong University Qwen Team, Alibaba Group, The Chinese University of Hong Kong, Shenzhen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46464
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28020

Browse the full library · About the Tower of Babel