Co-Evolving Policy Distillation

Naibin Gu, Chenxu Yang, Qingyi Si, Chuanyu Qin, Dingyu Yao, Peng Fu, Zheng Lin, Weiping Wang, Nan Duan, Jiaqi Wang · 2026

Read Co-Evolving Policy Distillation by Naibin Gu, Chenxu Yang, Qingyi Si, Chuanyu Qin, Dingyu Yao, Peng Fu, Zheng Lin, Weiping Wang, Nan Duan, Jiaqi Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27083.txt.

Description

Gu and nine colleagues analyze RLVR and OPD, two ways to fold several expert capabilities into one model. Mixed RLVR suffers divergence cost, while training experts first then distilling with OPD avoids divergence but fails to fully absorb teacher skills, due to large teacher-student gaps. Their CoPD trains experts in parallel and inserts OPD during their ongoing RLVR training, with experts as mutual teachers, so patterns co-evolve. Experiments show CoPD integrates text, image, and video reasoning, beating strong baselines and even domain experts.

Catalog record

CREATORNaibin Gu, Chenxu Yang, Qingyi Si, Chuanyu Qin, Dingyu Yao, Peng Fu, Zheng Lin, Weiping Wang, Nan Duan, Jiaqi Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48735
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27083

Browse the full library · About the Tower of Babel