AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment

Zhenlin Wei, Pu Jian, Yingzhuo Deng, Xiaohan Wang, Jiajun Chai, Zhexin Hu, Wei Lin, Shanbin Zhang, Guojun Yin · 2026

Read AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment by Zhenlin Wei, Pu Jian, Yingzhuo Deng, Xiaohan Wang, Jiajun Chai, Zhexin Hu, Wei Lin, Shanbin Zhang, Guojun Yin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18529.txt.

Description

Zhenlin Wei and eight co-authors present AMR-SD, a 2026 asymmetric meta-reflective self-distillation method. It tackles token-level credit assignment in reinforcement learning with verifiable rewards. Instead of raw oracle traces, it squeezes diagnostic signals into short self-made Socratic hints and critiques. A causal information gain trick with an asymmetric ReLU-gated cutoff turns reflections into sparse token-level advantage tweaks. Across scientific, mathematical, and tool-use benchmarks it beats baselines with robust long-horizon stability and no late-stage collapse.

Catalog record

CREATORZhenlin Wei, Pu Jian, Yingzhuo Deng, Xiaohan Wang, Jiajun Chai, Zhexin Hu, Wei Lin, Shanbin Zhang, Guojun Yin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63160
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18529

Browse the full library · About the Tower of Babel