PHF: Privileged Hidden Flow for On-Policy Self-Distillation
Yuhan Li, Mingxu Zhang, Dazhong Shen, Ying Sun · 2026
Read PHF: Privileged Hidden Flow for On-Policy Self-Distillation by Yuhan Li, Mingxu Zhang, Dazhong Shen, Ying Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29340.txt.
Description
Li and three colleagues improve a training method where a reasoning model learns from its own attempts, guided by a teacher that also sees the checked answer. Such on-policy self-distillation usually supervises only the output distribution, the odds over next tokens. The privileged context then shapes training only through that token-level signal, never touching the inner computation that produced it.
Their method, Privileged Hidden Flow, also distils how the teacher's hidden states flow through the same attempt. Instead of forcing each student hidden vector to equal the teacher's at the same token, it aligns the directions of token-to-token transitions and the shape of the whole trajectory, at every layer. Under the same hundred-step schedule it beat the reproduced baseline on three model sizes, gaining roughly two points on average. Ablations separate its effect from simply matching hidden states point by point.
Catalog record
| CREATOR | Yuhan Li, Mingxu Zhang, Dazhong Shen, Ying Sun |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29340