Rethinking GSPO: The Perplexity-Entropy Equivalence
Chi Liu · 2025
Read Rethinking GSPO: The Perplexity-Entropy Equivalence by Chi Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23142.txt.
Description
Chi Liu reframes a recent training method, GSPO, through information theory. GSPO uses length-normalized importance ratios at the sequence level to weight policy updates. Liu shows that its weight can be written exactly as an inverse perplexity ratio between the old and new policies.
The same weight also equals the exponential of the cross-entropy change. While the link between perplexity and entropy follows from standard definitions, seeing GSPO through that lens clarifies what the algorithm rewards. Trainers can now reason about updates as perplexity shifts, which may guide safer tuning of language model reinforcement learning.
Catalog record
| CREATOR | Chi Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23142