Rethinking GSPO: The Perplexity-Entropy Equivalence

Chi Liu · 2025

Read Rethinking GSPO: The Perplexity-Entropy Equivalence by Chi Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23142.txt.

Description

Chi Liu reframes a recent training method, GSPO, through information theory. GSPO uses length-normalized importance ratios at the sequence level to weight policy updates. Liu shows that its weight can be written exactly as an inverse perplexity ratio between the old and new policies.

The same weight also equals the exponential of the cross-entropy change. While the link between perplexity and entropy follows from standard definitions, seeing GSPO through that lens clarifies what the algorithm rewards. Trainers can now reason about updates as perplexity shifts, which may guide safer tuning of language model reinforcement learning.

Catalog record

CREATORChi Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-23142

Browse the full library · About the Tower of Babel