Matching Accuracy, Different Geometry: Evolution Strategies vs GRPO in LLM Post-Training

William Hoy, Binxu Wang, Xu Pan, [0.5em] Department of Industrial, Systems Engineering, University of Miami, [0.3em] [email protected] · 2026

Read Matching Accuracy, Different Geometry: Evolution Strategies vs GRPO in LLM Post-Training by William Hoy, Binxu Wang, Xu Pan, [0.5em] Department of Industrial, Systems Engineering, University of Miami, [0.3em] [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01499.txt.

Description

Hoy and colleagues compare evolution methods and Group Relative Policy Optimization across single tasks and task chains. Evolution strategies match or beat GRPO in accuracy and stay competitive when iteration budget is capped. Despite similar task results, the methods produce different model updates: evolution methods make larger changes and broader off-task KL drift, while GRPO makes smaller, more local updates. The evolution-strategy and GRPO results are linearly connected with no loss barrier, even though their update directions are nearly orthogonal. They develop a theory for the method.

Catalog record

CREATORWilliam Hoy, Binxu Wang, Xu Pan, [0.5em] Department of Industrial, Systems Engineering, University of Miami, [0.3em] [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE103964
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.01499

Browse the full library · About the Tower of Babel