Matching Accuracy, Different Geometry: Evolution Strategies vs GRPO in LLM Post-Training
William Hoy, Binxu Wang, Xu Pan, [0.5em] Department of Industrial, Systems Engineering, University of Miami, [0.3em] [email protected] · 2026
Read Matching Accuracy, Different Geometry: Evolution Strategies vs GRPO in LLM Post-Training by William Hoy, Binxu Wang, Xu Pan, [0.5em] Department of Industrial, Systems Engineering, University of Miami, [0.3em] [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01499.txt.
Description
Hoy and colleagues compare evolution methods and Group Relative Policy Optimization across single tasks and task chains. Evolution strategies match or beat GRPO in accuracy and stay competitive when iteration budget is capped. Despite similar task results, the methods produce different model updates: evolution methods make larger changes and broader off-task KL drift, while GRPO makes smaller, more local updates. The evolution-strategy and GRPO results are linearly connected with no loss barrier, even though their update directions are nearly orthogonal. They develop a theory for the method.
Catalog record
| CREATOR | William Hoy, Binxu Wang, Xu Pan, [0.5em] Department of Industrial, Systems Engineering, University of Miami, [0.3em] [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 103964 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.01499